2023-11-25T03:56:11.670 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-25T03:56:11.670 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-11-24_21:17:59-fs-main-distro-default-smithi/7466115 --owner scheduled_yuriw@teuthology --verbose --name yuriw-2023-11-24_21:17:59-fs-main-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/yuriw-2023-11-24_21:17:59-fs-main-distro-default-smithi/7466115/orig.config.yaml 2023-11-25T03:56:11.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-25T03:56:11.841 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-24_21:17:59-fs-main-distro-default-smithi/7466115 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: yweinste@redhat.com first_in_suite: false job_id: '7466115' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-24_21:17:59-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: ec928368edcc5fc71884a56fd9fd821b148f4e30 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ec928368edcc5fc71884a56fd9fd821b148f4e30 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: ec928368edcc5fc71884a56fd9fd821b148f4e30 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3835 sha1: ec928368edcc5fc71884a56fd9fd821b148f4e30 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ec928368edcc5fc71884a56fd9fd821b148f4e30/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ec928368edcc5fc71884a56fd9fd821b148f4e30 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHc51PXXRxSzC+BqOt6g9ojwk6cJzxVQyz0RoKj8Hhxgk8Ukm/8OlwY+NyzTnHbMRlYD/6r6pqmbevq7N0e1mDs= smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJtEdNF+oxWvn7RPGqOLcMXe4dgVXdaGiu1ubTeQn9ot1ysTU+5+bXCxXbhcxj5EM/oHLBFLAMFUmUQ46wKy9ws= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_21:17:59 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-25T03:56:11.841 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ec928368edcc5fc71884a56fd9fd821b148f4e30/qa; will attempt to use it 2023-11-25T03:56:11.842 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ec928368edcc5fc71884a56fd9fd821b148f4e30/qa/tasks 2023-11-25T03:56:11.842 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-25T03:56:11.844 INFO:teuthology.task.internal:Checking packages... 2023-11-25T03:56:11.870 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ec928368edcc5fc71884a56fd9fd821b148f4e30' 2023-11-25T03:56:11.870 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-25T03:56:11.870 INFO:teuthology.packaging:ref: None 2023-11-25T03:56:11.870 INFO:teuthology.packaging:tag: None 2023-11-25T03:56:11.870 INFO:teuthology.packaging:branch: main 2023-11-25T03:56:11.870 INFO:teuthology.packaging:sha1: ec928368edcc5fc71884a56fd9fd821b148f4e30 2023-11-25T03:56:11.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2023-11-25T03:56:12.213 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7506.gec928368 2023-11-25T03:56:12.213 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-25T03:56:12.219 INFO:teuthology.task.internal:no buildpackages task found 2023-11-25T03:56:12.219 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-25T03:56:12.229 INFO:teuthology.task.internal:Saving configuration 2023-11-25T03:56:12.247 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-25T03:56:12.252 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-25T03:56:12.277 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-24_21:17:59-fs-main-distro-default-smithi/7466115', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-25 03:49:48.539733', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHc51PXXRxSzC+BqOt6g9ojwk6cJzxVQyz0RoKj8Hhxgk8Ukm/8OlwY+NyzTnHbMRlYD/6r6pqmbevq7N0e1mDs='} 2023-11-25T03:56:12.299 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-24_21:17:59-fs-main-distro-default-smithi/7466115', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-25 03:49:48.541102', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJtEdNF+oxWvn7RPGqOLcMXe4dgVXdaGiu1ubTeQn9ot1ysTU+5+bXCxXbhcxj5EM/oHLBFLAMFUmUQ46wKy9ws='} 2023-11-25T03:56:12.299 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-25T03:56:12.306 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-25T03:56:12.306 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-25T03:56:12.306 INFO:teuthology.run_tasks:Running task console_log... 2023-11-25T03:56:12.381 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0c6dc7f0d0>, signals=[15]) 2023-11-25T03:56:12.381 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-25T03:56:12.387 INFO:teuthology.task.internal:Opening connections... 2023-11-25T03:56:12.388 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T03:56:12.389 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:56:12.490 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T03:56:12.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:56:12.591 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-25T03:56:12.600 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2023-11-25T03:56:12.618 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2023-11-25T03:56:12.618 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2023-11-25T03:56:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2023-11-25T03:56:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2023-11-25T03:56:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2023-11-25T03:56:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2023-11-25T03:56:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2023-11-25T03:56:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2023-11-25T03:56:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-25T03:56:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2023-11-25T03:56:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2023-11-25T03:56:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-25T03:56:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2023-11-25T03:56:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T03:56:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-25T03:56:12.676 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-25T03:56:12.677 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2023-11-25T03:56:12.695 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2023-11-25T03:56:12.713 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2023-11-25T03:56:12.714 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-11-25T03:56:12.774 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2023-11-25T03:56:12.774 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2023-11-25T03:56:12.774 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2023-11-25T03:56:12.774 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2023-11-25T03:56:12.774 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2023-11-25T03:56:12.774 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2023-11-25T03:56:12.774 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2023-11-25T03:56:12.774 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-11-25T03:56:12.775 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2023-11-25T03:56:12.775 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-11-25T03:56:12.775 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2023-11-25T03:56:12.775 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-25T03:56:12.775 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-11-25T03:56:12.775 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-11-25T03:56:12.775 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-11-25T03:56:12.795 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-25T03:56:12.807 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-25T03:56:12.813 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-25T03:56:12.813 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2023-11-25T03:56:12.816 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2023-11-25T03:56:12.833 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-25T03:56:12.838 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-25T03:56:12.838 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2023-11-25T03:56:12.874 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2023-11-25T03:56:12.903 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-25T03:56:12.960 INFO:teuthology.run_tasks:Running task kernel... 2023-11-25T03:56:12.975 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-11-25T03:56:12.975 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-11-25T03:56:12.976 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-25T03:56:12.976 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-25T03:56:12.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T03:56:12.992 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2023-11-25T03:56:12.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T03:56:12.993 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2023-11-25T03:56:13.051 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-361.el9.x86_64 2023-11-25T03:56:13.051 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-361.el9.x86_64 2023-11-25T03:56:13.051 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2023-11-25T03:56:13.052 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-361.el9.x86_64 2023-11-25T03:56:13.052 INFO:teuthology.task.kernel:Running kernel on smithi066: 5.14.0-361.el9.x86_64 2023-11-25T03:56:13.053 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum install -y kernel 2023-11-25T03:56:15.116 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-9 - AppStream 15 MB/s | 6.4 MB 00:00 2023-11-25T03:56:15.191 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2023-11-25T03:56:16.517 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2023-11-25T03:56:16.608 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2023-11-25T03:56:17.757 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 8.8 MB/s | 7.9 MB 00:00 2023-11-25T03:56:18.365 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 7.9 MB 00:01 2023-11-25T03:56:19.592 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 27 MB/s | 18 MB 00:00 2023-11-25T03:56:24.584 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 5.8 MB 00:01 2023-11-25T03:56:26.266 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 18 MB 00:06 2023-11-25T03:56:26.410 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2023-11-25T03:56:28.513 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 10 MB/s | 20 MB 00:01 2023-11-25T03:56:31.266 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.8 MB 00:01 2023-11-25T03:56:32.684 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 15 kB 00:00 2023-11-25T03:56:33.528 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2023-11-25T03:56:34.671 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-11-25T03:56:35.984 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-25T03:56:35.985 INFO:teuthology.orchestra.run.smithi066.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-25T03:56:36.081 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2023-11-25T03:56:36.093 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2023-11-25T03:56:36.093 INFO:teuthology.orchestra.run.smithi066.stdout: Package Architecture Version Repository Size 2023-11-25T03:56:36.093 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2023-11-25T03:56:36.093 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2023-11-25T03:56:36.093 INFO:teuthology.orchestra.run.smithi066.stdout: kernel x86_64 5.14.0-386.el9 baseos 5.5 M 2023-11-25T03:56:36.093 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2023-11-25T03:56:36.094 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core x86_64 5.14.0-386.el9 baseos 20 M 2023-11-25T03:56:36.094 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules x86_64 5.14.0-386.el9 baseos 38 M 2023-11-25T03:56:36.094 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core x86_64 5.14.0-386.el9 baseos 32 M 2023-11-25T03:56:36.094 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T03:56:36.094 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2023-11-25T03:56:36.094 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2023-11-25T03:56:36.094 INFO:teuthology.orchestra.run.smithi066.stdout:Install 4 Packages 2023-11-25T03:56:36.094 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T03:56:36.095 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 95 M 2023-11-25T03:56:36.095 INFO:teuthology.orchestra.run.smithi066.stdout:Installed size: 121 M 2023-11-25T03:56:36.095 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2023-11-25T03:56:36.496 INFO:teuthology.orchestra.run.smithi066.stdout:(1/4): kernel-5.14.0-386.el9.x86_64.rpm 21 MB/s | 5.5 MB 00:00 2023-11-25T03:56:36.838 INFO:teuthology.orchestra.run.smithi066.stdout:(2/4): kernel-core-5.14.0-386.el9.x86_64.rpm 33 MB/s | 20 MB 00:00 2023-11-25T03:56:37.346 INFO:teuthology.orchestra.run.smithi066.stdout:(3/4): kernel-modules-5.14.0-386.el9.x86_64.rpm 34 MB/s | 38 MB 00:01 2023-11-25T03:56:37.638 INFO:teuthology.orchestra.run.smithi066.stdout:(4/4): kernel-modules-core-5.14.0-386.el9.x86_6 28 MB/s | 32 MB 00:01 2023-11-25T03:56:37.639 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2023-11-25T03:56:37.639 INFO:teuthology.orchestra.run.smithi066.stdout:Total 62 MB/s | 95 MB 00:01 2023-11-25T03:56:38.525 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2023-11-25T03:56:38.945 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2023-11-25T03:56:38.946 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2023-11-25T03:56:39.660 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2023-11-25T03:56:40.295 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2023-11-25T03:56:40.296 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2023-11-25T03:56:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-11-25T03:56:42.099 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-11-25T03:56:42.189 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-11-25T03:56:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-11-25T03:56:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2023-11-25T03:56:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-11-25T03:56:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-11-25T03:56:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-386.el9 baseos 5.5 M 2023-11-25T03:56:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-11-25T03:56:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-386.el9 baseos 20 M 2023-11-25T03:56:42.196 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-386.el9 baseos 38 M 2023-11-25T03:56:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-386.el9 baseos 32 M 2023-11-25T03:56:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T03:56:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-11-25T03:56:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-11-25T03:56:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2023-11-25T03:56:42.197 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T03:56:42.197 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 95 M 2023-11-25T03:56:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 121 M 2023-11-25T03:56:42.198 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-11-25T03:56:43.028 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-386.el9.x86_64.rpm 8.8 MB/s | 5.5 MB 00:00 2023-11-25T03:56:43.092 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2023-11-25T03:56:43.221 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-386.el9.x86_64.rpm 25 MB/s | 20 MB 00:00 2023-11-25T03:56:43.768 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-core-5.14.0-386.el9.x86_64 1/4 2023-11-25T03:56:43.938 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-25T03:56:44.520 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-5.14.0-386.el9.x86_64.rpm 18 MB/s | 38 MB 00:02 2023-11-25T03:56:44.812 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-core-5.14.0-386.el9.x86_6 18 MB/s | 32 MB 00:01 2023-11-25T03:56:44.812 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-11-25T03:56:44.812 INFO:teuthology.orchestra.run.smithi002.stdout:Total 37 MB/s | 95 MB 00:02 2023-11-25T03:56:45.693 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-11-25T03:56:46.140 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-11-25T03:56:46.140 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-11-25T03:56:46.818 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-25T03:56:46.998 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-25T03:56:47.496 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-11-25T03:56:47.496 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-11-25T03:56:50.343 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-11-25T03:56:51.016 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-386.el9.x86_64 1/4 2023-11-25T03:56:51.145 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-25T03:56:51.947 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-25T03:56:52.056 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : kernel-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:56:54.024 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-25T03:56:54.196 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-25T03:56:57.035 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:56:59.149 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-25T03:56:59.265 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:04.251 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:27.557 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:27.603 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:27.985 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: kernel-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:27.985 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-5.14.0-386.el9.x86_64 1/4 2023-11-25T03:57:27.985 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-25T03:57:27.985 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-25T03:57:28.406 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:28.406 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T03:57:28.406 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2023-11-25T03:57:28.406 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-5.14.0-386.el9.x86_64 2023-11-25T03:57:28.406 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-core-5.14.0-386.el9.x86_64 2023-11-25T03:57:28.406 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-5.14.0-386.el9.x86_64 2023-11-25T03:57:28.406 INFO:teuthology.orchestra.run.smithi066.stdout: kernel-modules-core-5.14.0-386.el9.x86_64 2023-11-25T03:57:28.406 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T03:57:28.406 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2023-11-25T03:57:28.903 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2023-11-25T03:57:29.054 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-25T03:57:29.054 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-25T03:57:29.054 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-386.el9.x86_64 2023-11-25T03:57:29.054 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-25T03:57:29.055 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-25T03:57:29.055 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-11-25T03:57:29.055 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=None, version=distro) 2023-11-25T03:57:29.055 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q kernel | sort -rV | head -n 1 2023-11-25T03:57:29.178 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-25T03:57:29.178 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-25T03:57:29.178 DEBUG:teuthology.orchestra.run.smithi066:> sudo rpm -qi grub2-tools 2023-11-25T03:57:29.225 INFO:teuthology.orchestra.run.smithi066.stdout:Name : grub2-tools 2023-11-25T03:57:29.225 INFO:teuthology.orchestra.run.smithi066.stdout:Epoch : 1 2023-11-25T03:57:29.225 INFO:teuthology.orchestra.run.smithi066.stdout:Version : 2.06 2023-11-25T03:57:29.225 INFO:teuthology.orchestra.run.smithi066.stdout:Release : 68.el9 2023-11-25T03:57:29.225 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: x86_64 2023-11-25T03:57:29.225 INFO:teuthology.orchestra.run.smithi066.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-25T03:57:29.225 INFO:teuthology.orchestra.run.smithi066.stdout:Group : Unspecified 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:Size : 8264254 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:License : GPLv3+ 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:Packager : builder@centos.org 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:Vendor : CentOS 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-25T03:57:29.226 INFO:teuthology.orchestra.run.smithi066.stdout:Summary : Support tools for GRUB. 2023-11-25T03:57:29.227 INFO:teuthology.orchestra.run.smithi066.stdout:Description : 2023-11-25T03:57:29.227 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T03:57:29.227 INFO:teuthology.orchestra.run.smithi066.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-25T03:57:29.227 INFO:teuthology.orchestra.run.smithi066.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-25T03:57:29.227 INFO:teuthology.orchestra.run.smithi066.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-25T03:57:29.227 INFO:teuthology.orchestra.run.smithi066.stdout:hardware devices. 2023-11-25T03:57:29.227 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T03:57:29.227 INFO:teuthology.orchestra.run.smithi066.stdout:This subpackage provides tools for support of all platforms. 2023-11-25T03:57:29.228 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-25T03:57:29.228 INFO:teuthology.task.kernel:Updating grub on smithi066 to boot 5.14.0-386.el9.x86_64 2023-11-25T03:57:29.228 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-25T03:57:29.819 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2023-11-25T03:57:31.306 INFO:teuthology.orchestra.run.smithi066.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-25T03:57:31.337 INFO:teuthology.orchestra.run.smithi066.stderr:done 2023-11-25T03:57:31.339 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2023-11-25T03:57:31.355 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.63ayx1tzTo 2023-11-25T03:57:31.356 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.63ayx1tzTo 2023-11-25T03:57:31.428 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.63ayx1tzTo 2023-11-25T03:57:31.571 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.63ayx1tzTo is 6KB 2023-11-25T03:57:31.619 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.63ayx1tzTo 2023-11-25T03:57:31.633 DEBUG:teuthology.orchestra.run.smithi066:> sudo /bin/ls /boot/loader/entries || true 2023-11-25T03:57:31.703 INFO:teuthology.orchestra.run.smithi066.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-25T03:57:31.703 INFO:teuthology.orchestra.run.smithi066.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-25T03:57:31.703 INFO:teuthology.orchestra.run.smithi066.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-25T03:57:31.703 INFO:teuthology.orchestra.run.smithi066.stdout:15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64.conf 2023-11-25T03:57:31.704 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64 2023-11-25T03:57:31.855 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2023-11-25T03:57:34.578 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:34.622 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:35.113 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:35.113 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-386.el9.x86_64 1/4 2023-11-25T03:57:35.113 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-386.el9.x86_64 2/4 2023-11-25T03:57:35.113 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-386.el9.x86_64 3/4 2023-11-25T03:57:35.519 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-386.el9.x86_64 4/4 2023-11-25T03:57:35.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T03:57:35.519 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-11-25T03:57:35.519 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-386.el9.x86_64 2023-11-25T03:57:35.520 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-386.el9.x86_64 2023-11-25T03:57:35.520 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-386.el9.x86_64 2023-11-25T03:57:35.520 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-386.el9.x86_64 2023-11-25T03:57:35.520 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T03:57:35.520 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-11-25T03:57:35.972 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2023-11-25T03:57:36.120 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-25T03:57:36.120 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-25T03:57:36.120 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-386.el9.x86_64 2023-11-25T03:57:36.120 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-11-25T03:57:36.120 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-11-25T03:57:36.120 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-11-25T03:57:36.121 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2023-11-25T03:57:36.121 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2023-11-25T03:57:36.242 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-386.el9.x86_64 2023-11-25T03:57:36.243 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-386.el9.x86_64 2023-11-25T03:57:36.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2023-11-25T03:57:36.299 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2023-11-25T03:57:36.299 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2023-11-25T03:57:36.299 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2023-11-25T03:57:36.299 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 68.el9 2023-11-25T03:57:36.299 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2023-11-25T03:57:36.299 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8264254 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T03:57:36.300 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-11-25T03:57:36.301 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2023-11-25T03:57:36.301 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2023-11-25T03:57:36.301 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2023-11-25T03:57:36.301 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T03:57:36.301 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2023-11-25T03:57:36.302 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-11-25T03:57:36.302 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-386.el9.x86_64 2023-11-25T03:57:36.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-11-25T03:57:36.887 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2023-11-25T03:57:38.262 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-11-25T03:57:38.294 INFO:teuthology.orchestra.run.smithi002.stderr:done 2023-11-25T03:57:38.296 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2023-11-25T03:57:38.312 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.Dm8XmxsebP 2023-11-25T03:57:38.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Dm8XmxsebP 2023-11-25T03:57:38.393 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.Dm8XmxsebP 2023-11-25T03:57:38.538 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.Dm8XmxsebP is 6KB 2023-11-25T03:57:38.587 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.Dm8XmxsebP 2023-11-25T03:57:38.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2023-11-25T03:57:38.669 INFO:teuthology.orchestra.run.smithi002.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-11-25T03:57:38.669 INFO:teuthology.orchestra.run.smithi002.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-11-25T03:57:38.669 INFO:teuthology.orchestra.run.smithi002.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-11-25T03:57:38.670 INFO:teuthology.orchestra.run.smithi002.stdout:15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64.conf 2023-11-25T03:57:38.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-386.el9.x86_64 2023-11-25T03:57:38.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2023-11-25T03:58:01.878 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-11-25T03:58:01.878 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-25T03:58:01.879 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:58:08.811 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-11-25T03:58:08.812 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-25T03:58:08.812 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:58:20.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-25T03:58:27.170 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.2 2023-11-25T03:58:29.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-25T03:58:29.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:58:32.322 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-25T03:58:36.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-25T03:58:36.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:58:44.331 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-25T03:58:44.332 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:58:47.394 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-25T03:59:02.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-25T03:59:02.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:59:05.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-25T03:59:23.494 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-25T03:59:23.495 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:59:36.186 DEBUG:teuthology.orchestra.remote:timed out 2023-11-25T03:59:41.926 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-11-25T03:59:48.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-25T03:59:48.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T03:59:48.498 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-11-25T03:59:48.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-25T03:59:48.886 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-386.el9.x86_64"... 2023-11-25T03:59:48.886 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2023-11-25T03:59:48.901 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-386.el9.x86_64 2023-11-25T03:59:48.901 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-386.el9.x86_64 vs 5.14.0-386.el9.x86_64 2023-11-25T03:59:48.901 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-25T03:59:48.901 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-25T03:59:49.902 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-11-25T03:59:49.903 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-25T03:59:49.970 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2023-11-25T03:59:50.018 DEBUG:teuthology.parallel:result is None 2023-11-25T04:00:02.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-25T04:00:02.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T04:00:03.235 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-11-25T04:00:03.618 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-25T04:00:03.618 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-386.el9.x86_64"... 2023-11-25T04:00:03.618 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2023-11-25T04:00:03.634 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-386.el9.x86_64 2023-11-25T04:00:03.634 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-386.el9.x86_64 vs 5.14.0-386.el9.x86_64 2023-11-25T04:00:03.634 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-25T04:00:03.634 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-11-25T04:00:04.636 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-11-25T04:00:04.636 DEBUG:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-11-25T04:00:04.721 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2023-11-25T04:00:04.767 DEBUG:teuthology.parallel:result is None 2023-11-25T04:00:04.768 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-25T04:00:04.775 INFO:teuthology.task.internal:Creating test directory... 2023-11-25T04:00:04.775 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-25T04:00:04.779 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-25T04:00:04.798 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-25T04:00:04.825 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-25T04:00:04.883 INFO:teuthology.task.internal:Creating archive directory... 2023-11-25T04:00:04.883 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-25T04:00:04.885 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-25T04:00:04.926 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-25T04:00:04.934 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-25T04:00:04.934 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-25T04:00:04.948 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-25T04:00:04.991 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-25T04:00:05.009 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-25T04:00:05.012 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-25T04:00:05.030 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-25T04:00:05.032 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-25T04:00:05.039 INFO:teuthology.task.internal:Configuring sudo... 2023-11-25T04:00:05.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-25T04:00:05.042 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-25T04:00:05.075 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-25T04:00:05.107 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-25T04:00:05.107 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-25T04:00:05.115 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-25T04:00:05.132 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-25T04:00:05.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-25T04:00:05.268 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-25T04:00:05.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-25T04:00:05.398 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:00:05.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-25T04:00:05.470 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-25T04:00:05.516 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-25T04:00:05.574 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-25T04:00:05.658 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-25T04:00:05.707 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:00:05.708 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-25T04:00:05.781 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2023-11-25T04:00:05.783 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2023-11-25T04:00:05.822 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-25T04:00:05.878 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-25T04:00:06.376 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-25T04:00:06.384 INFO:teuthology.task.internal:Starting timer... 2023-11-25T04:00:06.384 INFO:teuthology.run_tasks:Running task pcp... 2023-11-25T04:00:06.437 INFO:teuthology.run_tasks:Running task selinux... 2023-11-25T04:00:06.489 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2023-11-25T04:00:06.563 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2023-11-25T04:00:06.566 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2023-11-25T04:00:06.629 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2023-11-25T04:00:06.631 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-25T04:00:06.631 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2023-11-25T04:00:06.651 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2023-11-25T04:00:06.652 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2023-11-25T04:00:06.687 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2023-11-25T04:00:06.687 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi066.front.sepia.ceph.com': 'permissive'} 2023-11-25T04:00:06.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-25T04:00:06.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T04:00:06.725 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-25T04:00:06.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T04:00:06.762 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-25T04:00:06.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2023-11-25T04:00:06.804 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2023-11-25T04:00:06.855 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-25T04:00:06.865 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-25T04:00:06.865 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-25T04:00:06.881 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-25T04:00:06.882 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi066.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-25T04:05:54.946 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com')] 2023-11-25T04:05:54.947 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-25T04:05:54.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T04:05:55.046 DEBUG:teuthology.orchestra.run.smithi002:> true 2023-11-25T04:05:55.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2023-11-25T04:05:55.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-25T04:05:55.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-25T04:05:55.249 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-11-25T04:05:55.317 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-11-25T04:05:55.317 INFO:teuthology.run_tasks:Running task clock... 2023-11-25T04:05:55.331 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-25T04:05:55.332 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-25T04:05:55.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-25T04:05:55.335 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-25T04:05:55.335 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-25T04:05:55.368 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-25T04:05:55.388 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-25T04:05:55.392 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-25T04:05:55.412 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-25T04:05:55.425 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2023-11-25T04:05:55.442 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2023-11-25T04:05:55.448 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2023-11-25T04:05:55.462 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-25T04:05:55.465 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2023-11-25T04:05:55.482 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-25T04:05:55.485 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-25T04:05:55.505 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-25T04:05:55.529 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2023-11-25T04:05:55.532 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-25T04:05:55.532 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2023-11-25T04:05:55.532 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-25T04:05:55.532 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-25T04:05:55.533 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-25T04:05:55.533 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-25T04:05:55.553 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2023-11-25T04:05:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-25T04:05:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2023-11-25T04:05:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-25T04:05:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-25T04:05:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-25T04:05:55.556 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-25T04:05:55.557 INFO:teuthology.run_tasks:Running task install... 2023-11-25T04:05:55.566 DEBUG:teuthology.task.install:project ceph 2023-11-25T04:05:55.566 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30'}} 2023-11-25T04:05:55.566 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30'} 2023-11-25T04:05:55.566 INFO:teuthology.task.install:Using flavor: default 2023-11-25T04:05:55.572 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-25T04:05:55.572 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-25T04:05:55.573 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30', 'tag': None, 'wait_for_package': False} 2023-11-25T04:05:55.573 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ec928368edcc5fc71884a56fd9fd821b148f4e30 2023-11-25T04:05:55.575 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30', 'tag': None, 'wait_for_package': False} 2023-11-25T04:05:55.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ec928368edcc5fc71884a56fd9fd821b148f4e30 2023-11-25T04:05:55.712 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/ec928368edcc5fc71884a56fd9fd821b148f4e30/centos/9/flavors/default/ 2023-11-25T04:05:55.713 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7506.gec928368 2023-11-25T04:05:55.797 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/ec928368edcc5fc71884a56fd9fd821b148f4e30/centos/9/flavors/default/ 2023-11-25T04:05:55.797 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7506.gec928368 2023-11-25T04:05:55.880 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/ec928368edcc5fc71884a56fd9fd821b148f4e30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/ec928368edcc5fc71884a56fd9fd821b148f4e30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/ec928368edcc5fc71884a56fd9fd821b148f4e30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-25T04:05:55.880 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:05:55.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-25T04:05:55.904 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/ec928368edcc5fc71884a56fd9fd821b148f4e30/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/ec928368edcc5fc71884a56fd9fd821b148f4e30/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/ec928368edcc5fc71884a56fd9fd821b148f4e30/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-25T04:05:55.905 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:05:55.905 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-25T04:05:55.912 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-25T04:05:55.913 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ec928368edcc5fc71884a56fd9fd821b148f4e30/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-25T04:05:55.937 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-25T04:05:55.937 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ec928368edcc5fc71884a56fd9fd821b148f4e30/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-25T04:05:55.985 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-25T04:05:56.010 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-25T04:05:56.072 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-25T04:05:56.098 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-25T04:05:56.101 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2023-11-25T04:05:56.103 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2023-11-25T04:05:56.128 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2023-11-25T04:05:56.129 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2023-11-25T04:05:56.359 INFO:teuthology.orchestra.run.smithi002.stdout:73 files removed 2023-11-25T04:05:56.384 INFO:teuthology.orchestra.run.smithi066.stdout:73 files removed 2023-11-25T04:05:56.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-25T04:05:56.411 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-25T04:05:57.178 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 182 kB/s | 78 kB 00:00 2023-11-25T04:05:57.213 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 159 kB/s | 78 kB 00:00 2023-11-25T04:05:57.564 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 32 kB/s | 9.5 kB 00:00 2023-11-25T04:05:57.595 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-11-25T04:05:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 6.6 kB/s | 1.9 kB 00:00 2023-11-25T04:05:57.954 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2023-11-25T04:05:58.317 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS-9 - AppStream 16 MB/s | 6.4 MB 00:00 2023-11-25T04:05:58.373 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-9 - AppStream 17 MB/s | 6.4 MB 00:00 2023-11-25T04:05:59.748 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.0 MB 00:00 2023-11-25T04:05:59.834 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS-9 - BaseOS 5.4 MB/s | 2.0 MB 00:00 2023-11-25T04:06:01.508 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 7.9 MB 00:01 2023-11-25T04:06:02.691 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 7.9 MB 00:02 2023-11-25T04:06:04.709 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 18 MB 00:02 2023-11-25T04:06:07.974 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 18 MB 00:04 2023-11-25T04:06:08.726 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 13 MB/s | 5.8 MB 00:00 2023-11-25T04:06:10.177 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 15 kB 00:00 2023-11-25T04:06:11.870 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-11-25T04:06:12.583 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 5.8 MB 00:01 2023-11-25T04:06:13.992 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 60 kB/s | 15 kB 00:00 2023-11-25T04:06:16.637 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 20 MB 00:02 2023-11-25T04:06:16.970 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2023-11-25T04:06:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-25T04:06:19.741 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-25T04:06:19.752 INFO:teuthology.orchestra.run.smithi002.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-25T04:06:19.753 INFO:teuthology.orchestra.run.smithi002.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-25T04:06:19.754 INFO:teuthology.orchestra.run.smithi002.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-25T04:06:19.755 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-25T04:06:19.757 INFO:teuthology.orchestra.run.smithi002.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-25T04:06:19.759 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-25T04:06:19.760 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-25T04:06:19.841 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-11-25T04:06:19.848 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================================ 2023-11-25T04:06:19.848 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-11-25T04:06:19.848 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================================ 2023-11-25T04:06:19.848 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:18.0.0-7506.gec928368.el9 ceph 6.6 k 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:18.0.0-7506.gec928368.el9 ceph 5.2 M 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:18.0.0-7506.gec928368.el9 ceph 859 k 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7506.gec928368.el9 ceph 141 k 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:18.0.0-7506.gec928368.el9 ceph 1.5 M 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 133 k 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 1.8 M 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 7.4 M 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 50 k 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:18.0.0-7506.gec928368.el9 ceph 8.7 M 2023-11-25T04:06:19.849 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:18.0.0-7506.gec928368.el9 ceph 41 M 2023-11-25T04:06:19.850 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 262 k 2023-11-25T04:06:19.850 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 776 k 2023-11-25T04:06:19.850 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror x86_64 2:18.0.0-7506.gec928368.el9 ceph 217 k 2023-11-25T04:06:19.850 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 18 k 2023-11-25T04:06:19.850 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-25T04:06:19.850 INFO:teuthology.orchestra.run.smithi002.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-25T04:06:19.850 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-25T04:06:19.850 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:18.0.0-7506.gec928368.el9 ceph 31 k 2023-11-25T04:06:19.850 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:18.0.0-7506.gec928368.el9 ceph 719 k 2023-11-25T04:06:19.851 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:18.0.0-7506.gec928368.el9 ceph 126 k 2023-11-25T04:06:19.851 INFO:teuthology.orchestra.run.smithi002.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-25T04:06:19.851 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-25T04:06:19.851 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-25T04:06:19.851 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-25T04:06:19.851 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-25T04:06:19.851 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-25T04:06:19.851 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:18.0.0-7506.gec928368.el9 ceph 162 k 2023-11-25T04:06:19.851 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:18.0.0-7506.gec928368.el9 ceph 320 k 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:18.0.0-7506.gec928368.el9 ceph 298 k 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:18.0.0-7506.gec928368.el9 ceph 99 k 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:18.0.0-7506.gec928368.el9 ceph 85 k 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:18.0.0-7506.gec928368.el9 ceph 3.0 M 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:18.0.0-7506.gec928368.el9 ceph 170 k 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-25T04:06:19.852 INFO:teuthology.orchestra.run.smithi002.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:18.0.0-7506.gec928368.el9 ceph 3.3 M 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:18.0.0-7506.gec928368.el9 ceph 3.0 M 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-25T04:06:19.853 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:18.0.0-7506.gec928368.el9 ceph 19 M 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 28 k 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:18.0.0-7506.gec928368.el9 ceph 2.1 M 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 243 k 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:18.0.0-7506.gec928368.el9 ceph 4.4 M 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:18.0.0-7506.gec928368.el9 ceph 18 M 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 15 k 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:18.0.0-7506.gec928368.el9 ceph 24 k 2023-11-25T04:06:19.854 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:18.0.0-7506.gec928368.el9 ceph 163 k 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-25T04:06:19.855 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:18.0.0-7506.gec928368.el9 ceph 476 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:18.0.0-7506.gec928368.el9 ceph 4.8 M 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-11-25T04:06:19.856 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:18.0.0-7506.gec928368.el9 ceph 45 k 2023-11-25T04:06:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:18.0.0-7506.gec928368.el9 ceph 129 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-25T04:06:19.858 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-25T04:06:19.859 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-25T04:06:19.860 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-25T04:06:19.861 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout:============================================================================================ 2023-11-25T04:06:19.862 INFO:teuthology.orchestra.run.smithi002.stdout:Install 135 Packages 2023-11-25T04:06:19.863 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 15 Packages 2023-11-25T04:06:19.863 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:06:19.863 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 205 M 2023-11-25T04:06:19.863 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-11-25T04:06:20.671 INFO:teuthology.orchestra.run.smithi002.stdout:(1/150): ceph-18.0.0-7506.gec928368.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2023-11-25T04:06:21.538 INFO:teuthology.orchestra.run.smithi002.stdout:(2/150): ceph-fuse-18.0.0-7506.gec928368.el9.x8 992 kB/s | 859 kB 00:00 2023-11-25T04:06:21.568 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2023-11-25T04:06:21.639 INFO:teuthology.orchestra.run.smithi002.stdout:(3/150): ceph-immutable-object-cache-18.0.0-750 1.4 MB/s | 141 kB 00:00 2023-11-25T04:06:21.916 INFO:teuthology.orchestra.run.smithi002.stdout:(4/150): ceph-base-18.0.0-7506.gec928368.el9.x8 3.4 MB/s | 5.2 MB 00:01 2023-11-25T04:06:22.072 INFO:teuthology.orchestra.run.smithi002.stdout:(5/150): ceph-mgr-18.0.0-7506.gec928368.el9.x86 9.4 MB/s | 1.5 MB 00:00 2023-11-25T04:06:22.298 INFO:teuthology.orchestra.run.smithi002.stdout:(6/150): ceph-mds-18.0.0-7506.gec928368.el9.x86 3.2 MB/s | 2.1 MB 00:00 2023-11-25T04:06:22.431 INFO:teuthology.orchestra.run.smithi002.stdout:(7/150): ceph-mon-18.0.0-7506.gec928368.el9.x86 12 MB/s | 4.4 MB 00:00 2023-11-25T04:06:23.056 INFO:teuthology.orchestra.run.smithi002.stdout:(8/150): ceph-radosgw-18.0.0-7506.gec928368.el9 14 MB/s | 8.7 MB 00:00 2023-11-25T04:06:23.115 INFO:teuthology.orchestra.run.smithi002.stdout:(9/150): ceph-selinux-18.0.0-7506.gec928368.el9 414 kB/s | 24 kB 00:00 2023-11-25T04:06:24.149 INFO:teuthology.orchestra.run.smithi002.stdout:(10/150): ceph-common-18.0.0-7506.gec928368.el9 5.0 MB/s | 19 MB 00:03 2023-11-25T04:06:24.215 INFO:teuthology.orchestra.run.smithi002.stdout:(11/150): cephfs-mirror-18.0.0-7506.gec928368.e 3.2 MB/s | 217 kB 00:00 2023-11-25T04:06:24.290 INFO:teuthology.orchestra.run.smithi002.stdout:(12/150): libcephfs-devel-18.0.0-7506.gec928368 415 kB/s | 31 kB 00:00 2023-11-25T04:06:24.355 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-25T04:06:24.355 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-11-25T04:06:24.363 INFO:teuthology.orchestra.run.smithi066.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-11-25T04:06:24.364 INFO:teuthology.orchestra.run.smithi066.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-11-25T04:06:24.365 INFO:teuthology.orchestra.run.smithi066.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-11-25T04:06:24.366 INFO:teuthology.orchestra.run.smithi066.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-11-25T04:06:24.368 INFO:teuthology.orchestra.run.smithi066.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-11-25T04:06:24.371 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-11-25T04:06:24.372 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-25T04:06:24.450 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2023-11-25T04:06:24.457 INFO:teuthology.orchestra.run.smithi002.stdout:(13/150): libcephfs2-18.0.0-7506.gec928368.el9. 4.2 MB/s | 719 kB 00:00 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================================ 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================================ 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:18.0.0-7506.gec928368.el9 ceph 6.6 k 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:18.0.0-7506.gec928368.el9 ceph 5.2 M 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:18.0.0-7506.gec928368.el9 ceph 859 k 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7506.gec928368.el9 ceph 141 k 2023-11-25T04:06:24.464 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:18.0.0-7506.gec928368.el9 ceph 1.5 M 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 133 k 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 1.8 M 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 7.4 M 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 50 k 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:18.0.0-7506.gec928368.el9 ceph 8.7 M 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:18.0.0-7506.gec928368.el9 ceph 41 M 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 262 k 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 776 k 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror x86_64 2:18.0.0-7506.gec928368.el9 ceph 217 k 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 18 k 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-11-25T04:06:24.465 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:18.0.0-7506.gec928368.el9 ceph 31 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:18.0.0-7506.gec928368.el9 ceph 719 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:18.0.0-7506.gec928368.el9 ceph 126 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:18.0.0-7506.gec928368.el9 ceph 162 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:18.0.0-7506.gec928368.el9 ceph 320 k 2023-11-25T04:06:24.466 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:18.0.0-7506.gec928368.el9 ceph 298 k 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:18.0.0-7506.gec928368.el9 ceph 99 k 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:18.0.0-7506.gec928368.el9 ceph 85 k 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:18.0.0-7506.gec928368.el9 ceph 3.0 M 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:18.0.0-7506.gec928368.el9 ceph 170 k 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager x86_64 1:1.45.6-1.el9 CentOS-BaseOS 2.2 M 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm x86_64 1:1.45.6-1.el9 CentOS-BaseOS 1.8 M 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team x86_64 1:1.45.6-1.el9 CentOS-BaseOS 42 k 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui x86_64 1:1.45.6-1.el9 CentOS-BaseOS 245 k 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-11-25T04:06:24.467 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:18.0.0-7506.gec928368.el9 ceph 3.3 M 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:18.0.0-7506.gec928368.el9 ceph 3.0 M 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-11-25T04:06:24.468 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:18.0.0-7506.gec928368.el9 ceph 19 M 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 28 k 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:18.0.0-7506.gec928368.el9 ceph 2.1 M 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 243 k 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:18.0.0-7506.gec928368.el9 ceph 4.4 M 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:18.0.0-7506.gec928368.el9 ceph 18 M 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7506.gec928368.el9 ceph-noarch 15 k 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:18.0.0-7506.gec928368.el9 ceph 24 k 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-11-25T04:06:24.469 INFO:teuthology.orchestra.run.smithi066.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:18.0.0-7506.gec928368.el9 ceph 163 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:18.0.0-7506.gec928368.el9 ceph 476 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:18.0.0-7506.gec928368.el9 ceph 4.8 M 2023-11-25T04:06:24.470 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-11-25T04:06:24.471 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:18.0.0-7506.gec928368.el9 ceph 45 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:18.0.0-7506.gec928368.el9 ceph 129 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-11-25T04:06:24.472 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-11-25T04:06:24.473 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-11-25T04:06:24.474 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-11-25T04:06:24.475 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-11-25T04:06:24.475 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-11-25T04:06:24.475 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-11-25T04:06:24.475 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-11-25T04:06:24.475 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-11-25T04:06:24.475 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-11-25T04:06:24.475 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-11-25T04:06:24.475 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-11-25T04:06:24.476 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2023-11-25T04:06:24.477 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-11-25T04:06:24.477 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:06:24.477 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2023-11-25T04:06:24.477 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================================ 2023-11-25T04:06:24.477 INFO:teuthology.orchestra.run.smithi066.stdout:Install 135 Packages 2023-11-25T04:06:24.477 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 15 Packages 2023-11-25T04:06:24.477 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:06:24.478 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 205 M 2023-11-25T04:06:24.478 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2023-11-25T04:06:24.558 INFO:teuthology.orchestra.run.smithi002.stdout:(14/150): libcephsqlite-18.0.0-7506.gec928368.e 1.6 MB/s | 163 kB 00:00 2023-11-25T04:06:24.650 INFO:teuthology.orchestra.run.smithi002.stdout:(15/150): librados-devel-18.0.0-7506.gec928368. 1.3 MB/s | 126 kB 00:00 2023-11-25T04:06:24.758 INFO:teuthology.orchestra.run.smithi002.stdout:(16/150): libradosstriper1-18.0.0-7506.gec92836 4.3 MB/s | 476 kB 00:00 2023-11-25T04:06:25.533 INFO:teuthology.orchestra.run.smithi002.stdout:(17/150): librgw2-18.0.0-7506.gec928368.el9.x86 6.2 MB/s | 4.8 MB 00:00 2023-11-25T04:06:25.642 INFO:teuthology.orchestra.run.smithi002.stdout:(18/150): python3-ceph-argparse-18.0.0-7506.gec 418 kB/s | 45 kB 00:00 2023-11-25T04:06:25.678 INFO:teuthology.orchestra.run.smithi066.stdout:(1/150): ceph-18.0.0-7506.gec928368.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2023-11-25T04:06:25.826 INFO:teuthology.orchestra.run.smithi002.stdout:(19/150): ceph-osd-18.0.0-7506.gec928368.el9.x8 5.0 MB/s | 18 MB 00:03 2023-11-25T04:06:25.860 INFO:teuthology.orchestra.run.smithi002.stdout:(20/150): python3-ceph-common-18.0.0-7506.gec92 592 kB/s | 129 kB 00:00 2023-11-25T04:06:25.896 INFO:teuthology.orchestra.run.smithi002.stdout:(21/150): python3-cephfs-18.0.0-7506.gec928368. 2.3 MB/s | 162 kB 00:00 2023-11-25T04:06:26.111 INFO:teuthology.orchestra.run.smithi066.stdout:(2/150): ceph-fuse-18.0.0-7506.gec928368.el9.x8 1.9 MB/s | 859 kB 00:00 2023-11-25T04:06:26.195 INFO:teuthology.orchestra.run.smithi066.stdout:(3/150): ceph-immutable-object-cache-18.0.0-750 1.7 MB/s | 141 kB 00:00 2023-11-25T04:06:26.269 INFO:teuthology.orchestra.run.smithi002.stdout:(22/150): ceph-test-18.0.0-7506.gec928368.el9.x 13 MB/s | 41 MB 00:03 2023-11-25T04:06:26.294 INFO:teuthology.orchestra.run.smithi002.stdout:(23/150): python3-rbd-18.0.0-7506.gec928368.el9 745 kB/s | 298 kB 00:00 2023-11-25T04:06:26.328 INFO:teuthology.orchestra.run.smithi002.stdout:(24/150): python3-rados-18.0.0-7506.gec928368.e 685 kB/s | 320 kB 00:00 2023-11-25T04:06:26.353 INFO:teuthology.orchestra.run.smithi002.stdout:(25/150): python3-rgw-18.0.0-7506.gec928368.el9 1.2 MB/s | 99 kB 00:00 2023-11-25T04:06:26.387 INFO:teuthology.orchestra.run.smithi002.stdout:(26/150): rbd-fuse-18.0.0-7506.gec928368.el9.x8 921 kB/s | 85 kB 00:00 2023-11-25T04:06:26.454 INFO:teuthology.orchestra.run.smithi002.stdout:(27/150): rbd-nbd-18.0.0-7506.gec928368.el9.x86 1.7 MB/s | 170 kB 00:00 2023-11-25T04:06:26.496 INFO:teuthology.orchestra.run.smithi002.stdout:(28/150): ceph-grafana-dashboards-18.0.0-7506.g 258 kB/s | 28 kB 00:00 2023-11-25T04:06:26.554 INFO:teuthology.orchestra.run.smithi002.stdout:(29/150): ceph-mgr-cephadm-18.0.0-7506.gec92836 1.3 MB/s | 133 kB 00:00 2023-11-25T04:06:27.037 INFO:teuthology.orchestra.run.smithi066.stdout:(4/150): ceph-mds-18.0.0-7506.gec928368.el9.x86 2.5 MB/s | 2.1 MB 00:00 2023-11-25T04:06:27.038 INFO:teuthology.orchestra.run.smithi002.stdout:(30/150): rbd-mirror-18.0.0-7506.gec928368.el9. 4.2 MB/s | 3.0 MB 00:00 2023-11-25T04:06:27.112 INFO:teuthology.orchestra.run.smithi066.stdout:(5/150): ceph-base-18.0.0-7506.gec928368.el9.x8 2.8 MB/s | 5.2 MB 00:01 2023-11-25T04:06:27.180 INFO:teuthology.orchestra.run.smithi002.stdout:(31/150): ceph-mgr-modules-core-18.0.0-7506.gec 1.7 MB/s | 243 kB 00:00 2023-11-25T04:06:27.214 INFO:teuthology.orchestra.run.smithi002.stdout:(32/150): ceph-mgr-dashboard-18.0.0-7506.gec928 2.5 MB/s | 1.8 MB 00:00 2023-11-25T04:06:27.305 INFO:teuthology.orchestra.run.smithi002.stdout:(33/150): ceph-mgr-rook-18.0.0-7506.gec928368.e 401 kB/s | 50 kB 00:00 2023-11-25T04:06:27.339 INFO:teuthology.orchestra.run.smithi002.stdout:(34/150): ceph-prometheus-alerts-18.0.0-7506.ge 121 kB/s | 15 kB 00:00 2023-11-25T04:06:27.489 INFO:teuthology.orchestra.run.smithi002.stdout:(35/150): ceph-mgr-diskprediction-local-18.0.0- 7.9 MB/s | 7.4 MB 00:00 2023-11-25T04:06:27.515 INFO:teuthology.orchestra.run.smithi002.stdout:(36/150): ceph-volume-18.0.0-7506.gec928368.el9 1.2 MB/s | 262 kB 00:00 2023-11-25T04:06:27.556 INFO:teuthology.orchestra.run.smithi002.stdout:(37/150): cephfs-top-18.0.0-7506.gec928368.el9. 274 kB/s | 18 kB 00:00 2023-11-25T04:06:27.645 INFO:teuthology.orchestra.run.smithi066.stdout:(6/150): ceph-mgr-18.0.0-7506.gec928368.el9.x86 2.4 MB/s | 1.5 MB 00:00 2023-11-25T04:06:27.657 INFO:teuthology.orchestra.run.smithi002.stdout:(38/150): cephadm-18.0.0-7506.gec928368.el9.noa 2.4 MB/s | 776 kB 00:00 2023-11-25T04:06:27.740 INFO:teuthology.orchestra.run.smithi002.stdout:(39/150): automake-1.16.2-8.el9.noarch.rpm 2.9 MB/s | 662 kB 00:00 2023-11-25T04:06:27.782 INFO:teuthology.orchestra.run.smithi002.stdout:(40/150): bison-3.7.4-5.el9.x86_64.rpm 4.5 MB/s | 920 kB 00:00 2023-11-25T04:06:27.808 INFO:teuthology.orchestra.run.smithi002.stdout:(41/150): boost-program-options-1.75.0-8.el9.x8 709 kB/s | 106 kB 00:00 2023-11-25T04:06:27.824 INFO:teuthology.orchestra.run.smithi002.stdout:(42/150): elfutils-libelf-devel-0.190-1.el9.x86 258 kB/s | 21 kB 00:00 2023-11-25T04:06:27.866 INFO:teuthology.orchestra.run.smithi002.stdout:(43/150): flexiblas-3.0.4-8.el9.x86_64.rpm 543 kB/s | 32 kB 00:00 2023-11-25T04:06:27.892 INFO:teuthology.orchestra.run.smithi002.stdout:(44/150): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2023-11-25T04:06:28.108 INFO:teuthology.orchestra.run.smithi002.stdout:(45/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2023-11-25T04:06:28.125 INFO:teuthology.orchestra.run.smithi002.stdout:(46/150): flexiblas-openblas-openmp-3.0.4-8.el9 66 kB/s | 17 kB 00:00 2023-11-25T04:06:28.151 INFO:teuthology.orchestra.run.smithi002.stdout:(47/150): jq-1.6-16.el9.x86_64.rpm 723 kB/s | 186 kB 00:00 2023-11-25T04:06:28.221 INFO:teuthology.orchestra.run.smithi066.stdout:(7/150): ceph-mon-18.0.0-7506.gec928368.el9.x86 4.0 MB/s | 4.4 MB 00:01 2023-11-25T04:06:28.238 INFO:teuthology.orchestra.run.smithi002.stdout:(48/150): libaio-devel-0.3.111-13.el9.x86_64.rp 116 kB/s | 10 kB 00:00 2023-11-25T04:06:28.259 INFO:teuthology.orchestra.run.smithi002.stdout:(49/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 408 kB/s | 44 kB 00:00 2023-11-25T04:06:28.285 INFO:teuthology.orchestra.run.smithi002.stdout:(50/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2023-11-25T04:06:28.310 INFO:teuthology.orchestra.run.smithi002.stdout:(51/150): librdkafka-1.6.1-102.el9.x86_64.rpm 9.0 MB/s | 661 kB 00:00 2023-11-25T04:06:28.343 INFO:teuthology.orchestra.run.smithi002.stdout:(52/150): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2023-11-25T04:06:28.369 INFO:teuthology.orchestra.run.smithi002.stdout:(53/150): libuuid-devel-2.37.4-15.el9.x86_64.rp 297 kB/s | 24 kB 00:00 2023-11-25T04:06:28.394 INFO:teuthology.orchestra.run.smithi002.stdout:(54/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 560 kB/s | 46 kB 00:00 2023-11-25T04:06:28.419 INFO:teuthology.orchestra.run.smithi002.stdout:(55/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2023-11-25T04:06:28.453 INFO:teuthology.orchestra.run.smithi002.stdout:(56/150): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2023-11-25T04:06:28.470 INFO:teuthology.orchestra.run.smithi002.stdout:(57/150): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2023-11-25T04:06:28.495 INFO:teuthology.orchestra.run.smithi002.stdout:(58/150): openblas-0.3.21-2.el9.x86_64.rpm 452 kB/s | 34 kB 00:00 2023-11-25T04:06:28.695 INFO:teuthology.orchestra.run.smithi002.stdout:(59/150): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2023-11-25T04:06:28.729 INFO:teuthology.orchestra.run.smithi002.stdout:(60/150): postgresql-contrib-13.11-1.el9.x86_64 3.4 MB/s | 811 kB 00:00 2023-11-25T04:06:28.762 INFO:teuthology.orchestra.run.smithi002.stdout:(61/150): postgresql-13.11-1.el9.x86_64.rpm 5.8 MB/s | 1.5 MB 00:00 2023-11-25T04:06:28.787 INFO:teuthology.orchestra.run.smithi002.stdout:(62/150): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 134 kB 00:00 2023-11-25T04:06:28.965 INFO:teuthology.orchestra.run.smithi002.stdout:(63/150): postgresql-server-13.11-1.el9.x86_64. 25 MB/s | 5.7 MB 00:00 2023-11-25T04:06:28.988 INFO:teuthology.orchestra.run.smithi002.stdout:(64/150): python3-jinja2-2.11.3-4.el9.noarch.rp 1.1 MB/s | 228 kB 00:00 2023-11-25T04:06:29.122 INFO:teuthology.orchestra.run.smithi002.stdout:(65/150): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-11-25T04:06:29.147 INFO:teuthology.orchestra.run.smithi002.stdout:(66/150): python3-jsonpatch-1.21-16.el9.noarch. 134 kB/s | 24 kB 00:00 2023-11-25T04:06:29.172 INFO:teuthology.orchestra.run.smithi002.stdout:(67/150): python3-jsonpointer-2.0-4.el9.noarch. 100 kB/s | 18 kB 00:00 2023-11-25T04:06:29.239 INFO:teuthology.orchestra.run.smithi002.stdout:(68/150): python3-markupsafe-1.1.1-12.el9.x86_6 477 kB/s | 32 kB 00:00 2023-11-25T04:06:29.256 INFO:teuthology.orchestra.run.smithi002.stdout:(69/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2023-11-25T04:06:29.314 INFO:teuthology.orchestra.run.smithi066.stdout:(8/150): ceph-radosgw-18.0.0-7506.gec928368.el9 8.0 MB/s | 8.7 MB 00:01 2023-11-25T04:06:29.355 INFO:teuthology.orchestra.run.smithi066.stdout:(9/150): ceph-selinux-18.0.0-7506.gec928368.el9 585 kB/s | 24 kB 00:00 2023-11-25T04:06:29.431 INFO:teuthology.orchestra.run.smithi002.stdout:(70/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2023-11-25T04:06:29.448 INFO:teuthology.orchestra.run.smithi002.stdout:(71/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2023-11-25T04:06:29.473 INFO:teuthology.orchestra.run.smithi002.stdout:(72/150): python3-oauthlib-3.1.1-5.el9.noarch.r 810 kB/s | 174 kB 00:00 2023-11-25T04:06:29.506 INFO:teuthology.orchestra.run.smithi002.stdout:(73/150): python3-prettytable-0.7.2-27.el9.noar 708 kB/s | 41 kB 00:00 2023-11-25T04:06:29.524 INFO:teuthology.orchestra.run.smithi002.stdout:(74/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-11-25T04:06:29.549 INFO:teuthology.orchestra.run.smithi002.stdout:(75/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-11-25T04:06:29.574 INFO:teuthology.orchestra.run.smithi002.stdout:(76/150): python3-pytz-2021.1-5.el9.noarch.rpm 706 kB/s | 47 kB 00:00 2023-11-25T04:06:29.599 INFO:teuthology.orchestra.run.smithi002.stdout:(77/150): python3-requests-oauthlib-1.3.0-12.el 569 kB/s | 43 kB 00:00 2023-11-25T04:06:29.639 INFO:teuthology.orchestra.run.smithi066.stdout:(10/150): ceph-common-18.0.0-7506.gec928368.el9 4.3 MB/s | 19 MB 00:04 2023-11-25T04:06:29.706 INFO:teuthology.orchestra.run.smithi066.stdout:(11/150): cephfs-mirror-18.0.0-7506.gec928368.e 3.2 MB/s | 217 kB 00:00 2023-11-25T04:06:29.748 INFO:teuthology.orchestra.run.smithi066.stdout:(12/150): libcephfs-devel-18.0.0-7506.gec928368 751 kB/s | 31 kB 00:00 2023-11-25T04:06:29.865 INFO:teuthology.orchestra.run.smithi066.stdout:(13/150): libcephfs2-18.0.0-7506.gec928368.el9. 6.0 MB/s | 719 kB 00:00 2023-11-25T04:06:29.916 INFO:teuthology.orchestra.run.smithi066.stdout:(14/150): libcephsqlite-18.0.0-7506.gec928368.e 3.2 MB/s | 163 kB 00:00 2023-11-25T04:06:29.966 INFO:teuthology.orchestra.run.smithi066.stdout:(15/150): librados-devel-18.0.0-7506.gec928368. 2.5 MB/s | 126 kB 00:00 2023-11-25T04:06:30.058 INFO:teuthology.orchestra.run.smithi066.stdout:(16/150): libradosstriper1-18.0.0-7506.gec92836 5.1 MB/s | 476 kB 00:00 2023-11-25T04:06:30.083 INFO:teuthology.orchestra.run.smithi002.stdout:(78/150): python3-toml-0.10.2-6.el9.noarch.rpm 76 kB/s | 39 kB 00:00 2023-11-25T04:06:30.178 INFO:teuthology.orchestra.run.smithi002.stdout:(79/150): socat-1.7.4.1-5.el9.x86_64.rpm 522 kB/s | 300 kB 00:00 2023-11-25T04:06:30.517 INFO:teuthology.orchestra.run.smithi002.stdout:(80/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:00 2023-11-25T04:06:30.542 INFO:teuthology.orchestra.run.smithi002.stdout:(81/150): uuid-1.6.2-55.el9.x86_64.rpm 123 kB/s | 56 kB 00:00 2023-11-25T04:06:30.567 INFO:teuthology.orchestra.run.smithi002.stdout:(82/150): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 217 kB/s | 85 kB 00:00 2023-11-25T04:06:30.592 INFO:teuthology.orchestra.run.smithi002.stdout:(83/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 834 kB/s | 63 kB 00:00 2023-11-25T04:06:30.616 INFO:teuthology.orchestra.run.smithi066.stdout:(17/150): librgw2-18.0.0-7506.gec928368.el9.x86 8.6 MB/s | 4.8 MB 00:00 2023-11-25T04:06:30.617 INFO:teuthology.orchestra.run.smithi002.stdout:(84/150): zlib-devel-1.2.11-40.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2023-11-25T04:06:30.643 INFO:teuthology.orchestra.run.smithi002.stdout:(85/150): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-11-25T04:06:30.666 INFO:teuthology.orchestra.run.smithi066.stdout:(18/150): python3-ceph-argparse-18.0.0-7506.gec 905 kB/s | 45 kB 00:00 2023-11-25T04:06:30.676 INFO:teuthology.orchestra.run.smithi002.stdout:(86/150): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.4 MB/s | 803 kB 00:00 2023-11-25T04:06:30.701 INFO:teuthology.orchestra.run.smithi002.stdout:(87/150): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-11-25T04:06:30.716 INFO:teuthology.orchestra.run.smithi066.stdout:(19/150): python3-ceph-common-18.0.0-7506.gec92 2.5 MB/s | 129 kB 00:00 2023-11-25T04:06:30.727 INFO:teuthology.orchestra.run.smithi002.stdout:(88/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2023-11-25T04:06:30.767 INFO:teuthology.orchestra.run.smithi066.stdout:(20/150): python3-cephfs-18.0.0-7506.gec928368. 3.2 MB/s | 162 kB 00:00 2023-11-25T04:06:30.785 INFO:teuthology.orchestra.run.smithi002.stdout:(89/150): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2023-11-25T04:06:30.811 INFO:teuthology.orchestra.run.smithi002.stdout:(90/150): python3-ply-3.11-14.el9.noarch.rpm 949 kB/s | 103 kB 00:00 2023-11-25T04:06:30.836 INFO:teuthology.orchestra.run.smithi002.stdout:(91/150): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 124 kB 00:00 2023-11-25T04:06:30.842 INFO:teuthology.orchestra.run.smithi066.stdout:(21/150): python3-rados-18.0.0-7506.gec928368.e 4.2 MB/s | 320 kB 00:00 2023-11-25T04:06:30.861 INFO:teuthology.orchestra.run.smithi002.stdout:(92/150): python3-requests-2.25.1-7.el9.noarch. 1.5 MB/s | 113 kB 00:00 2023-11-25T04:06:30.886 INFO:teuthology.orchestra.run.smithi002.stdout:(93/150): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-11-25T04:06:30.909 INFO:teuthology.orchestra.run.smithi066.stdout:(22/150): python3-rbd-18.0.0-7506.gec928368.el9 4.4 MB/s | 298 kB 00:00 2023-11-25T04:06:30.959 INFO:teuthology.orchestra.run.smithi066.stdout:(23/150): python3-rgw-18.0.0-7506.gec928368.el9 1.9 MB/s | 99 kB 00:00 2023-11-25T04:06:31.001 INFO:teuthology.orchestra.run.smithi066.stdout:(24/150): rbd-fuse-18.0.0-7506.gec928368.el9.x8 2.0 MB/s | 85 kB 00:00 2023-11-25T04:06:31.037 INFO:teuthology.orchestra.run.smithi002.stdout:(94/150): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2023-11-25T04:06:31.304 INFO:teuthology.orchestra.run.smithi002.stdout:(95/150): openssl-devel-3.0.7-25.el9.x86_64.rpm 8.8 MB/s | 4.1 MB 00:00 2023-11-25T04:06:31.329 INFO:teuthology.orchestra.run.smithi002.stdout:(96/150): lua-devel-5.4.4-4.el9.x86_64.rpm 50 kB/s | 22 kB 00:00 2023-11-25T04:06:31.351 INFO:teuthology.orchestra.run.smithi066.stdout:(25/150): rbd-mirror-18.0.0-7506.gec928368.el9. 8.6 MB/s | 3.0 MB 00:00 2023-11-25T04:06:31.402 INFO:teuthology.orchestra.run.smithi066.stdout:(26/150): rbd-nbd-18.0.0-7506.gec928368.el9.x86 3.3 MB/s | 170 kB 00:00 2023-11-25T04:06:31.429 INFO:teuthology.orchestra.run.smithi002.stdout:(97/150): gperftools-libs-2.9.1-2.el9.x86_64.rp 788 kB/s | 309 kB 00:00 2023-11-25T04:06:31.452 INFO:teuthology.orchestra.run.smithi066.stdout:(27/150): ceph-grafana-dashboards-18.0.0-7506.g 561 kB/s | 28 kB 00:00 2023-11-25T04:06:31.479 INFO:teuthology.orchestra.run.smithi002.stdout:(98/150): liboath-2.6.7-2.el9.x86_64.rpm 1.0 MB/s | 49 kB 00:00 2023-11-25T04:06:31.502 INFO:teuthology.orchestra.run.smithi066.stdout:(28/150): ceph-mgr-cephadm-18.0.0-7506.gec92836 2.6 MB/s | 133 kB 00:00 2023-11-25T04:06:31.538 INFO:teuthology.orchestra.run.smithi002.stdout:(99/150): libarrow-doc-9.0.0-9.el9.noarch.rpm 133 kB/s | 24 kB 00:00 2023-11-25T04:06:31.563 INFO:teuthology.orchestra.run.smithi002.stdout:(100/150): libunwind-1.6.2-1.el9.x86_64.rpm 808 kB/s | 67 kB 00:00 2023-11-25T04:06:31.622 INFO:teuthology.orchestra.run.smithi002.stdout:(101/150): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2023-11-25T04:06:31.672 INFO:teuthology.orchestra.run.smithi002.stdout:(102/150): parquet-libs-9.0.0-9.el9.x86_64.rpm 7.5 MB/s | 837 kB 00:00 2023-11-25T04:06:31.711 INFO:teuthology.orchestra.run.smithi066.stdout:(29/150): ceph-mgr-dashboard-18.0.0-7506.gec928 8.4 MB/s | 1.8 MB 00:00 2023-11-25T04:06:31.747 INFO:teuthology.orchestra.run.smithi002.stdout:(103/150): python3-asyncssh-2.13.2-3.el9.noarch 4.3 MB/s | 548 kB 00:00 2023-11-25T04:06:31.772 INFO:teuthology.orchestra.run.smithi002.stdout:(104/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 433 kB/s | 43 kB 00:00 2023-11-25T04:06:31.823 INFO:teuthology.orchestra.run.smithi002.stdout:(105/150): python3-cachetools-4.2.4-1.el9.noarc 427 kB/s | 32 kB 00:00 2023-11-25T04:06:31.848 INFO:teuthology.orchestra.run.smithi002.stdout:(106/150): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2023-11-25T04:06:31.915 INFO:teuthology.orchestra.run.smithi002.stdout:(107/150): libarrow-9.0.0-9.el9.x86_64.rpm 7.2 MB/s | 4.4 MB 00:00 2023-11-25T04:06:31.940 INFO:teuthology.orchestra.run.smithi002.stdout:(108/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2023-11-25T04:06:31.966 INFO:teuthology.orchestra.run.smithi002.stdout:(109/150): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2023-11-25T04:06:31.991 INFO:teuthology.orchestra.run.smithi002.stdout:(110/150): python3-google-auth-2.23.4-1.el9.noa 2.6 MB/s | 197 kB 00:00 2023-11-25T04:06:32.016 INFO:teuthology.orchestra.run.smithi002.stdout:(111/150): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2023-11-25T04:06:32.108 INFO:teuthology.orchestra.run.smithi002.stdout:(112/150): python3-jaraco-classes-3.2.1-5.el9.n 124 kB/s | 18 kB 00:00 2023-11-25T04:06:32.183 INFO:teuthology.orchestra.run.smithi002.stdout:(113/150): python3-jaraco-collections-3.0.0-8.e 138 kB/s | 23 kB 00:00 2023-11-25T04:06:32.209 INFO:teuthology.orchestra.run.smithi002.stdout:(114/150): python3-jaraco-functools-3.5.0-2.el9 101 kB/s | 19 kB 00:00 2023-11-25T04:06:32.234 INFO:teuthology.orchestra.run.smithi002.stdout:(115/150): python3-jaraco-text-3.2.0-6.el9.noar 156 kB/s | 20 kB 00:00 2023-11-25T04:06:32.259 INFO:teuthology.orchestra.run.smithi002.stdout:(116/150): python3-jwt+crypto-2.4.0-1.el9.noarc 181 kB/s | 9.0 kB 00:00 2023-11-25T04:06:32.285 INFO:teuthology.orchestra.run.smithi002.stdout:(117/150): python3-jwt-2.4.0-1.el9.noarch.rpm 545 kB/s | 41 kB 00:00 2023-11-25T04:06:32.343 INFO:teuthology.orchestra.run.smithi002.stdout:(118/150): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2023-11-25T04:06:32.360 INFO:teuthology.orchestra.run.smithi002.stdout:(119/150): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2023-11-25T04:06:32.385 INFO:teuthology.orchestra.run.smithi002.stdout:(120/150): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2023-11-25T04:06:32.419 INFO:teuthology.orchestra.run.smithi002.stdout:(121/150): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2023-11-25T04:06:32.444 INFO:teuthology.orchestra.run.smithi002.stdout:(122/150): python3-logutils-0.3.5-21.el9.noarch 251 kB/s | 46 kB 00:00 2023-11-25T04:06:32.461 INFO:teuthology.orchestra.run.smithi066.stdout:(30/150): ceph-mgr-diskprediction-local-18.0.0- 9.8 MB/s | 7.4 MB 00:00 2023-11-25T04:06:32.469 INFO:teuthology.orchestra.run.smithi002.stdout:(123/150): python3-portend-3.1.0-2.el9.noarch.r 196 kB/s | 16 kB 00:00 2023-11-25T04:06:32.494 INFO:teuthology.orchestra.run.smithi002.stdout:(124/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2023-11-25T04:06:32.520 INFO:teuthology.orchestra.run.smithi066.stdout:(31/150): ceph-mgr-modules-core-18.0.0-7506.gec 4.1 MB/s | 243 kB 00:00 2023-11-25T04:06:32.520 INFO:teuthology.orchestra.run.smithi002.stdout:(125/150): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2023-11-25T04:06:32.545 INFO:teuthology.orchestra.run.smithi002.stdout:(126/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2023-11-25T04:06:32.570 INFO:teuthology.orchestra.run.smithi066.stdout:(32/150): ceph-mgr-rook-18.0.0-7506.gec928368.e 1.0 MB/s | 50 kB 00:00 2023-11-25T04:06:32.571 INFO:teuthology.orchestra.run.smithi002.stdout:(127/150): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2023-11-25T04:06:32.595 INFO:teuthology.orchestra.run.smithi002.stdout:(128/150): python3-tempora-5.0.0-2.el9.noarch.r 475 kB/s | 36 kB 00:00 2023-11-25T04:06:32.620 INFO:teuthology.orchestra.run.smithi066.stdout:(33/150): ceph-prometheus-alerts-18.0.0-7506.ge 302 kB/s | 15 kB 00:00 2023-11-25T04:06:32.621 INFO:teuthology.orchestra.run.smithi002.stdout:(129/150): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2023-11-25T04:06:32.646 INFO:teuthology.orchestra.run.smithi002.stdout:(130/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2023-11-25T04:06:32.671 INFO:teuthology.orchestra.run.smithi002.stdout:(131/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-11-25T04:06:32.697 INFO:teuthology.orchestra.run.smithi002.stdout:(132/150): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2023-11-25T04:06:32.722 INFO:teuthology.orchestra.run.smithi002.stdout:(133/150): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2023-11-25T04:06:32.725 INFO:teuthology.orchestra.run.smithi066.stdout:(34/150): ceph-volume-18.0.0-7506.gec928368.el9 2.4 MB/s | 262 kB 00:00 2023-11-25T04:06:32.747 INFO:teuthology.orchestra.run.smithi002.stdout:(134/150): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-11-25T04:06:32.789 INFO:teuthology.orchestra.run.smithi002.stdout:(135/150): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2023-11-25T04:06:32.829 INFO:teuthology.orchestra.run.smithi066.stdout:(35/150): cephadm-18.0.0-7506.gec928368.el9.noa 7.3 MB/s | 776 kB 00:00 2023-11-25T04:06:32.831 INFO:teuthology.orchestra.run.smithi002.stdout:(136/150): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-11-25T04:06:32.871 INFO:teuthology.orchestra.run.smithi066.stdout:(36/150): cephfs-top-18.0.0-7506.gec928368.el9. 440 kB/s | 18 kB 00:00 2023-11-25T04:06:32.981 INFO:teuthology.orchestra.run.smithi002.stdout:(137/150): NetworkManager-1.45.6-1.el9.x86_64.r 15 MB/s | 2.2 MB 00:00 2023-11-25T04:06:33.115 INFO:teuthology.orchestra.run.smithi002.stdout:(138/150): NetworkManager-libnm-1.45.6-1.el9.x8 13 MB/s | 1.8 MB 00:00 2023-11-25T04:06:33.121 INFO:teuthology.orchestra.run.smithi066.stdout:(37/150): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 662 kB 00:00 2023-11-25T04:06:33.165 INFO:teuthology.orchestra.run.smithi002.stdout:(139/150): librbd1-18.0.0-7506.gec928368.el9.x8 7.2 MB/s | 3.0 MB 00:00 2023-11-25T04:06:33.188 INFO:teuthology.orchestra.run.smithi066.stdout:(38/150): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2023-11-25T04:06:33.190 INFO:teuthology.orchestra.run.smithi002.stdout:(140/150): NetworkManager-team-1.45.6-1.el9.x86 560 kB/s | 42 kB 00:00 2023-11-25T04:06:33.214 INFO:teuthology.orchestra.run.smithi066.stdout:(39/150): boost-program-options-1.75.0-8.el9.x8 4.1 MB/s | 106 kB 00:00 2023-11-25T04:06:33.215 INFO:teuthology.orchestra.run.smithi002.stdout:(141/150): NetworkManager-tui-1.45.6-1.el9.x86_ 4.8 MB/s | 245 kB 00:00 2023-11-25T04:06:33.241 INFO:teuthology.orchestra.run.smithi002.stdout:(142/150): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 69 kB 00:00 2023-11-25T04:06:33.256 INFO:teuthology.orchestra.run.smithi066.stdout:(40/150): elfutils-libelf-devel-0.190-1.el9.x86 517 kB/s | 21 kB 00:00 2023-11-25T04:06:33.283 INFO:teuthology.orchestra.run.smithi002.stdout:(143/150): elfutils-libelf-0.190-1.el9.x86_64.r 4.5 MB/s | 192 kB 00:00 2023-11-25T04:06:33.298 INFO:teuthology.orchestra.run.smithi066.stdout:(41/150): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-11-25T04:06:33.308 INFO:teuthology.orchestra.run.smithi002.stdout:(144/150): elfutils-debuginfod-client-0.190-1.e 398 kB/s | 36 kB 00:00 2023-11-25T04:06:33.331 INFO:teuthology.orchestra.run.smithi066.stdout:(42/150): flexiblas-3.0.4-8.el9.x86_64.rpm 952 kB/s | 32 kB 00:00 2023-11-25T04:06:33.342 INFO:teuthology.orchestra.run.smithi002.stdout:(145/150): elfutils-libs-0.190-1.el9.x86_64.rpm 4.2 MB/s | 255 kB 00:00 2023-11-25T04:06:33.367 INFO:teuthology.orchestra.run.smithi002.stdout:(146/150): libacl-2.3.1-4.el9.x86_64.rpm 377 kB/s | 22 kB 00:00 2023-11-25T04:06:33.401 INFO:teuthology.orchestra.run.smithi002.stdout:(147/150): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 321 kB 00:00 2023-11-25T04:06:33.501 INFO:teuthology.orchestra.run.smithi002.stdout:(148/150): openssl-3.0.7-25.el9.x86_64.rpm 9.1 MB/s | 1.2 MB 00:00 2023-11-25T04:06:33.560 INFO:teuthology.orchestra.run.smithi002.stdout:(149/150): librados2-18.0.0-7506.gec928368.el9. 4.0 MB/s | 3.3 MB 00:00 2023-11-25T04:06:33.627 INFO:teuthology.orchestra.run.smithi002.stdout:(150/150): openssl-libs-3.0.7-25.el9.x86_64.rpm 9.5 MB/s | 2.2 MB 00:00 2023-11-25T04:06:33.634 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-11-25T04:06:33.634 INFO:teuthology.orchestra.run.smithi002.stdout:Total 15 MB/s | 205 MB 00:13 2023-11-25T04:06:33.743 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-11-25T04:06:33.850 INFO:teuthology.orchestra.run.smithi066.stdout:(43/150): ceph-test-18.0.0-7506.gec928368.el9.x 9.2 MB/s | 41 MB 00:04 2023-11-25T04:06:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:(44/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.2 MB/s | 3.0 MB 00:00 2023-11-25T04:06:33.924 INFO:teuthology.orchestra.run.smithi066.stdout:(45/150): flexiblas-openblas-openmp-3.0.4-8.el9 244 kB/s | 17 kB 00:00 2023-11-25T04:06:33.948 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-11-25T04:06:33.948 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-11-25T04:06:33.949 INFO:teuthology.orchestra.run.smithi066.stdout:(46/150): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2023-11-25T04:06:33.966 INFO:teuthology.orchestra.run.smithi066.stdout:(47/150): libaio-devel-0.3.111-13.el9.x86_64.rp 243 kB/s | 10 kB 00:00 2023-11-25T04:06:33.991 INFO:teuthology.orchestra.run.smithi066.stdout:(48/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-11-25T04:06:34.008 INFO:teuthology.orchestra.run.smithi066.stdout:(49/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-11-25T04:06:34.184 INFO:teuthology.orchestra.run.smithi066.stdout:(50/150): ceph-osd-18.0.0-7506.gec928368.el9.x8 2.7 MB/s | 18 MB 00:06 2023-11-25T04:06:34.225 INFO:teuthology.orchestra.run.smithi066.stdout:(51/150): librdkafka-1.6.1-102.el9.x86_64.rpm 2.8 MB/s | 661 kB 00:00 2023-11-25T04:06:34.250 INFO:teuthology.orchestra.run.smithi066.stdout:(52/150): libtool-2.4.6-45.el9.x86_64.rpm 2.3 MB/s | 578 kB 00:00 2023-11-25T04:06:34.267 INFO:teuthology.orchestra.run.smithi066.stdout:(53/150): libuuid-devel-2.37.4-15.el9.x86_64.rp 300 kB/s | 24 kB 00:00 2023-11-25T04:06:34.284 INFO:teuthology.orchestra.run.smithi066.stdout:(54/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-11-25T04:06:34.310 INFO:teuthology.orchestra.run.smithi066.stdout:(55/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2023-11-25T04:06:34.335 INFO:teuthology.orchestra.run.smithi066.stdout:(56/150): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2023-11-25T04:06:34.360 INFO:teuthology.orchestra.run.smithi066.stdout:(57/150): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2023-11-25T04:06:34.394 INFO:teuthology.orchestra.run.smithi066.stdout:(58/150): openblas-0.3.21-2.el9.x86_64.rpm 588 kB/s | 34 kB 00:00 2023-11-25T04:06:34.527 INFO:teuthology.orchestra.run.smithi066.stdout:(59/150): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2023-11-25T04:06:34.577 INFO:teuthology.orchestra.run.smithi066.stdout:(60/150): postgresql-13.11-1.el9.x86_64.rpm 7.0 MB/s | 1.5 MB 00:00 2023-11-25T04:06:34.611 INFO:teuthology.orchestra.run.smithi066.stdout:(61/150): postgresql-contrib-13.11-1.el9.x86_64 3.7 MB/s | 811 kB 00:00 2023-11-25T04:06:34.628 INFO:teuthology.orchestra.run.smithi066.stdout:(62/150): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2023-11-25T04:06:34.770 INFO:teuthology.orchestra.run.smithi066.stdout:(63/150): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-11-25T04:06:34.853 INFO:teuthology.orchestra.run.smithi066.stdout:(64/150): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2023-11-25T04:06:34.928 INFO:teuthology.orchestra.run.smithi066.stdout:(65/150): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 5.8 MB 00:00 2023-11-25T04:06:34.945 INFO:teuthology.orchestra.run.smithi066.stdout:(66/150): python3-jsonpatch-1.21-16.el9.noarch. 140 kB/s | 24 kB 00:00 2023-11-25T04:06:34.962 INFO:teuthology.orchestra.run.smithi066.stdout:(67/150): python3-jsonpointer-2.0-4.el9.noarch. 548 kB/s | 18 kB 00:00 2023-11-25T04:06:34.987 INFO:teuthology.orchestra.run.smithi066.stdout:(68/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-11-25T04:06:35.004 INFO:teuthology.orchestra.run.smithi066.stdout:(69/150): python3-markupsafe-1.1.1-12.el9.x86_6 542 kB/s | 32 kB 00:00 2023-11-25T04:06:35.029 INFO:teuthology.orchestra.run.smithi066.stdout:(70/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.1 MB/s | 217 kB 00:00 2023-11-25T04:06:35.113 INFO:teuthology.orchestra.run.smithi066.stdout:(71/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2023-11-25T04:06:35.138 INFO:teuthology.orchestra.run.smithi066.stdout:(72/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-11-25T04:06:35.164 INFO:teuthology.orchestra.run.smithi066.stdout:(73/150): python3-prettytable-0.7.2-27.el9.noar 314 kB/s | 41 kB 00:00 2023-11-25T04:06:35.189 INFO:teuthology.orchestra.run.smithi066.stdout:(74/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-11-25T04:06:35.214 INFO:teuthology.orchestra.run.smithi066.stdout:(75/150): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-11-25T04:06:35.248 INFO:teuthology.orchestra.run.smithi066.stdout:(76/150): python3-pytz-2021.1-5.el9.noarch.rpm 566 kB/s | 47 kB 00:00 2023-11-25T04:06:35.273 INFO:teuthology.orchestra.run.smithi066.stdout:(77/150): python3-requests-oauthlib-1.3.0-12.el 510 kB/s | 43 kB 00:00 2023-11-25T04:06:35.298 INFO:teuthology.orchestra.run.smithi066.stdout:(78/150): python3-toml-0.10.2-6.el9.noarch.rpm 776 kB/s | 39 kB 00:00 2023-11-25T04:06:35.399 INFO:teuthology.orchestra.run.smithi066.stdout:(79/150): socat-1.7.4.1-5.el9.x86_64.rpm 2.4 MB/s | 300 kB 00:00 2023-11-25T04:06:35.582 INFO:teuthology.orchestra.run.smithi066.stdout:(80/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2023-11-25T04:06:35.607 INFO:teuthology.orchestra.run.smithi066.stdout:(81/150): uuid-1.6.2-55.el9.x86_64.rpm 184 kB/s | 56 kB 00:00 2023-11-25T04:06:35.632 INFO:teuthology.orchestra.run.smithi066.stdout:(82/150): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 368 kB/s | 85 kB 00:00 2023-11-25T04:06:35.658 INFO:teuthology.orchestra.run.smithi066.stdout:(83/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 834 kB/s | 63 kB 00:00 2023-11-25T04:06:35.683 INFO:teuthology.orchestra.run.smithi066.stdout:(84/150): zlib-devel-1.2.11-40.el9.x86_64.rpm 882 kB/s | 44 kB 00:00 2023-11-25T04:06:35.700 INFO:teuthology.orchestra.run.smithi066.stdout:(85/150): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2023-11-25T04:06:35.734 INFO:teuthology.orchestra.run.smithi066.stdout:(86/150): libgfortran-11.4.1-2.3.el9.x86_64.rpm 10 MB/s | 803 kB 00:00 2023-11-25T04:06:35.759 INFO:teuthology.orchestra.run.smithi066.stdout:(87/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2023-11-25T04:06:35.784 INFO:teuthology.orchestra.run.smithi066.stdout:(88/150): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-11-25T04:06:35.818 INFO:teuthology.orchestra.run.smithi066.stdout:(89/150): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-11-25T04:06:35.834 INFO:teuthology.orchestra.run.smithi066.stdout:(90/150): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-11-25T04:06:35.840 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-11-25T04:06:35.841 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-11-25T04:06:35.860 INFO:teuthology.orchestra.run.smithi066.stdout:(91/150): python3-requests-2.25.1-7.el9.noarch. 2.7 MB/s | 113 kB 00:00 2023-11-25T04:06:35.885 INFO:teuthology.orchestra.run.smithi066.stdout:(92/150): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 124 kB 00:00 2023-11-25T04:06:35.910 INFO:teuthology.orchestra.run.smithi066.stdout:(93/150): python3-urllib3-1.26.5-4.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2023-11-25T04:06:35.985 INFO:teuthology.orchestra.run.smithi066.stdout:(94/150): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2023-11-25T04:06:36.078 INFO:teuthology.orchestra.run.smithi066.stdout:(95/150): gperftools-libs-2.9.1-2.el9.x86_64.rp 3.3 MB/s | 309 kB 00:00 2023-11-25T04:06:36.138 INFO:teuthology.orchestra.run.smithi066.stdout:(96/150): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2023-11-25T04:06:36.211 INFO:teuthology.orchestra.run.smithi066.stdout:(97/150): libarrow-9.0.0-9.el9.x86_64.rpm 33 MB/s | 4.4 MB 00:00 2023-11-25T04:06:36.228 INFO:teuthology.orchestra.run.smithi066.stdout:(98/150): libarrow-doc-9.0.0-9.el9.noarch.rpm 265 kB/s | 24 kB 00:00 2023-11-25T04:06:36.245 INFO:teuthology.orchestra.run.smithi066.stdout:(99/150): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2023-11-25T04:06:36.270 INFO:teuthology.orchestra.run.smithi066.stdout:(100/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2023-11-25T04:06:36.296 INFO:teuthology.orchestra.run.smithi066.stdout:(101/150): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2023-11-25T04:06:36.329 INFO:teuthology.orchestra.run.smithi066.stdout:(102/150): python3-asyncssh-2.13.2-3.el9.noarch 16 MB/s | 548 kB 00:00 2023-11-25T04:06:36.363 INFO:teuthology.orchestra.run.smithi066.stdout:(103/150): parquet-libs-9.0.0-9.el9.x86_64.rpm 8.9 MB/s | 837 kB 00:00 2023-11-25T04:06:36.380 INFO:teuthology.orchestra.run.smithi066.stdout:(104/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 869 kB/s | 43 kB 00:00 2023-11-25T04:06:36.396 INFO:teuthology.orchestra.run.smithi066.stdout:(105/150): python3-cachetools-4.2.4-1.el9.noarc 964 kB/s | 32 kB 00:00 2023-11-25T04:06:36.413 INFO:teuthology.orchestra.run.smithi066.stdout:(106/150): python3-certifi-2021.10.8-2.el9.noar 451 kB/s | 15 kB 00:00 2023-11-25T04:06:36.439 INFO:teuthology.orchestra.run.smithi066.stdout:(107/150): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2023-11-25T04:06:36.472 INFO:teuthology.orchestra.run.smithi066.stdout:(108/150): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2023-11-25T04:06:36.490 INFO:teuthology.orchestra.run.smithi066.stdout:(109/150): python3-google-auth-2.23.4-1.el9.noa 3.8 MB/s | 197 kB 00:00 2023-11-25T04:06:36.506 INFO:teuthology.orchestra.run.smithi066.stdout:(110/150): python3-jaraco-8.2.1-3.el9.noarch.rp 317 kB/s | 11 kB 00:00 2023-11-25T04:06:36.523 INFO:teuthology.orchestra.run.smithi066.stdout:(111/150): python3-jaraco-classes-3.2.1-5.el9.n 531 kB/s | 18 kB 00:00 2023-11-25T04:06:36.540 INFO:teuthology.orchestra.run.smithi066.stdout:(112/150): python3-jaraco-collections-3.0.0-8.e 692 kB/s | 23 kB 00:00 2023-11-25T04:06:36.566 INFO:teuthology.orchestra.run.smithi066.stdout:(113/150): python3-jaraco-functools-3.5.0-2.el9 465 kB/s | 19 kB 00:00 2023-11-25T04:06:36.591 INFO:teuthology.orchestra.run.smithi066.stdout:(114/150): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2023-11-25T04:06:36.616 INFO:teuthology.orchestra.run.smithi066.stdout:(115/150): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2023-11-25T04:06:36.641 INFO:teuthology.orchestra.run.smithi066.stdout:(116/150): python3-jwt-2.4.0-1.el9.noarch.rpm 816 kB/s | 41 kB 00:00 2023-11-25T04:06:36.708 INFO:teuthology.orchestra.run.smithi066.stdout:(117/150): openssl-devel-3.0.7-25.el9.x86_64.rp 4.9 MB/s | 4.1 MB 00:00 2023-11-25T04:06:36.734 INFO:teuthology.orchestra.run.smithi066.stdout:(118/150): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2023-11-25T04:06:36.767 INFO:teuthology.orchestra.run.smithi066.stdout:(119/150): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2023-11-25T04:06:36.793 INFO:teuthology.orchestra.run.smithi066.stdout:(120/150): python3-natsort-7.1.1-5.el9.noarch.r 985 kB/s | 58 kB 00:00 2023-11-25T04:06:36.818 INFO:teuthology.orchestra.run.smithi066.stdout:(121/150): python3-more-itertools-8.12.0-2.el9. 724 kB/s | 79 kB 00:00 2023-11-25T04:06:36.843 INFO:teuthology.orchestra.run.smithi066.stdout:(122/150): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2023-11-25T04:06:36.868 INFO:teuthology.orchestra.run.smithi066.stdout:(123/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2023-11-25T04:06:36.894 INFO:teuthology.orchestra.run.smithi066.stdout:(124/150): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2023-11-25T04:06:36.919 INFO:teuthology.orchestra.run.smithi066.stdout:(125/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2023-11-25T04:06:36.944 INFO:teuthology.orchestra.run.smithi066.stdout:(126/150): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2023-11-25T04:06:36.986 INFO:teuthology.orchestra.run.smithi066.stdout:(127/150): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-11-25T04:06:37.011 INFO:teuthology.orchestra.run.smithi066.stdout:(128/150): python3-tempora-5.0.0-2.el9.noarch.r 389 kB/s | 36 kB 00:00 2023-11-25T04:06:37.036 INFO:teuthology.orchestra.run.smithi066.stdout:(129/150): python3-typing-extensions-4.4.0-2.el 555 kB/s | 51 kB 00:00 2023-11-25T04:06:37.062 INFO:teuthology.orchestra.run.smithi066.stdout:(130/150): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2023-11-25T04:06:37.087 INFO:teuthology.orchestra.run.smithi066.stdout:(131/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2023-11-25T04:06:37.112 INFO:teuthology.orchestra.run.smithi066.stdout:(132/150): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2023-11-25T04:06:37.137 INFO:teuthology.orchestra.run.smithi066.stdout:(133/150): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2023-11-25T04:06:37.163 INFO:teuthology.orchestra.run.smithi066.stdout:(134/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-11-25T04:06:37.205 INFO:teuthology.orchestra.run.smithi066.stdout:(135/150): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2023-11-25T04:06:37.238 INFO:teuthology.orchestra.run.smithi066.stdout:(136/150): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-11-25T04:06:37.405 INFO:teuthology.orchestra.run.smithi066.stdout:(137/150): NetworkManager-1.45.6-1.el9.x86_64.r 13 MB/s | 2.2 MB 00:00 2023-11-25T04:06:37.497 INFO:teuthology.orchestra.run.smithi066.stdout:(138/150): NetworkManager-libnm-1.45.6-1.el9.x8 19 MB/s | 1.8 MB 00:00 2023-11-25T04:06:37.523 INFO:teuthology.orchestra.run.smithi066.stdout:(139/150): NetworkManager-team-1.45.6-1.el9.x86 1.7 MB/s | 42 kB 00:00 2023-11-25T04:06:37.565 INFO:teuthology.orchestra.run.smithi066.stdout:(140/150): NetworkManager-tui-1.45.6-1.el9.x86_ 5.7 MB/s | 245 kB 00:00 2023-11-25T04:06:37.607 INFO:teuthology.orchestra.run.smithi066.stdout:(141/150): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-11-25T04:06:37.665 INFO:teuthology.orchestra.run.smithi066.stdout:(142/150): librbd1-18.0.0-7506.gec928368.el9.x8 6.0 MB/s | 3.0 MB 00:00 2023-11-25T04:06:37.682 INFO:teuthology.orchestra.run.smithi066.stdout:(143/150): elfutils-debuginfod-client-0.190-1.e 485 kB/s | 36 kB 00:00 2023-11-25T04:06:37.708 INFO:teuthology.orchestra.run.smithi066.stdout:(144/150): elfutils-libelf-0.190-1.el9.x86_64.r 4.5 MB/s | 192 kB 00:00 2023-11-25T04:06:37.741 INFO:teuthology.orchestra.run.smithi066.stdout:(145/150): elfutils-libs-0.190-1.el9.x86_64.rpm 4.3 MB/s | 255 kB 00:00 2023-11-25T04:06:37.758 INFO:teuthology.orchestra.run.smithi066.stdout:(146/150): libacl-2.3.1-4.el9.x86_64.rpm 442 kB/s | 22 kB 00:00 2023-11-25T04:06:37.785 INFO:teuthology.orchestra.run.smithi066.stdout:(147/150): xfsdump-3.1.12-4.el9.x86_64.rpm 7.5 MB/s | 321 kB 00:00 2023-11-25T04:06:37.984 INFO:teuthology.orchestra.run.smithi066.stdout:(148/150): openssl-3.0.7-25.el9.x86_64.rpm 5.4 MB/s | 1.2 MB 00:00 2023-11-25T04:06:38.150 INFO:teuthology.orchestra.run.smithi066.stdout:(149/150): openssl-libs-3.0.7-25.el9.x86_64.rpm 5.9 MB/s | 2.2 MB 00:00 2023-11-25T04:06:38.234 INFO:teuthology.orchestra.run.smithi066.stdout:(150/150): librados2-18.0.0-7506.gec928368.el9. 3.0 MB/s | 3.3 MB 00:01 2023-11-25T04:06:38.238 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2023-11-25T04:06:38.238 INFO:teuthology.orchestra.run.smithi066.stdout:Total 15 MB/s | 205 MB 00:13 2023-11-25T04:06:38.349 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2023-11-25T04:06:38.554 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2023-11-25T04:06:38.554 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2023-11-25T04:06:40.438 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2023-11-25T04:06:40.439 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2023-11-25T04:06:42.217 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-11-25T04:06:42.323 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/165 2023-11-25T04:06:42.355 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/165 2023-11-25T04:06:42.398 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/165 2023-11-25T04:06:42.439 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/165 2023-11-25T04:06:42.464 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2023-11-25T04:06:42.513 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2023-11-25T04:06:42.851 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2023-11-25T04:06:42.890 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:18.0.0-7506.gec928368.el9.x86_64 8/165 2023-11-25T04:06:43.012 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:18.0.0-7506.gec928368.el9.x86_64 8/165 2023-11-25T04:06:43.158 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:18.0.0-7506.gec928368.el9.x86_64 9/165 2023-11-25T04:06:43.257 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:18.0.0-7506.gec928368.el9.x86_64 9/165 2023-11-25T04:06:43.296 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:18.0.0-7506.gec928368.el9.x86_64 10/165 2023-11-25T04:06:43.338 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/165 2023-11-25T04:06:43.515 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/165 2023-11-25T04:06:43.561 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/165 2023-11-25T04:06:43.604 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:18.0.0-7506.gec928368.el9.x86_64 14/165 2023-11-25T04:06:43.690 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7506.gec928368.el9.x86_64 14/165 2023-11-25T04:06:43.713 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:18.0.0-7506.gec928368.el9.x86 15/165 2023-11-25T04:06:43.775 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7506.gec928368.el9.x86 15/165 2023-11-25T04:06:43.941 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/165 2023-11-25T04:06:44.084 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/165 2023-11-25T04:06:44.144 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/165 2023-11-25T04:06:44.238 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/165 2023-11-25T04:06:44.295 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/165 2023-11-25T04:06:44.568 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/165 2023-11-25T04:06:44.608 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/165 2023-11-25T04:06:44.679 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/165 2023-11-25T04:06:44.731 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/165 2023-11-25T04:06:44.761 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/165 2023-11-25T04:06:44.807 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/165 2023-11-25T04:06:44.856 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/165 2023-11-25T04:06:44.923 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/165 2023-11-25T04:06:44.963 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/165 2023-11-25T04:06:44.997 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/165 2023-11-25T04:06:45.025 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2023-11-25T04:06:45.095 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2023-11-25T04:06:45.130 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:18.0.0-7506.gec928368.el9. 30/165 2023-11-25T04:06:45.174 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:18.0.0-7506.gec928368.el 31/165 2023-11-25T04:06:45.202 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:18.0.0-7506.gec928368.el9.x86_6 32/165 2023-11-25T04:06:45.276 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/165 2023-11-25T04:06:45.359 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/165 2023-11-25T04:06:45.497 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/165 2023-11-25T04:06:45.553 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/165 2023-11-25T04:06:46.108 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/165 2023-11-25T04:06:46.191 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/165 2023-11-25T04:06:46.238 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 39/165 2023-11-25T04:06:46.278 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 40/165 2023-11-25T04:06:46.315 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:18.0.0-7506.gec928368.el9.x86_6 41/165 2023-11-25T04:06:46.358 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/165 2023-11-25T04:06:46.501 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/165 2023-11-25T04:06:46.558 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 44/165 2023-11-25T04:06:46.668 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-3.el9.x86_64 45/165 2023-11-25T04:06:46.702 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 46/165 2023-11-25T04:06:46.712 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2023-11-25T04:06:46.759 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/165 2023-11-25T04:06:46.833 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/165 2023-11-25T04:06:46.854 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/165 2023-11-25T04:06:46.870 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/165 2023-11-25T04:06:46.889 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/165 2023-11-25T04:06:46.906 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/165 2023-11-25T04:06:46.928 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/165 2023-11-25T04:06:46.954 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/165 2023-11-25T04:06:46.964 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/165 2023-11-25T04:06:46.981 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2023-11-25T04:06:46.999 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/165 2023-11-25T04:06:47.037 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2023-11-25T04:06:47.041 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/165 2023-11-25T04:06:47.182 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/165 2023-11-25T04:06:47.226 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/165 2023-11-25T04:06:47.268 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/165 2023-11-25T04:06:47.364 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/165 2023-11-25T04:06:47.382 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2023-11-25T04:06:47.440 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:18.0.0-7506.gec928368.el9.x86_64 8/165 2023-11-25T04:06:47.469 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/165 2023-11-25T04:06:47.562 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:18.0.0-7506.gec928368.el9.x86_64 8/165 2023-11-25T04:06:47.590 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:18.0.0-7506.gec928368.el9.x86_64 9/165 2023-11-25T04:06:47.650 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/165 2023-11-25T04:06:47.683 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:18.0.0-7506.gec928368.el9.x86_64 9/165 2023-11-25T04:06:47.719 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:18.0.0-7506.gec928368.el9.x86_64 10/165 2023-11-25T04:06:47.741 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/165 2023-11-25T04:06:47.764 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/165 2023-11-25T04:06:47.849 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 61/165 2023-11-25T04:06:47.886 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/165 2023-11-25T04:06:47.945 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/165 2023-11-25T04:06:47.969 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/165 2023-11-25T04:06:48.009 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/165 2023-11-25T04:06:48.029 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/165 2023-11-25T04:06:48.053 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:18.0.0-7506.gec928368.el9.x86_64 14/165 2023-11-25T04:06:48.157 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7506.gec928368.el9.x86_64 14/165 2023-11-25T04:06:48.179 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:18.0.0-7506.gec928368.el9.x86 15/165 2023-11-25T04:06:48.204 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/165 2023-11-25T04:06:48.241 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7506.gec928368.el9.x86 15/165 2023-11-25T04:06:48.248 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/165 2023-11-25T04:06:48.392 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/165 2023-11-25T04:06:48.411 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 16/165 2023-11-25T04:06:48.442 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/165 2023-11-25T04:06:48.470 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/165 2023-11-25T04:06:48.496 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/165 2023-11-25T04:06:48.525 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/165 2023-11-25T04:06:48.528 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/165 2023-11-25T04:06:48.559 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/165 2023-11-25T04:06:48.568 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 17/165 2023-11-25T04:06:48.587 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/165 2023-11-25T04:06:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/165 2023-11-25T04:06:48.658 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/165 2023-11-25T04:06:48.675 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/165 2023-11-25T04:06:48.712 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-1:1.45.6-1.el9.x86_64 18/165 2023-11-25T04:06:48.713 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/165 2023-11-25T04:06:48.792 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/165 2023-11-25T04:06:48.823 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 78/165 2023-11-25T04:06:48.857 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/165 2023-11-25T04:06:48.898 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/165 2023-11-25T04:06:48.924 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/165 2023-11-25T04:06:48.996 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.45.6-1.el9.x86_64 18/165 2023-11-25T04:06:49.018 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/165 2023-11-25T04:06:49.032 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/165 2023-11-25T04:06:49.060 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 83/165 2023-11-25T04:06:49.104 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/165 2023-11-25T04:06:49.156 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/165 2023-11-25T04:06:49.168 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/165 2023-11-25T04:06:49.186 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/165 2023-11-25T04:06:49.230 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/165 2023-11-25T04:06:49.262 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/165 2023-11-25T04:06:49.270 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/165 2023-11-25T04:06:49.344 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/165 2023-11-25T04:06:49.386 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/165 2023-11-25T04:06:49.420 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/165 2023-11-25T04:06:49.447 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2023-11-25T04:06:49.511 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2023-11-25T04:06:49.535 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:18.0.0-7506.gec928368.el9. 30/165 2023-11-25T04:06:49.580 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:18.0.0-7506.gec928368.el 31/165 2023-11-25T04:06:49.607 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:18.0.0-7506.gec928368.el9.x86_6 32/165 2023-11-25T04:06:49.679 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/165 2023-11-25T04:06:49.757 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/165 2023-11-25T04:06:49.894 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/165 2023-11-25T04:06:49.950 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/165 2023-11-25T04:06:50.028 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/165 2023-11-25T04:06:50.074 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/165 2023-11-25T04:06:50.108 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/165 2023-11-25T04:06:50.141 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/165 2023-11-25T04:06:50.326 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/165 2023-11-25T04:06:50.355 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/165 2023-11-25T04:06:50.436 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/165 2023-11-25T04:06:50.512 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/165 2023-11-25T04:06:50.596 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/165 2023-11-25T04:06:50.652 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 39/165 2023-11-25T04:06:50.701 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 40/165 2023-11-25T04:06:50.738 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:18.0.0-7506.gec928368.el9.x86_6 41/165 2023-11-25T04:06:50.780 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/165 2023-11-25T04:06:50.920 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/165 2023-11-25T04:06:50.963 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 44/165 2023-11-25T04:06:51.066 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : re2-1:20211101-3.el9.x86_64 45/165 2023-11-25T04:06:51.109 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 46/165 2023-11-25T04:06:51.164 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/165 2023-11-25T04:06:51.181 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/165 2023-11-25T04:06:51.255 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/165 2023-11-25T04:06:51.290 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/165 2023-11-25T04:06:51.291 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/165 2023-11-25T04:06:51.329 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/165 2023-11-25T04:06:51.376 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/165 2023-11-25T04:06:51.421 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/165 2023-11-25T04:06:51.464 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/165 2023-11-25T04:06:51.603 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/165 2023-11-25T04:06:51.648 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/165 2023-11-25T04:06:51.690 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/165 2023-11-25T04:06:51.786 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/165 2023-11-25T04:06:51.824 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/165 2023-11-25T04:06:51.865 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/165 2023-11-25T04:06:51.896 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/165 2023-11-25T04:06:51.996 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 61/165 2023-11-25T04:06:52.041 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/165 2023-11-25T04:06:52.099 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/165 2023-11-25T04:06:52.163 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/165 2023-11-25T04:06:52.357 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/165 2023-11-25T04:06:52.414 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/165 2023-11-25T04:06:52.557 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/165 2023-11-25T04:06:52.586 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/165 2023-11-25T04:06:52.598 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/165 2023-11-25T04:06:52.635 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/165 2023-11-25T04:06:52.681 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/165 2023-11-25T04:06:52.711 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 97/165 2023-11-25T04:06:52.742 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jq-1.6-16.el9.x86_64 98/165 2023-11-25T04:06:52.744 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/165 2023-11-25T04:06:52.771 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2023-11-25T04:06:52.804 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 100/165 2023-11-25T04:06:52.970 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/165 2023-11-25T04:06:52.999 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/165 2023-11-25T04:06:53.036 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/165 2023-11-25T04:06:53.078 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/165 2023-11-25T04:06:53.116 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/165 2023-11-25T04:06:53.122 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2023-11-25T04:06:53.137 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/165 2023-11-25T04:06:53.150 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:18.0.0-7506.gec928368.el9.x86_64 102/165 2023-11-25T04:06:53.211 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/165 2023-11-25T04:06:53.242 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:18.0.0-7506.gec928368.el9.x86_64 102/165 2023-11-25T04:06:53.255 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 78/165 2023-11-25T04:06:53.272 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:18.0.0-7506.gec928368.el9.x86_64 103/165 2023-11-25T04:06:53.288 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/165 2023-11-25T04:06:53.308 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2023-11-25T04:06:53.331 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/165 2023-11-25T04:06:53.365 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/165 2023-11-25T04:06:53.461 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/165 2023-11-25T04:06:53.500 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 83/165 2023-11-25T04:06:53.608 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/165 2023-11-25T04:06:53.660 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/165 2023-11-25T04:06:53.759 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 105/165 2023-11-25T04:06:53.787 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:18.0.0-7506.gec928368.el9.x86_64 106/165 2023-11-25T04:06:53.841 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:18.0.0-7506.gec928368.el9.x86_64 106/165 2023-11-25T04:06:53.880 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:18.0.0-7506.gec928368.el9.x86_64 107/165 2023-11-25T04:06:54.430 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/165 2023-11-25T04:06:54.480 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/165 2023-11-25T04:06:54.514 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/165 2023-11-25T04:06:54.546 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/165 2023-11-25T04:06:54.735 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/165 2023-11-25T04:06:54.752 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/165 2023-11-25T04:06:54.834 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/165 2023-11-25T04:06:55.510 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/165 2023-11-25T04:06:55.630 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/165 2023-11-25T04:06:56.056 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 108/165 2023-11-25T04:06:56.085 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 108/165 2023-11-25T04:06:56.675 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 108/165 2023-11-25T04:06:56.722 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:18.0.0-7506.gec928368.el9.x86_64 109/165 2023-11-25T04:06:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:18.0.0-7506.gec928368.el9.x86_64 109/165 2023-11-25T04:06:56.801 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-25T04:06:56.801 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-25T04:06:56.801 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:06:56.840 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:18.0.0-7506.gec928368.el9.x86_64 110/165 2023-11-25T04:06:56.950 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/165 2023-11-25T04:06:57.036 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/165 2023-11-25T04:06:57.068 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 97/165 2023-11-25T04:06:57.098 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : jq-1.6-16.el9.x86_64 98/165 2023-11-25T04:06:57.127 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2023-11-25T04:06:57.160 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 100/165 2023-11-25T04:06:57.477 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2023-11-25T04:06:57.506 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:18.0.0-7506.gec928368.el9.x86_64 102/165 2023-11-25T04:06:57.598 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:18.0.0-7506.gec928368.el9.x86_64 102/165 2023-11-25T04:06:57.627 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:18.0.0-7506.gec928368.el9.x86_64 103/165 2023-11-25T04:06:57.664 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2023-11-25T04:06:58.117 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 105/165 2023-11-25T04:06:58.142 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:18.0.0-7506.gec928368.el9.x86_64 106/165 2023-11-25T04:06:58.214 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:18.0.0-7506.gec928368.el9.x86_64 106/165 2023-11-25T04:06:58.243 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:18.0.0-7506.gec928368.el9.x86_64 107/165 2023-11-25T04:07:00.460 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 108/165 2023-11-25T04:07:00.490 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 108/165 2023-11-25T04:07:01.061 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 108/165 2023-11-25T04:07:01.102 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:18.0.0-7506.gec928368.el9.x86_64 109/165 2023-11-25T04:07:01.192 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:18.0.0-7506.gec928368.el9.x86_64 109/165 2023-11-25T04:07:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-11-25T04:07:01.192 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-11-25T04:07:01.192 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:01.236 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:18.0.0-7506.gec928368.el9.x86_64 110/165 2023-11-25T04:07:08.732 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7506.gec928368.el9.x86_64 110/165 2023-11-25T04:07:08.732 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2023-11-25T04:07:08.732 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2023-11-25T04:07:08.732 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2023-11-25T04:07:08.732 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2023-11-25T04:07:08.732 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2023-11-25T04:07:08.732 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2023-11-25T04:07:08.732 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2023-11-25T04:07:08.732 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:08.893 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:18.0.0-7506.gec928368.el9.noarch 111/165 2023-11-25T04:07:08.909 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:18.0.0-7506.gec928368.el9.noarch 111/165 2023-11-25T04:07:08.909 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:08.909 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-25T04:07:08.909 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:10.554 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:18.0.0-7506.gec928368.el9.x86_64 112/165 2023-11-25T04:07:12.858 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:18.0.0-7506.gec928368.el9.x86_64 112/165 2023-11-25T04:07:12.862 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:12.862 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-25T04:07:12.862 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:18.0.0-7506.gec928368.el9.x86_64 113/165 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:18.0.0-7506.gec928368.el9.x86_64 113/165 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:18.0.0-7506.gec928368.el9.x86_64 114/165 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:18.0.0-7506.gec928368.el9.x86_64 114/165 2023-11-25T04:07:12.863 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:18.0.0-7506.gec928368.el9.noarch 116/165 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:18.0.0-7506.gec928368.el9.noarch 116/165 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7506.gec928368.e 117/165 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7506.gec928368. 118/165 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7506.gec928368.el9.noa 119/165 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7506.gec928368.el9.noa 119/165 2023-11-25T04:07:12.864 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7506.gec928368.el9.n 120/165 2023-11-25T04:07:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7506.gec928368.el9.x86_64 110/165 2023-11-25T04:07:13.005 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2023-11-25T04:07:13.005 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2023-11-25T04:07:13.005 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2023-11-25T04:07:13.005 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2023-11-25T04:07:13.005 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2023-11-25T04:07:13.005 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2023-11-25T04:07:13.005 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2023-11-25T04:07:13.005 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:13.172 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-volume-2:18.0.0-7506.gec928368.el9.noarch 111/165 2023-11-25T04:07:13.189 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-volume-2:18.0.0-7506.gec928368.el9.noarch 111/165 2023-11-25T04:07:13.189 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:13.189 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-11-25T04:07:13.189 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:13.306 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7506.gec928368.el9.n 120/165 2023-11-25T04:07:13.346 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7506.gec9 121/165 2023-11-25T04:07:13.451 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7506.gec9 121/165 2023-11-25T04:07:13.610 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7506.gec928368.el 122/165 2023-11-25T04:07:13.640 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:18.0.0-7506.gec928368.el9.x86_64 123/165 2023-11-25T04:07:13.664 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7506.gec928368.el9.x86_64 123/165 2023-11-25T04:07:13.664 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:13.664 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-25T04:07:13.664 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-25T04:07:13.664 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-25T04:07:13.665 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:13.715 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:18.0.0-7506.gec928368.el9.noarch 124/165 2023-11-25T04:07:13.726 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7506.gec928368.el9.noarch 124/165 2023-11-25T04:07:13.783 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:18.0.0-7506.gec928368.el9.x86_64 125/165 2023-11-25T04:07:14.619 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/165 2023-11-25T04:07:14.651 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:18.0.0-7506.gec928368.el9.x86_64 127/165 2023-11-25T04:07:14.675 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7506.gec928368.el9.x86_64 127/165 2023-11-25T04:07:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-25T04:07:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-25T04:07:14.675 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-25T04:07:14.676 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:14.718 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7506.gec928 128/165 2023-11-25T04:07:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7506.gec928 128/165 2023-11-25T04:07:14.741 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:14.741 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-25T04:07:14.741 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:14.785 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-mirror-2:18.0.0-7506.gec928368.el9.x86_64 129/165 2023-11-25T04:07:14.809 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7506.gec928368.el9.x86_64 129/165 2023-11-25T04:07:14.809 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:14.809 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-25T04:07:14.809 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-25T04:07:14.810 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-25T04:07:14.810 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:14.825 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:18.0.0-7506.gec928368.el9.x86_64 112/165 2023-11-25T04:07:14.852 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:18.0.0-7506.gec928368.el9.x86_64 112/165 2023-11-25T04:07:14.853 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:14.853 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-11-25T04:07:14.853 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-25T04:07:14.853 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-11-25T04:07:14.853 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:15.059 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:18.0.0-7506.gec928368.el9.x86_64 113/165 2023-11-25T04:07:15.083 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:18.0.0-7506.gec928368.el9.x86_64 113/165 2023-11-25T04:07:15.083 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:15.083 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-11-25T04:07:15.083 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-25T04:07:15.083 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-11-25T04:07:15.083 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:15.128 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:18.0.0-7506.gec928368.el9.x86_64 130/165 2023-11-25T04:07:15.152 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7506.gec928368.el9.x86_64 130/165 2023-11-25T04:07:15.152 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:15.152 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-25T04:07:15.152 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-25T04:07:15.152 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-25T04:07:15.152 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:15.551 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:18.0.0-7506.gec928368.el9.x86_64 114/165 2023-11-25T04:07:15.576 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:18.0.0-7506.gec928368.el9.x86_64 114/165 2023-11-25T04:07:15.576 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:15.576 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-11-25T04:07:15.576 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-25T04:07:15.576 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-11-25T04:07:15.576 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:15.678 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2023-11-25T04:07:16.135 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:18.0.0-7506.gec928368.el9.noarch 116/165 2023-11-25T04:07:16.159 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:18.0.0-7506.gec928368.el9.noarch 116/165 2023-11-25T04:07:16.189 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7506.gec928368.e 117/165 2023-11-25T04:07:16.252 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7506.gec928368. 118/165 2023-11-25T04:07:16.282 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7506.gec928368.el9.noa 119/165 2023-11-25T04:07:16.517 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7506.gec928368.el9.noa 119/165 2023-11-25T04:07:16.550 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7506.gec928368.el9.n 120/165 2023-11-25T04:07:17.573 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7506.gec928368.el9.n 120/165 2023-11-25T04:07:17.600 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7506.gec9 121/165 2023-11-25T04:07:17.707 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7506.gec9 121/165 2023-11-25T04:07:17.865 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7506.gec928368.el 122/165 2023-11-25T04:07:17.894 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:18.0.0-7506.gec928368.el9.x86_64 123/165 2023-11-25T04:07:17.919 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7506.gec928368.el9.x86_64 123/165 2023-11-25T04:07:17.919 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:17.919 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-11-25T04:07:17.919 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-25T04:07:17.919 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-11-25T04:07:17.919 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:17.970 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:18.0.0-7506.gec928368.el9.noarch 124/165 2023-11-25T04:07:17.981 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7506.gec928368.el9.noarch 124/165 2023-11-25T04:07:18.030 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:18.0.0-7506.gec928368.el9.x86_64 125/165 2023-11-25T04:07:18.890 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/165 2023-11-25T04:07:18.922 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:18.0.0-7506.gec928368.el9.x86_64 127/165 2023-11-25T04:07:18.946 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7506.gec928368.el9.x86_64 127/165 2023-11-25T04:07:18.947 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:18.947 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-11-25T04:07:18.947 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-25T04:07:18.947 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-11-25T04:07:18.947 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:18.989 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7506.gec928 128/165 2023-11-25T04:07:19.012 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7506.gec928 128/165 2023-11-25T04:07:19.012 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:19.013 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-11-25T04:07:19.013 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:19.056 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-mirror-2:18.0.0-7506.gec928368.el9.x86_64 129/165 2023-11-25T04:07:19.080 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7506.gec928368.el9.x86_64 129/165 2023-11-25T04:07:19.080 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:19.081 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-11-25T04:07:19.081 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-25T04:07:19.081 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-11-25T04:07:19.081 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:19.181 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:18.0.0-7506.gec928368.el9.x86_64 131/165 2023-11-25T04:07:19.223 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:18.0.0-7506.gec928368.el9.x86_64 132/165 2023-11-25T04:07:19.264 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:18.0.0-7506.gec928368.el9.x86_64 133/165 2023-11-25T04:07:19.295 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 134/165 2023-11-25T04:07:19.390 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:18.0.0-7506.gec928368.el9.x86_64 130/165 2023-11-25T04:07:19.415 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7506.gec928368.el9.x86_64 130/165 2023-11-25T04:07:19.415 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-11-25T04:07:19.415 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-11-25T04:07:19.415 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-25T04:07:19.415 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-11-25T04:07:19.415 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:19.481 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 135/165 2023-11-25T04:07:19.598 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 136/165 2023-11-25T04:07:19.635 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:18.0.0-7506.gec928368.el9.x86_64 137/165 2023-11-25T04:07:19.668 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:18.0.0-7506.gec928368.el9.x86_ 138/165 2023-11-25T04:07:19.708 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 139/165 2023-11-25T04:07:19.738 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 140/165 2023-11-25T04:07:19.814 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 141/165 2023-11-25T04:07:19.874 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 142/165 2023-11-25T04:07:19.911 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 143/165 2023-11-25T04:07:20.537 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-11-25T04:07:20.576 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 144/165 2023-11-25T04:07:20.596 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-11-25T04:07:21.475 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephfs-top-2:18.0.0-7506.gec928368.el9.noarch 145/165 2023-11-25T04:07:21.583 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 146/165 2023-11-25T04:07:21.647 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 147/165 2023-11-25T04:07:21.690 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/165 2023-11-25T04:07:21.783 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/165 2023-11-25T04:07:21.818 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/165 2023-11-25T04:07:21.843 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/165 2023-11-25T04:07:21.868 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 152/165 2023-11-25T04:07:21.895 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 153/165 2023-11-25T04:07:21.895 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-11-25T04:07:21.963 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-11-25T04:07:21.991 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 155/165 2023-11-25T04:07:22.025 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 156/165 2023-11-25T04:07:22.072 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 157/165 2023-11-25T04:07:22.072 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 158/165 2023-11-25T04:07:22.156 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 158/165 2023-11-25T04:07:22.181 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-11-25T04:07:22.187 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-11-25T04:07:22.187 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-11-25T04:07:22.375 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-11-25T04:07:22.375 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-11-25T04:07:22.459 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-11-25T04:07:22.483 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 162/165 2023-11-25T04:07:22.508 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 163/165 2023-11-25T04:07:22.534 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 164/165 2023-11-25T04:07:22.602 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 165/165 2023-11-25T04:07:23.452 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:18.0.0-7506.gec928368.el9.x86_64 131/165 2023-11-25T04:07:23.494 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:18.0.0-7506.gec928368.el9.x86_64 132/165 2023-11-25T04:07:23.535 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:18.0.0-7506.gec928368.el9.x86_64 133/165 2023-11-25T04:07:23.566 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 134/165 2023-11-25T04:07:23.756 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 135/165 2023-11-25T04:07:23.869 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 136/165 2023-11-25T04:07:23.922 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:18.0.0-7506.gec928368.el9.x86_64 137/165 2023-11-25T04:07:23.956 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:18.0.0-7506.gec928368.el9.x86_ 138/165 2023-11-25T04:07:23.996 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 139/165 2023-11-25T04:07:24.025 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-team-1:1.45.6-1.el9.x86_64 140/165 2023-11-25T04:07:24.101 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-tui-1:1.45.6-1.el9.x86_64 141/165 2023-11-25T04:07:24.165 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 142/165 2023-11-25T04:07:24.207 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 143/165 2023-11-25T04:07:24.854 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-11-25T04:07:24.889 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 144/165 2023-11-25T04:07:24.910 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-11-25T04:07:25.820 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-top-2:18.0.0-7506.gec928368.el9.noarch 145/165 2023-11-25T04:07:25.932 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 146/165 2023-11-25T04:07:25.992 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 147/165 2023-11-25T04:07:26.035 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/165 2023-11-25T04:07:26.122 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/165 2023-11-25T04:07:26.155 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/165 2023-11-25T04:07:26.180 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/165 2023-11-25T04:07:26.205 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 152/165 2023-11-25T04:07:26.231 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 153/165 2023-11-25T04:07:26.232 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-11-25T04:07:26.316 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-11-25T04:07:26.344 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 155/165 2023-11-25T04:07:26.375 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 156/165 2023-11-25T04:07:26.399 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 157/165 2023-11-25T04:07:26.399 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 158/165 2023-11-25T04:07:26.484 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 158/165 2023-11-25T04:07:26.509 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-11-25T04:07:26.516 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-11-25T04:07:26.516 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-11-25T04:07:26.703 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-11-25T04:07:26.704 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-11-25T04:07:26.787 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-11-25T04:07:26.811 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 162/165 2023-11-25T04:07:26.845 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 163/165 2023-11-25T04:07:26.870 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 164/165 2023-11-25T04:07:26.900 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 165/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:18.0.0-7506.gec928368.el9.x86_64 1/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:18.0.0-7506.gec928368.el9.x86_64 2/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 3/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:18.0.0-7506.gec928368.el9.x86_64 4/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7506.gec928 5/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:18.0.0-7506.gec928368.el9.x86_64 6/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:18.0.0-7506.gec928368.el9.x86_64 7/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:18.0.0-7506.gec928368.el9.x86_64 8/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:18.0.0-7506.gec928368.el9.x86_64 9/165 2023-11-25T04:07:26.901 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:18.0.0-7506.gec928368.el9.x86_64 10/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:18.0.0-7506.gec928368.el9.x86_64 11/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:18.0.0-7506.gec928368.el9.x86_64 12/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-mirror-2:18.0.0-7506.gec928368.el9.x86_64 13/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:18.0.0-7506.gec928368.el9.x86_ 14/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:18.0.0-7506.gec928368.el9.x86_64 15/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:18.0.0-7506.gec928368.el9.x86_64 16/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:18.0.0-7506.gec928368.el9.x86_6 17/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:18.0.0-7506.gec928368.el9.x86 18/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:18.0.0-7506.gec928368.el9.x86_64 19/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7506.gec928368.el 20/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:18.0.0-7506.gec928368.el9. 21/165 2023-11-25T04:07:26.902 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:18.0.0-7506.gec928368.el9.x86_6 22/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:18.0.0-7506.gec928368.el9.x86_64 23/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:18.0.0-7506.gec928368.el9.x86_64 24/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:18.0.0-7506.gec928368.el9.x86_64 25/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:18.0.0-7506.gec928368.el9.x86_64 26/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:18.0.0-7506.gec928368.el9.x86_64 27/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:18.0.0-7506.gec928368.el9.x86_64 28/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7506.gec928368. 29/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7506.gec928368.el9.noa 30/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7506.gec928368.el9.n 31/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7506.gec9 32/165 2023-11-25T04:07:26.903 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7506.gec928368.el 33/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7506.gec928368.el9.noarch 34/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7506.gec928368.e 35/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:18.0.0-7506.gec928368.el9.noarch 36/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:18.0.0-7506.gec928368.el9.noarch 37/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephfs-top-2:18.0.0-7506.gec928368.el9.noarch 38/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/165 2023-11-25T04:07:26.904 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jq-1.6-16.el9.x86_64 47/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/165 2023-11-25T04:07:26.905 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/165 2023-11-25T04:07:26.906 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/165 2023-11-25T04:07:26.907 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/165 2023-11-25T04:07:26.908 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 96/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 98/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 99/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 103/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 104/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/165 2023-11-25T04:07:26.909 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 110/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 111/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 112/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 113/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 115/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 116/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 117/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/165 2023-11-25T04:07:26.910 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/165 2023-11-25T04:07:26.911 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:18.0.0-7506.gec928368.el9.x86_64 136/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:18.0.0-7506.gec928368.el9.x86_64 138/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 141/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 142/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 143/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 144/165 2023-11-25T04:07:26.912 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 145/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 146/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 148/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 149/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : acl-2.3.1-4.el9.x86_64 150/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : acl-2.3.1-3.el9.x86_64 151/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 152/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 153/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 154/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 155/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 156/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 157/165 2023-11-25T04:07:26.913 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 158/165 2023-11-25T04:07:26.914 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 159/165 2023-11-25T04:07:26.914 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 160/165 2023-11-25T04:07:26.914 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 161/165 2023-11-25T04:07:26.914 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 162/165 2023-11-25T04:07:26.914 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 163/165 2023-11-25T04:07:26.914 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 164/165 2023-11-25T04:07:26.938 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 165/165 2023-11-25T04:07:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 165/165 2023-11-25T04:07:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:29.366 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2023-11-25T04:07:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-25T04:07:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-25T04:07:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-25T04:07:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-25T04:07:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: acl-2.3.1-4.el9.x86_64 2023-11-25T04:07:29.366 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: automake-1.16.2-8.el9.noarch 2023-11-25T04:07:29.367 INFO:teuthology.orchestra.run.smithi002.stdout: bison-3.7.4-5.el9.x86_64 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.368 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.369 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-mirror-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: cephfs-top-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: flex-2.6.4-9.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: jq-1.6-16.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-25T04:07:29.370 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.371 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-1.el9.noarch 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-25T04:07:29.372 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-13.11-1.el9.x86_64 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-25T04:07:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-25T04:07:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-25T04:07:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-25T04:07:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-25T04:07:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-25T04:07:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-25T04:07:29.374 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-25T04:07:29.375 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-25T04:07:29.376 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.377 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.378 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-3.el9.x86_64 2023-11-25T04:07:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-25T04:07:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-25T04:07:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-25T04:07:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-25T04:07:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-25T04:07:29.379 INFO:teuthology.orchestra.run.smithi002.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-25T04:07:29.380 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:29.380 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-11-25T04:07:29.958 DEBUG:teuthology.parallel:result is None 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 165/165 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:18.0.0-7506.gec928368.el9.x86_64 1/165 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:18.0.0-7506.gec928368.el9.x86_64 2/165 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 3/165 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:18.0.0-7506.gec928368.el9.x86_64 4/165 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7506.gec928 5/165 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:18.0.0-7506.gec928368.el9.x86_64 6/165 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:18.0.0-7506.gec928368.el9.x86_64 7/165 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:18.0.0-7506.gec928368.el9.x86_64 8/165 2023-11-25T04:07:31.271 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:18.0.0-7506.gec928368.el9.x86_64 9/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:18.0.0-7506.gec928368.el9.x86_64 10/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:18.0.0-7506.gec928368.el9.x86_64 11/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:18.0.0-7506.gec928368.el9.x86_64 12/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-mirror-2:18.0.0-7506.gec928368.el9.x86_64 13/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:18.0.0-7506.gec928368.el9.x86_ 14/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:18.0.0-7506.gec928368.el9.x86_64 15/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:18.0.0-7506.gec928368.el9.x86_64 16/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:18.0.0-7506.gec928368.el9.x86_6 17/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:18.0.0-7506.gec928368.el9.x86 18/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:18.0.0-7506.gec928368.el9.x86_64 19/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7506.gec928368.el 20/165 2023-11-25T04:07:31.272 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:18.0.0-7506.gec928368.el9. 21/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:18.0.0-7506.gec928368.el9.x86_6 22/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:18.0.0-7506.gec928368.el9.x86_64 23/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:18.0.0-7506.gec928368.el9.x86_64 24/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:18.0.0-7506.gec928368.el9.x86_64 25/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:18.0.0-7506.gec928368.el9.x86_64 26/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:18.0.0-7506.gec928368.el9.x86_64 27/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:18.0.0-7506.gec928368.el9.x86_64 28/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7506.gec928368. 29/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7506.gec928368.el9.noa 30/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7506.gec928368.el9.n 31/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7506.gec9 32/165 2023-11-25T04:07:31.273 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7506.gec928368.el 33/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7506.gec928368.el9.noarch 34/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7506.gec928368.e 35/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-volume-2:18.0.0-7506.gec928368.el9.noarch 36/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:18.0.0-7506.gec928368.el9.noarch 37/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-top-2:18.0.0-7506.gec928368.el9.noarch 38/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/165 2023-11-25T04:07:31.274 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : jq-1.6-16.el9.x86_64 47/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/165 2023-11-25T04:07:31.275 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/165 2023-11-25T04:07:31.276 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/165 2023-11-25T04:07:31.277 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/165 2023-11-25T04:07:31.278 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/165 2023-11-25T04:07:31.279 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 96/165 2023-11-25T04:07:31.280 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/165 2023-11-25T04:07:31.280 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 98/165 2023-11-25T04:07:31.280 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 99/165 2023-11-25T04:07:31.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/165 2023-11-25T04:07:31.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/165 2023-11-25T04:07:31.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/165 2023-11-25T04:07:31.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 103/165 2023-11-25T04:07:31.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 104/165 2023-11-25T04:07:31.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/165 2023-11-25T04:07:31.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/165 2023-11-25T04:07:31.281 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 110/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 111/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 112/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 113/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 115/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 116/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 117/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/165 2023-11-25T04:07:31.282 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/165 2023-11-25T04:07:31.283 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:18.0.0-7506.gec928368.el9.x86_64 136/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:18.0.0-7506.gec928368.el9.x86_64 138/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 141/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.45.6-1.el9.x86_64 142/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 143/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.45.6-1.el9.x86_64 144/165 2023-11-25T04:07:31.284 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 145/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.45.6-1.el9.x86_64 146/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 147/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.45.6-1.el9.x86_64 148/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 149/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : acl-2.3.1-4.el9.x86_64 150/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : acl-2.3.1-3.el9.x86_64 151/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 152/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 153/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 154/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 155/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 156/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 157/165 2023-11-25T04:07:31.285 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 158/165 2023-11-25T04:07:31.286 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 159/165 2023-11-25T04:07:31.286 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 160/165 2023-11-25T04:07:31.286 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 161/165 2023-11-25T04:07:31.286 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 162/165 2023-11-25T04:07:31.286 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 163/165 2023-11-25T04:07:31.286 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 164/165 2023-11-25T04:07:33.792 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 165/165 2023-11-25T04:07:33.792 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:33.792 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2023-11-25T04:07:33.792 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-1:1.45.6-1.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm-1:1.45.6-1.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team-1:1.45.6-1.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui-1:1.45.6-1.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: acl-2.3.1-4.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: libacl-2.3.1-4.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.793 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.2-8.el9.noarch 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.7.4-5.el9.x86_64 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.794 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.795 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top-2:18.0.0-7506.gec928368.el9.noarch 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.4-9.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.9-15.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: jq-1.6-16.el9.x86_64 2023-11-25T04:07:33.796 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-9.0.0-9.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.797 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-45.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: lua-5.4.4-4.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks-3.9.2-1.el9.noarch 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.21-2.el9.x86_64 2023-11-25T04:07:33.798 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-13.11-1.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server-13.11-1.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.799 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-11-25T04:07:33.800 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-11-25T04:07:33.801 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.802 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-7.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.7-6.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-11-25T04:07:33.803 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-11-25T04:07:33.804 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.804 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.804 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:18.0.0-7506.gec928368.el9.x86_64 2023-11-25T04:07:33.804 INFO:teuthology.orchestra.run.smithi066.stdout: re2-1:20211101-3.el9.x86_64 2023-11-25T04:07:33.804 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-5.el9.x86_64 2023-11-25T04:07:33.804 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2023-11-25T04:07:33.804 INFO:teuthology.orchestra.run.smithi066.stdout: uuid-1.6.2-55.el9.x86_64 2023-11-25T04:07:33.804 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-11-25T04:07:33.804 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-11-25T04:07:33.805 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-11-25T04:07:33.805 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:33.805 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2023-11-25T04:07:34.383 DEBUG:teuthology.parallel:result is None 2023-11-25T04:07:34.383 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ec928368edcc5fc71884a56fd9fd821b148f4e30 2023-11-25T04:07:34.663 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-25T04:07:34.690 INFO:teuthology.orchestra.run.smithi002.stdout:18.0.0-7506.gec928368.el9 2023-11-25T04:07:34.690 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7506.gec928368.el9 2023-11-25T04:07:34.691 INFO:teuthology.task.install:The correct ceph version 18.0.0-7506.gec928368 is installed. 2023-11-25T04:07:34.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=ec928368edcc5fc71884a56fd9fd821b148f4e30 2023-11-25T04:07:34.911 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-25T04:07:34.935 INFO:teuthology.orchestra.run.smithi066.stdout:18.0.0-7506.gec928368.el9 2023-11-25T04:07:34.935 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7506.gec928368.el9 2023-11-25T04:07:34.935 INFO:teuthology.task.install:The correct ceph version 18.0.0-7506.gec928368 is installed. 2023-11-25T04:07:34.936 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-25T04:07:34.936 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:34.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-25T04:07:34.975 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:07:34.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-25T04:07:35.011 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-25T04:07:35.011 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:35.011 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2023-11-25T04:07:35.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-25T04:07:35.124 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:07:35.125 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2023-11-25T04:07:35.157 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-25T04:07:35.229 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-25T04:07:35.229 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:35.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-25T04:07:35.265 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-25T04:07:35.340 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:07:35.340 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-25T04:07:35.372 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-25T04:07:35.443 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-25T04:07:35.444 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:35.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2023-11-25T04:07:35.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-25T04:07:35.553 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:07:35.554 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2023-11-25T04:07:35.585 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-25T04:07:35.656 INFO:teuthology.run_tasks:Running task ceph... 2023-11-25T04:07:35.722 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-25T04:07:35.723 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2023-11-25T04:07:35.725 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2023-11-25T04:07:35.759 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-25T04:07:35.759 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-25T04:07:35.801 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-25T04:07:35.834 INFO:tasks.ceph:Creating extra log directories... 2023-11-25T04:07:35.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-25T04:07:35.876 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-25T04:07:35.914 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-25T04:07:35.914 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-25T04:07:35.914 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-25T04:07:35.914 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:35.915 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-25T04:07:35.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-25T04:07:36.097 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-25T04:07:36.129 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:07:36.130 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-25T04:07:36.145 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-25T04:07:36.276 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-25T04:07:36.312 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-25T04:07:36.312 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-25T04:07:36.312 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-11-24_21:17:59-fs-main-distro-default-smithi/7466115', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7466115', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-11-24_21:17:59-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3835, 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_ec928368edcc5fc71884a56fd9fd821b148f4e30/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHc51PXXRxSzC+BqOt6g9ojwk6cJzxVQyz0RoKj8Hhxgk8Ukm/8OlwY+NyzTnHbMRlYD/6r6pqmbevq7N0e1mDs=', 'smithi066.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJtEdNF+oxWvn7RPGqOLcMXe4dgVXdaGiu1ubTeQn9ot1ysTU+5+bXCxXbhcxj5EM/oHLBFLAMFUmUQ46wKy9ws='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'ec928368edcc5fc71884a56fd9fd821b148f4e30', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_21:17:59', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-25T04:07:36.313 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-25T04:07:36.316 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-25T04:07:36.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2023-11-25T04:07:36.372 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2023-11-25T04:07:36.432 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:36.433 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2023-11-25T04:07:36.458 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-25T04:07:36.458 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2023-11-25T04:07:36.514 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-25T04:07:36.515 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-25T04:07:36.515 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 664 Links: 1 2023-11-25T04:07:36.515 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-25T04:07:36.515 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-11-25T04:07:36.515 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-25 04:07:22.927483604 +0000 2023-11-25T04:07:36.515 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-25 04:05:24.245430806 +0000 2023-11-25T04:07:36.515 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-25 04:05:24.245430806 +0000 2023-11-25T04:07:36.515 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2023-11-25 04:05:24.245430806 +0000 2023-11-25T04:07:36.515 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-25T04:07:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-25T04:07:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-25T04:07:36.584 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.7418e-05 s, 5.3 MB/s 2023-11-25T04:07:36.585 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-25T04:07:36.642 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2023-11-25T04:07:36.698 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-25T04:07:36.698 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-25T04:07:36.699 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-11-25T04:07:36.699 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-25T04:07:36.699 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-11-25T04:07:36.699 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-25 04:07:22.928483580 +0000 2023-11-25T04:07:36.699 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-25 04:05:24.753418829 +0000 2023-11-25T04:07:36.699 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-25 04:05:24.753418829 +0000 2023-11-25T04:07:36.699 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2023-11-25 04:05:24.753418829 +0000 2023-11-25T04:07:36.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-25T04:07:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-25T04:07:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-25T04:07:36.768 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.9381e-05 s, 5.2 MB/s 2023-11-25T04:07:36.769 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-25T04:07:36.826 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2023-11-25T04:07:36.881 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-25T04:07:36.881 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-25T04:07:36.881 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-11-25T04:07:36.882 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-25T04:07:36.882 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-11-25T04:07:36.883 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-25 04:07:22.928483580 +0000 2023-11-25T04:07:36.883 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-25 04:05:25.291406144 +0000 2023-11-25T04:07:36.883 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-25 04:05:25.291406144 +0000 2023-11-25T04:07:36.883 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2023-11-25 04:05:25.291406144 +0000 2023-11-25T04:07:36.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-25T04:07:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-25T04:07:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-25T04:07:36.951 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 9.8315e-05 s, 5.2 MB/s 2023-11-25T04:07:36.952 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-25T04:07:37.010 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2023-11-25T04:07:37.066 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-25T04:07:37.067 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-25T04:07:37.067 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-11-25T04:07:37.067 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-25T04:07:37.067 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2023-11-25T04:07:37.067 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2023-11-25 04:07:22.929483557 +0000 2023-11-25T04:07:37.067 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2023-11-25 04:05:25.807393977 +0000 2023-11-25T04:07:37.067 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2023-11-25 04:05:25.807393977 +0000 2023-11-25T04:07:37.067 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2023-11-25 04:05:25.807393977 +0000 2023-11-25T04:07:37.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-25T04:07:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2023-11-25T04:07:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2023-11-25T04:07:37.136 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 8.046e-05 s, 6.4 MB/s 2023-11-25T04:07:37.137 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-25T04:07:37.193 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:37.193 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:07:37.193 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2023-11-25T04:07:37.212 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-25T04:07:37.212 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2023-11-25T04:07:37.270 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-25T04:07:37.270 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-25T04:07:37.270 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 662 Links: 1 2023-11-25T04:07:37.270 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-25T04:07:37.271 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2023-11-25T04:07:37.271 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-11-25 04:07:27.264915010 +0000 2023-11-25T04:07:37.271 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-11-25 04:05:24.178383791 +0000 2023-11-25T04:07:37.271 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-11-25 04:05:24.178383791 +0000 2023-11-25T04:07:37.271 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2023-11-25 04:05:24.178383791 +0000 2023-11-25T04:07:37.271 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-25T04:07:37.345 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-11-25T04:07:37.345 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-11-25T04:07:37.345 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000219599 s, 2.3 MB/s 2023-11-25T04:07:37.346 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-25T04:07:37.405 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2023-11-25T04:07:37.464 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-25T04:07:37.464 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-25T04:07:37.464 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-11-25T04:07:37.464 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-25T04:07:37.464 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2023-11-25T04:07:37.464 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-11-25 04:07:27.265915003 +0000 2023-11-25T04:07:37.465 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-11-25 04:05:24.710379716 +0000 2023-11-25T04:07:37.465 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-11-25 04:05:24.710379716 +0000 2023-11-25T04:07:37.465 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2023-11-25 04:05:24.710379716 +0000 2023-11-25T04:07:37.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-25T04:07:37.537 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-11-25T04:07:37.537 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-11-25T04:07:37.537 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000222269 s, 2.3 MB/s 2023-11-25T04:07:37.539 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-25T04:07:37.596 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2023-11-25T04:07:37.654 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-25T04:07:37.654 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-25T04:07:37.655 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 701 Links: 1 2023-11-25T04:07:37.655 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-25T04:07:37.655 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2023-11-25T04:07:37.655 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-11-25 04:07:27.265915003 +0000 2023-11-25T04:07:37.655 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-11-25 04:05:25.234375702 +0000 2023-11-25T04:07:37.655 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-11-25 04:05:25.234375702 +0000 2023-11-25T04:07:37.655 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2023-11-25 04:05:25.234375702 +0000 2023-11-25T04:07:37.655 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-25T04:07:37.727 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-11-25T04:07:37.727 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-11-25T04:07:37.727 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000222692 s, 2.3 MB/s 2023-11-25T04:07:37.728 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-25T04:07:37.785 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2023-11-25T04:07:37.842 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-25T04:07:37.842 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-25T04:07:37.842 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 722 Links: 1 2023-11-25T04:07:37.843 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-25T04:07:37.843 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2023-11-25T04:07:37.843 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-11-25 04:07:27.266914995 +0000 2023-11-25T04:07:37.843 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-11-25 04:05:25.753371726 +0000 2023-11-25T04:07:37.843 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-11-25 04:05:25.753371726 +0000 2023-11-25T04:07:37.843 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2023-11-25 04:05:25.753371726 +0000 2023-11-25T04:07:37.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-25T04:07:37.912 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-11-25T04:07:37.912 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-11-25T04:07:37.912 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000236582 s, 2.2 MB/s 2023-11-25T04:07:37.913 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-25T04:07:37.970 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:37.970 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-25T04:07:37.971 INFO:tasks.ceph:Generating config... 2023-11-25T04:07:37.972 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-25T04:07:37.972 INFO:tasks.ceph:[client] debug client = 20 2023-11-25T04:07:37.972 INFO:tasks.ceph:[client] debug ms = 1 2023-11-25T04:07:37.972 INFO:tasks.ceph:[client] pid file = 2023-11-25T04:07:37.972 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-25T04:07:37.972 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-25T04:07:37.972 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-25T04:07:37.972 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-25T04:07:37.973 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-25T04:07:37.974 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-25T04:07:37.974 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-25T04:07:37.975 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-25T04:07:37.975 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-25T04:07:37.975 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-25T04:07:37.975 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-25T04:07:37.975 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-25T04:07:37.975 INFO:tasks.ceph:Setting up mon.a... 2023-11-25T04:07:37.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-25T04:07:38.036 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2023-11-25T04:07:38.039 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-25T04:07:38.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-25T04:07:38.121 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2'), ('mon.b', '172.21.15.66'), ('mon.c', '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]')] 2023-11-25T04:07:38.122 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-25T04:07:38.122 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:38.123 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-25T04:07:38.177 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --add b 172.21.15.66 --addv c '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:38.263 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:38.263 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid 490edb11-4d53-4272-8bbb-d46dd29c1240 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = pacific 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 490edb11-4d53-4272-8bbb-d46dd29c1240 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2023-11-25T04:07:38.262996+0000 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:created 2023-11-25T04:07:38.262996+0000 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 16 (pacific) 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:2: [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] mon.c 2023-11-25T04:07:38.264 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-25T04:07:38.265 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-25T04:07:38.280 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 490edb11-4d53-4272-8bbb-d46dd29c1240... 2023-11-25T04:07:38.281 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-25T04:07:38.323 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-25T04:07:38.381 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2023-11-25T04:07:38.381 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2023-11-25T04:07:38.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2023-11-25T04:07:38.383 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2023-11-25T04:07:38.384 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 490edb11-4d53-4272-8bbb-d46dd29c1240 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.385 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2023-11-25T04:07:38.386 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: bdev async discard = True 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: bdev enable discard = True 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore allocator = bitmap 2023-11-25T04:07:38.387 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 1/20 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 1/20 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 4/10 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2023-11-25T04:07:38.388 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2023-11-25T04:07:38.389 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2023-11-25T04:07:38.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: mon op complaint time = 120 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2023-11-25T04:07:38.391 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: client mount timeout = 600 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: debug client = 20 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = "" 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2023-11-25T04:07:38.392 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout:[mds] 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds = 20 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout: debug mds balancer = 20 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug frag = True 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout: mds debug scatterstat = True 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout: mds op complaint time = 180 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout: mds verify scatter = True 2023-11-25T04:07:38.393 INFO:teuthology.orchestra.run.smithi002.stdout: osd op complaint time = 180 2023-11-25T04:07:38.394 INFO:teuthology.orchestra.run.smithi002.stdout: rados mon op timeout = 900 2023-11-25T04:07:38.394 INFO:teuthology.orchestra.run.smithi002.stdout: rados osd op timeout = 900 2023-11-25T04:07:38.394 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2023-11-25T04:07:38.394 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2023-11-25T04:07:38.394 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-25T04:07:38.394 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.395 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2023-11-25T04:07:38.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2023-11-25T04:07:38.397 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.2,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 490edb11-4d53-4272-8bbb-d46dd29c1240 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.398 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug trim objects = true 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: bdev async discard = True 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: bdev enable discard = True 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore allocator = bitmap 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2023-11-25T04:07:38.400 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 1/20 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 1/20 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 4/10 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.401 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2023-11-25T04:07:38.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2023-11-25T04:07:38.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2023-11-25T04:07:38.404 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = "" 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2023-11-25T04:07:38.405 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds balancer = 20 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = True 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = True 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2023-11-25T04:07:38.406 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2023-11-25T04:07:38.408 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-25T04:07:38.409 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-25T04:07:38.468 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-25T04:07:38.468 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:38.468 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-25T04:07:38.483 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:38.484 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-25T04:07:38.538 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T04:07:38.539 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:38.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-25T04:07:38.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-25T04:07:38.625 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:07:38.625 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:38.681 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T04:07:38.681 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:07:38.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-25T04:07:38.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-25T04:07:38.733 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:07:38.733 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:38.790 INFO:tasks.ceph:Setting up mon nodes... 2023-11-25T04:07:38.790 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-25T04:07:38.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-25T04:07:38.854 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-25T04:07:38.859 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-25T04:07:38.935 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-25T04:07:38.938 INFO:tasks.ceph:Setting up mds nodes... 2023-11-25T04:07:38.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-25T04:07:39.000 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-25T04:07:39.003 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-25T04:07:39.033 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-25T04:07:39.135 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-25T04:07:39.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-25T04:07:39.168 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-25T04:07:39.233 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-25T04:07:39.236 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-25T04:07:39.267 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-25T04:07:39.370 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-25T04:07:39.372 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-25T04:07:39.404 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-25T04:07:39.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-25T04:07:39.453 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-25T04:07:39.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-25T04:07:39.518 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-25T04:07:39.536 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-25T04:07:39.582 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-25T04:07:39.601 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-25T04:07:39.647 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-25T04:07:39.665 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-25T04:07:39.665 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-25T04:07:39.666 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-25T04:07:39.696 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:39.696 INFO:tasks.ceph:role: osd.0 2023-11-25T04:07:39.696 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T04:07:39.697 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-25T04:07:39.767 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-25T04:07:39.798 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-25T04:07:39.800 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-25T04:07:39.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-25T04:07:39.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-25T04:07:39.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-25T04:07:40.025 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:40.026 INFO:tasks.ceph:role: osd.1 2023-11-25T04:07:40.026 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T04:07:40.026 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-25T04:07:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-25T04:07:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-25T04:07:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-25T04:07:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-25T04:07:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-25T04:07:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-25T04:07:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-25T04:07:40.096 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-25T04:07:40.096 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-25T04:07:40.097 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-25T04:07:40.128 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-25T04:07:40.131 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-25T04:07:40.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-25T04:07:40.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-25T04:07:40.282 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-25T04:07:40.354 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:40.354 INFO:tasks.ceph:role: osd.2 2023-11-25T04:07:40.354 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T04:07:40.354 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-25T04:07:40.425 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-25T04:07:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-25T04:07:40.459 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-25T04:07:40.460 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-25T04:07:40.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-25T04:07:40.610 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-25T04:07:40.681 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:40.681 INFO:tasks.ceph:role: osd.3 2023-11-25T04:07:40.681 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T04:07:40.681 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-25T04:07:40.751 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-25T04:07:40.751 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-25T04:07:40.751 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-25T04:07:40.751 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-25T04:07:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-25T04:07:40.752 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2023-11-25T04:07:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-25T04:07:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-25T04:07:40.752 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-25T04:07:40.752 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-25T04:07:40.783 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2023-11-25T04:07:40.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2023-11-25T04:07:40.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-25T04:07:40.860 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-25T04:07:40.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:41.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:41.034+0000 7f885019b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-25T04:07:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:41.034+0000 7f885019b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-25T04:07:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:41.034+0000 7f885019b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-25T04:07:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:41.034+0000 7f885019b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-25T04:07:41.036 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:41.034+0000 7f885019b500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-25T04:07:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:41.034+0000 7f885019b500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-25T04:07:43.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-25T04:07:43.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:44.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:44.015+0000 7f9ca72fa500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-25T04:07:44.017 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:44.015+0000 7f9ca72fa500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-25T04:07:44.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:44.015+0000 7f9ca72fa500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-25T04:07:44.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:44.015+0000 7f9ca72fa500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-25T04:07:44.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:44.015+0000 7f9ca72fa500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-25T04:07:44.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:44.015+0000 7f9ca72fa500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-25T04:07:46.865 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-25T04:07:46.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:46.997+0000 7f6068348500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-25T04:07:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:46.997+0000 7f6068348500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-25T04:07:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:46.997+0000 7f6068348500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-25T04:07:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:46.997+0000 7f6068348500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-25T04:07:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:46.997+0000 7f6068348500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-25T04:07:47.000 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:46.998+0000 7f6068348500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-25T04:07:49.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-25T04:07:49.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:49.974+0000 7fb528212500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-25T04:07:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:49.974+0000 7fb528212500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-25T04:07:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:49.974+0000 7fb528212500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-25T04:07:49.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:49.974+0000 7fb528212500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-25T04:07:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:49.974+0000 7fb528212500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-25T04:07:49.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:07:49.974+0000 7fb528212500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-25T04:07:52.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-25T04:07:52.872 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-25T04:07:52.908 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:52.909 INFO:tasks.ceph:role: osd.4 2023-11-25T04:07:52.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T04:07:52.909 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-25T04:07:52.991 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-25T04:07:53.500 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2023-11-25T04:07:53.500 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-11-25T04:07:53.500 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-25T04:07:53.636 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-25T04:07:53.677 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-25T04:07:53.750 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:53.750 INFO:tasks.ceph:role: osd.5 2023-11-25T04:07:53.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T04:07:53.750 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-25T04:07:53.829 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-25T04:07:53.829 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-25T04:07:53.829 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-25T04:07:53.830 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-25T04:07:53.830 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-25T04:07:53.830 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-11-25T04:07:53.830 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-25T04:07:53.830 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-25T04:07:53.830 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-25T04:07:53.830 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-25T04:07:54.271 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2023-11-25T04:07:54.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-11-25T04:07:54.274 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-25T04:07:54.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-25T04:07:54.411 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-25T04:07:54.482 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:54.483 INFO:tasks.ceph:role: osd.6 2023-11-25T04:07:54.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T04:07:54.483 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-25T04:07:54.561 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-25T04:07:54.562 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-25T04:07:54.562 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-25T04:07:54.562 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-25T04:07:54.562 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-25T04:07:54.562 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-11-25T04:07:54.562 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-25T04:07:54.562 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-25T04:07:54.562 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-25T04:07:54.562 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-25T04:07:55.060 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2023-11-25T04:07:55.063 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-11-25T04:07:55.063 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-25T04:07:55.221 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-25T04:07:55.258 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-25T04:07:55.331 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-25T04:07:55.331 INFO:tasks.ceph:role: osd.7 2023-11-25T04:07:55.331 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T04:07:55.332 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-25T04:07:55.411 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-25T04:07:55.412 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-25T04:07:55.412 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-25T04:07:55.412 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-11-25T04:07:55.412 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-25T04:07:55.412 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-11-25T04:07:55.412 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-25T04:07:55.412 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-11-25T04:07:55.412 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-25T04:07:55.412 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-25T04:07:55.920 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2023-11-25T04:07:55.922 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-11-25T04:07:55.922 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-25T04:07:56.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-25T04:07:56.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:56.169 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:56.166+0000 7ff35f605500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-25T04:07:56.169 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:56.166+0000 7ff35f605500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-25T04:07:56.169 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:56.166+0000 7ff35f605500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-25T04:07:56.169 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:56.166+0000 7ff35f605500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-25T04:07:56.169 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:56.166+0000 7ff35f605500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-25T04:07:56.169 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:56.167+0000 7ff35f605500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-25T04:07:59.024 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-25T04:07:59.060 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:07:59.157 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:59.155+0000 7fd933a0e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-25T04:07:59.158 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:59.155+0000 7fd933a0e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-25T04:07:59.158 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:59.155+0000 7fd933a0e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-25T04:07:59.158 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:59.155+0000 7fd933a0e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-25T04:07:59.158 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:59.155+0000 7fd933a0e500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-25T04:07:59.158 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:07:59.156+0000 7fd933a0e500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-25T04:08:02.019 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-25T04:08:02.055 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:08:02.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:02.149+0000 7ff13949c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-25T04:08:02.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:02.149+0000 7ff13949c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-25T04:08:02.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:02.149+0000 7ff13949c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-25T04:08:02.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:02.149+0000 7ff13949c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-25T04:08:02.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:02.149+0000 7ff13949c500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-25T04:08:02.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:02.150+0000 7ff13949c500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-25T04:08:05.007 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-25T04:08:05.049 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:08:05.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:05.141+0000 7feeb439b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-25T04:08:05.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:05.141+0000 7feeb439b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-25T04:08:05.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:05.141+0000 7feeb439b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-25T04:08:05.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:05.141+0000 7feeb439b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-25T04:08:05.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:05.141+0000 7feeb439b500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-25T04:08:05.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:05.142+0000 7feeb439b500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-25T04:08:06.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:08:06.317 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:08:08.004 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-25T04:08:08.041 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-25T04:08:08.042 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:08.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-25T04:08:08.079 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:08.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-25T04:08:08.153 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:08.153 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-25T04:08:08.232 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:08.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-25T04:08:08.305 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:08.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-25T04:08:08.378 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:08.379 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-25T04:08:08.450 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:08.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-25T04:08:08.522 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:08.522 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-25T04:08:08.558 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:08.558 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-25T04:08:08.633 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:08.633 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-25T04:08:08.704 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:08.705 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-25T04:08:08.777 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:08.778 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-25T04:08:08.850 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:08.850 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-25T04:08:08.921 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:08.921 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-25T04:08:08.991 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:08.992 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-25T04:08:09.008 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:09.008 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-25T04:08:09.065 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:09.065 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-25T04:08:09.081 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:09.081 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-25T04:08:09.136 INFO:tasks.ceph:Adding keys to all mons... 2023-11-25T04:08:09.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-25T04:08:09.138 DEBUG:teuthology.orchestra.run.smithi066:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-25T04:08:09.179 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.y] 2023-11-25T04:08:09.179 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAKc2Fl6XTlMhAAjZ7UbcmM3JleJcMDf+bYvQ== 2023-11-25T04:08:09.179 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.a] 2023-11-25T04:08:09.179 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALc2Flo4gFABAAq6znUGgcN4BGfkmIUMYAaQ== 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.c] 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALc2FlnZcNCBAAJ5vebG16ng3h7UyzNaED7g== 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQANc2Fl4RsNAhAAuESHc7m52EPiMJyR0y7B7g== 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAQc2FlFzP+ABAA4WAc5NSSFzAh9fOdlZ/k8Q== 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQASc2FlggiGOxAATqBwHWUQbLehkeHtSZSnog== 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2023-11-25T04:08:09.180 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAVc2Fls9wkOhAAjiVd24vsbKIbQJ5thsqYGA== 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAKc2Fl1Fm8NxAAGC2prWE3MBy1mfCAo6e9IA== 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.b] 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALc2Flco3oDRAA5QJWKMCa51W6HptwDpoadw== 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:[mds.d] 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALc2Fll6EJFhAALB9wQZ7XAnZgRHtEuf7LxA== 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.4] 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAcc2FlfYsDChAAizaC1FsO1fw3tY2tpEUZOQ== 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.5] 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAfc2FlBoVYCRAAHdeE38eG4oEsYYevW8tKaA== 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.6] 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAic2FlReb+CBAAI1lAmpz9xIVRukJl5UbBOQ== 2023-11-25T04:08:09.181 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.7] 2023-11-25T04:08:09.182 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAlc2FlliuHCBAAZAiY1Ic+2V55TYPU7vIVvA== 2023-11-25T04:08:09.182 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-25T04:08:09.182 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALc2FlqNP5GhAAv0HvFTFKxDiE/tkoFN1FKA== 2023-11-25T04:08:09.182 INFO:teuthology.orchestra.run.smithi002.stdout:[client.2] 2023-11-25T04:08:09.182 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALc2Fl1I3WHhAAq2KxvUCG7qKZne5v4xuQMQ== 2023-11-25T04:08:09.182 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2023-11-25T04:08:09.182 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALc2FlRd61IhAAMEg1v1C3vWe4G5ukk6qqEA== 2023-11-25T04:08:09.182 INFO:teuthology.orchestra.run.smithi002.stdout:[client.3] 2023-11-25T04:08:09.182 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALc2FlWZCLJhAA5wtUUIzLPvqkJPUlqWq/rg== 2023-11-25T04:08:09.205 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.y] 2023-11-25T04:08:09.205 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAKc2Fl6XTlMhAAjZ7UbcmM3JleJcMDf+bYvQ== 2023-11-25T04:08:09.205 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2023-11-25T04:08:09.205 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQALc2Flo4gFABAAq6znUGgcN4BGfkmIUMYAaQ== 2023-11-25T04:08:09.205 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2023-11-25T04:08:09.205 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQALc2FlnZcNCBAAJ5vebG16ng3h7UyzNaED7g== 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.0] 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQANc2Fl4RsNAhAAuESHc7m52EPiMJyR0y7B7g== 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.1] 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAQc2FlFzP+ABAA4WAc5NSSFzAh9fOdlZ/k8Q== 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.2] 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQASc2FlggiGOxAATqBwHWUQbLehkeHtSZSnog== 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.3] 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAVc2Fls9wkOhAAjiVd24vsbKIbQJ5thsqYGA== 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.x] 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAKc2Fl1Fm8NxAAGC2prWE3MBy1mfCAo6e9IA== 2023-11-25T04:08:09.206 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQALc2Flco3oDRAA5QJWKMCa51W6HptwDpoadw== 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQALc2Fll6EJFhAALB9wQZ7XAnZgRHtEuf7LxA== 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.4] 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAcc2FlfYsDChAAizaC1FsO1fw3tY2tpEUZOQ== 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.5] 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAfc2FlBoVYCRAAHdeE38eG4oEsYYevW8tKaA== 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.6] 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAic2FlReb+CBAAI1lAmpz9xIVRukJl5UbBOQ== 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.7] 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAlc2FlliuHCBAAZAiY1Ic+2V55TYPU7vIVvA== 2023-11-25T04:08:09.207 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2023-11-25T04:08:09.208 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQALc2FlqNP5GhAAv0HvFTFKxDiE/tkoFN1FKA== 2023-11-25T04:08:09.208 INFO:teuthology.orchestra.run.smithi066.stdout:[client.2] 2023-11-25T04:08:09.208 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQALc2Fl1I3WHhAAq2KxvUCG7qKZne5v4xuQMQ== 2023-11-25T04:08:09.208 INFO:teuthology.orchestra.run.smithi066.stdout:[client.1] 2023-11-25T04:08:09.208 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQALc2FlRd61IhAAMEg1v1C3vWe4G5ukk6qqEA== 2023-11-25T04:08:09.208 INFO:teuthology.orchestra.run.smithi066.stdout:[client.3] 2023-11-25T04:08:09.208 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQALc2FlWZCLJhAA5wtUUIzLPvqkJPUlqWq/rg== 2023-11-25T04:08:09.209 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-25T04:08:09.226 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-25T04:08:09.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-25T04:08:09.308 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-25T04:08:09.366 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-25T04:08:09.368 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-25T04:08:09.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.429 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.487 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.546 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.604 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-25T04:08:09.664 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-25T04:08:09.720 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-25T04:08:09.722 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-25T04:08:09.781 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-25T04:08:09.783 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-25T04:08:09.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.844 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.900 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.902 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.958 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:09.961 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:10.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:10.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-25T04:08:10.076 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-25T04:08:10.078 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-25T04:08:10.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-25T04:08:10.140 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-25T04:08:10.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-25T04:08:10.203 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-25T04:08:10.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-25T04:08:10.264 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-25T04:08:10.323 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-25T04:08:10.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-25T04:08:10.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-25T04:08:10.455 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-25T04:08:10.486 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-25T04:08:10.517 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-25T04:08:10.618 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-25T04:08:10.650 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-25T04:08:10.720 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-25T04:08:10.822 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-25T04:08:10.853 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:08:10.856 DEBUG:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-25T04:08:10.908 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-25T04:08:10.908 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-25T04:08:10.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-25T04:08:10.912 INFO:tasks.ceph.mon.a:Started 2023-11-25T04:08:10.912 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-25T04:08:10.912 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-25T04:08:10.950 INFO:tasks.ceph.mon.b:Started 2023-11-25T04:08:10.950 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-25T04:08:10.950 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-25T04:08:10.952 INFO:tasks.ceph.mon.c:Started 2023-11-25T04:08:10.952 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-25T04:08:10.953 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-25T04:08:10.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-25T04:08:10.955 INFO:tasks.ceph.mgr.y:Started 2023-11-25T04:08:10.955 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-25T04:08:10.955 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-25T04:08:10.957 INFO:tasks.ceph.mgr.x:Started 2023-11-25T04:08:10.957 INFO:tasks.ceph:Setting crush tunables to default 2023-11-25T04:08:10.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2023-11-25T04:08:11.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.062+0000 7f50e2f7c640 1 Processor -- start 2023-11-25T04:08:11.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.062+0000 7f50e2f7c640 1 -- start start 2023-11-25T04:08:11.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e2f7c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f50dc15d8d0 0x7f50dc099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e2f7c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50dc0cf640 0x7f50dc0b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e2f7c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50dc0cfca0 con 0x7f50dc099eb0 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e2f7c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc09a340 con 0x7f50dc0cf640 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e2f7c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50dc0cfa90 con 0x7f50dc15d8d0 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e1519640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50dc0cf640 0x7f50dc0b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e1519640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50dc0cf640 0x7f50dc0b1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44392/0 (socket says 172.21.15.2:44392) 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e1519640 1 -- 172.21.15.2:0/3737449123 learned_addr learned my addr 172.21.15.2:0/3737449123 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e1519640 1 -- 172.21.15.2:0/3737449123 >> v2:172.21.15.2:3300/0 conn(0x7f50dc0cf640 msgr2=0x7f50dc0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e1519640 1 -- 172.21.15.2:0/3737449123 >> v2:172.21.15.2:3300/0 conn(0x7f50dc0cf640 msgr2=0x7f50dc0b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e1519640 1 --2- 172.21.15.2:0/3737449123 >> v2:172.21.15.2:3300/0 conn(0x7f50dc0cf640 0x7f50dc0b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e0d18640 1 --2- 172.21.15.2:0/3737449123 >> v2:172.21.15.66:3300/0 conn(0x7f50dc15d8d0 0x7f50dc099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e1519640 1 --2- 172.21.15.2:0/3737449123 >> v2:172.21.15.2:3300/0 conn(0x7f50dc0cf640 0x7f50dc0b1200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-25T04:08:11.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e0d18640 1 -- 172.21.15.2:0/3737449123 >> v2:172.21.15.66:3300/0 conn(0x7f50dc15d8d0 msgr2=0x7f50dc099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-25T04:08:11.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e0d18640 1 -- 172.21.15.2:0/3737449123 >> v2:172.21.15.66:3300/0 conn(0x7f50dc15d8d0 msgr2=0x7f50dc099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-25T04:08:11.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e0d18640 1 --2- 172.21.15.2:0/3737449123 >> v2:172.21.15.66:3300/0 conn(0x7f50dc15d8d0 0x7f50dc099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-25T04:08:11.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.063+0000 7f50e0d18640 1 --2- 172.21.15.2:0/3737449123 >> v2:172.21.15.66:3300/0 conn(0x7f50dc15d8d0 0x7f50dc099970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-25T04:08:11.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.242+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500198312 0 0) 0x7f50dc0cfca0 con 0x7f50dc099eb0 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.242+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50cc003520 con 0x7f50dc099eb0 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 <== mon.1 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3677809079 0 0) 0x7f50cc003520 con 0x7f50dc099eb0 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 >> v2:172.21.15.66:3300/0 conn(0x7f50dc15d8d0 msgr2=0x7f50dc099970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 --2- 172.21.15.2:0/3737449123 >> v2:172.21.15.66:3300/0 conn(0x7f50dc15d8d0 0x7f50dc099970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 >> v2:172.21.15.2:3300/0 conn(0x7f50dc0cf640 msgr2=0x7f50dc0b1200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 --2- 172.21.15.2:0/3737449123 >> v2:172.21.15.2:3300/0 conn(0x7f50dc0cf640 0x7f50dc0b1200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0b0720 con 0x7f50dc099eb0 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 <== mon.1 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f50c8001670 con 0x7f50dc099eb0 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 >> v1:172.21.15.66:6789/0 conn(0x7f50dc099eb0 legacy=0x7f50dc0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:11.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc003970 0x7f50cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50cc0047c0 0x7f50cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc09a340 con 0x7f50cc005180 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0cfa90 con 0x7f50cc003970 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00c080 con 0x7f50cc0047c0 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50e1519640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50e0d18640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc003970 0x7f50cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50dbfff640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50cc0047c0 0x7f50cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50e1519640 1 -- 172.21.15.2:0/3737449123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50cc0047c0 msgr2=0x7f50cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50e1519640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50cc0047c0 0x7f50cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50e1519640 1 -- 172.21.15.2:0/3737449123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc003970 msgr2=0x7f50cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:11.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50e1519640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50cc003970 0x7f50cc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50e1519640 1 -- 172.21.15.2:0/3737449123 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc003520 con 0x7f50cc005180 2023-11-25T04:08:11.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.243+0000 7f50dbfff640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50cc0047c0 0x7f50cc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:11.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.244+0000 7f50e1519640 1 -- 172.21.15.2:0/3737449123 reap_dead start 2023-11-25T04:08:11.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.244+0000 7f50e1519640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50cc00b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009cc0 tx=0x7f50cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81582fa683e249d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:11.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.245+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d402cb10 con 0x7f50cc005180 2023-11-25T04:08:11.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.245+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d4030070 con 0x7f50cc005180 2023-11-25T04:08:11.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.245+0000 7f50db7fe640 1 -- 172.21.15.2:0/3737449123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d4036410 con 0x7f50cc005180 2023-11-25T04:08:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.245+0000 7f50e2f7c640 1 -- 172.21.15.2:0/3737449123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 msgr2=0x7f50cc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.245+0000 7f50e2f7c640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50cc00b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50d4009cc0 tx=0x7f50cc0057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.245+0000 7f50e2f7c640 1 -- 172.21.15.2:0/3737449123 shutdown_connections 2023-11-25T04:08:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.245+0000 7f50e2f7c640 1 --2- 172.21.15.2:0/3737449123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50cc00b980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.245+0000 7f50e2f7c640 1 -- 172.21.15.2:0/3737449123 >> 172.21.15.2:0/3737449123 conn(0x7f50dc0b2ab0 msgr2=0x7f50dc0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.246+0000 7f50e2f7c640 1 -- 172.21.15.2:0/3737449123 shutdown_connections 2023-11-25T04:08:11.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.246+0000 7f50e2f7c640 1 -- 172.21.15.2:0/3737449123 wait complete. 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.247+0000 7f50e2f7c640 1 Processor -- start 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.247+0000 7f50e2f7c640 1 -- start start 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e2f7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50dc06fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e2f7c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50dc0c69f0 0x7f50dc14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e2f7c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50dc0b5c70 0x7f50dc0b60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e2f7c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc14e020 con 0x7f50cc005180 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e2f7c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc15dcb0 con 0x7f50dc0b5c70 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e2f7c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc0b6610 con 0x7f50dc0c69f0 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e0d18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50dc06fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e0d18640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50dc06fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44422/0 (socket says 172.21.15.2:44422) 2023-11-25T04:08:11.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e0d18640 1 -- 172.21.15.2:0/1513322085 learned_addr learned my addr 172.21.15.2:0/1513322085 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50dbfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50dc0c69f0 0x7f50dc14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.248+0000 7f50e1519640 1 --2- 172.21.15.2:0/1513322085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50dc0b5c70 0x7f50dc0b60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.249+0000 7f50e0d18640 1 -- 172.21.15.2:0/1513322085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50dc0c69f0 msgr2=0x7f50dc14c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.249+0000 7f50e0d18640 1 --2- 172.21.15.2:0/1513322085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50dc0c69f0 0x7f50dc14c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.249+0000 7f50e0d18640 1 -- 172.21.15.2:0/1513322085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50dc0b5c70 msgr2=0x7f50dc0b60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.249+0000 7f50e0d18640 1 --2- 172.21.15.2:0/1513322085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50dc0b5c70 0x7f50dc0b60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.249+0000 7f50e0d18640 1 -- 172.21.15.2:0/1513322085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc0c7240 con 0x7f50cc005180 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.249+0000 7f50dbfff640 1 --2- 172.21.15.2:0/1513322085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50dc0c69f0 0x7f50dc14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.249+0000 7f50e0d18640 1 --2- 172.21.15.2:0/1513322085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50dc06fd90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50d00108f0 tx=0x7f50d0010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.250+0000 7f50d97fa640 1 -- 172.21.15.2:0/1513322085 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000e9c0 con 0x7f50cc005180 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.250+0000 7f50d97fa640 1 -- 172.21.15.2:0/1513322085 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d000eb20 con 0x7f50cc005180 2023-11-25T04:08:11.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.250+0000 7f50e2f7c640 1 -- 172.21.15.2:0/1513322085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc0c7520 con 0x7f50cc005180 2023-11-25T04:08:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.250+0000 7f50d97fa640 1 -- 172.21.15.2:0/1513322085 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d000eed0 con 0x7f50cc005180 2023-11-25T04:08:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.250+0000 7f50e2f7c640 1 -- 172.21.15.2:0/1513322085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc14c820 con 0x7f50cc005180 2023-11-25T04:08:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.250+0000 7f50d97fa640 1 -- 172.21.15.2:0/1513322085 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f50d0016780 con 0x7f50cc005180 2023-11-25T04:08:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.250+0000 7f50d97fa640 1 -- 172.21.15.2:0/1513322085 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f50d0014880 con 0x7f50cc005180 2023-11-25T04:08:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.251+0000 7f50e2f7c640 1 -- 172.21.15.2:0/1513322085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc14e290 con 0x7f50cc005180 2023-11-25T04:08:11.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.254+0000 7f50d97fa640 1 -- 172.21.15.2:0/1513322085 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f50d003ece0 con 0x7f50cc005180 2023-11-25T04:08:11.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.321+0000 7f50e2f7c640 1 -- 172.21.15.2:0/1513322085 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f50dc09f0b0 con 0x7f50cc005180 2023-11-25T04:08:11.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.322+0000 7f50d97fa640 1 -- 172.21.15.2:0/1513322085 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f50d002d070 con 0x7f50cc005180 2023-11-25T04:08:11.324 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2023-11-25T04:08:11.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.323+0000 7f50e2f7c640 1 -- 172.21.15.2:0/1513322085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 msgr2=0x7f50dc06fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:11.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.323+0000 7f50e2f7c640 1 --2- 172.21.15.2:0/1513322085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50dc06fd90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50d00108f0 tx=0x7f50d0010db0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.323+0000 7f50e2f7c640 1 -- 172.21.15.2:0/1513322085 shutdown_connections 2023-11-25T04:08:11.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.323+0000 7f50e2f7c640 1 --2- 172.21.15.2:0/1513322085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50dc0b5c70 0x7f50dc0b60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.323+0000 7f50e2f7c640 1 --2- 172.21.15.2:0/1513322085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50dc0c69f0 0x7f50dc14c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.323+0000 7f50e2f7c640 1 --2- 172.21.15.2:0/1513322085 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50cc005180 0x7f50dc06fd90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.323+0000 7f50e2f7c640 1 -- 172.21.15.2:0/1513322085 >> 172.21.15.2:0/1513322085 conn(0x7f50dc0b2ab0 msgr2=0x7f50dc0662b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:11.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.323+0000 7f50e2f7c640 1 -- 172.21.15.2:0/1513322085 shutdown_connections 2023-11-25T04:08:11.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:11.323+0000 7f50e2f7c640 1 -- 172.21.15.2:0/1513322085 wait complete. 2023-11-25T04:08:11.336 INFO:tasks.ceph:check_enable_crimson: False 2023-11-25T04:08:11.336 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-25T04:08:11.336 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:11.336 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-25T04:08:11.367 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:11.367 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-25T04:08:11.438 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:11.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-25T04:08:11.509 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:08:11.509 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-25T04:08:11.580 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:11.580 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-25T04:08:11.611 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:11.611 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-25T04:08:11.683 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:11.683 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-25T04:08:11.703 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:11.701+0000 7f5b27412040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-25T04:08:11.707 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:11.704+0000 7f6353e12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-25T04:08:11.738 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:08:11.739 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-25T04:08:11.757 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:11.755+0000 7f5b27412040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-25T04:08:11.763 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:11.761+0000 7f6353e12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-25T04:08:11.793 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 44938ca7-aceb-48bf-b5cd-a09207612789 0 2023-11-25T04:08:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.938+0000 7efed701e640 1 Processor -- start 2023-11-25T04:08:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.938+0000 7efed701e640 1 -- start start 2023-11-25T04:08:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efed701e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed00cfff0 0x7efed00d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efed701e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efed006ef50 0x7efed00cefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efed701e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed006ff00 con 0x7efed0099970 2023-11-25T04:08:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efed701e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed00701e0 con 0x7efed006ef50 2023-11-25T04:08:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efed701e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed006b780 con 0x7efed00cfff0 2023-11-25T04:08:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efecffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efed006ef50 0x7efed00cefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.942 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efed4dba640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed00cfff0 0x7efed00d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efecffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efed006ef50 0x7efed00cefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38054/0 (socket says 172.21.15.66:38054) 2023-11-25T04:08:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efecffff640 1 -- 172.21.15.66:0/4142194263 learned_addr learned my addr 172.21.15.66:0/4142194263 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efed4dba640 1 --2- 172.21.15.66:0/4142194263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed00cfff0 0x7efed00d1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58216/0 (socket says 172.21.15.66:58216) 2023-11-25T04:08:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efecffff640 1 -- 172.21.15.66:0/4142194263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed00cfff0 msgr2=0x7efed00d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efecffff640 1 --2- 172.21.15.66:0/4142194263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed00cfff0 0x7efed00d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efecffff640 1 -- 172.21.15.66:0/4142194263 >> v1:172.21.15.2:6789/0 conn(0x7efed0099970 legacy=0x7efed006bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efecffff640 1 -- 172.21.15.66:0/4142194263 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed006f3d0 con 0x7efed006ef50 2023-11-25T04:08:11.943 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.939+0000 7efed4dba640 1 --2- 172.21.15.66:0/4142194263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed00cfff0 0x7efed00d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:11.944 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.940+0000 7efecffff640 1 --2- 172.21.15.66:0/4142194263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efed006ef50 0x7efed00cefd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efebc009870 tx=0x7efebc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec6f624fd7851fc9 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.940+0000 7efecf7fe640 1 -- 172.21.15.66:0/4142194263 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc031640 con 0x7efed006ef50 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.940+0000 7efecf7fe640 1 -- 172.21.15.66:0/4142194263 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc0317a0 con 0x7efed006ef50 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.940+0000 7efecf7fe640 1 -- 172.21.15.66:0/4142194263 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc031b30 con 0x7efed006ef50 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.941+0000 7efed701e640 1 -- 172.21.15.66:0/4142194263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efed006ef50 msgr2=0x7efed00cefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.941+0000 7efed701e640 1 --2- 172.21.15.66:0/4142194263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efed006ef50 0x7efed00cefd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efebc009870 tx=0x7efebc02b8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.941+0000 7efed701e640 1 -- 172.21.15.66:0/4142194263 shutdown_connections 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.941+0000 7efed701e640 1 --2- 172.21.15.66:0/4142194263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efed006ef50 0x7efed00cefd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.941+0000 7efed701e640 1 --2- 172.21.15.66:0/4142194263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed00cfff0 0x7efed00d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.941+0000 7efed701e640 1 -- 172.21.15.66:0/4142194263 >> 172.21.15.66:0/4142194263 conn(0x7efed00d0f40 msgr2=0x7efed00d1350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.941+0000 7efed701e640 1 -- 172.21.15.66:0/4142194263 shutdown_connections 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.941+0000 7efed701e640 1 -- 172.21.15.66:0/4142194263 wait complete. 2023-11-25T04:08:11.945 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.942+0000 7efed701e640 1 Processor -- start 2023-11-25T04:08:11.946 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.942+0000 7efed701e640 1 -- start start 2023-11-25T04:08:11.947 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efed701e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efed006ef50 0x7efed0154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.947 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efed701e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed0099970 0x7efed00ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.948 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efed701e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efed00cfff0 0x7efed00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:11.948 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efed701e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed00c5920 con 0x7efed006ef50 2023-11-25T04:08:11.948 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efed701e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed00c4a30 con 0x7efed00cfff0 2023-11-25T04:08:11.948 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efed701e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed00c4d10 con 0x7efed0099970 2023-11-25T04:08:11.948 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efecffff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed0099970 0x7efed00ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efecffff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed0099970 0x7efed00ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58222/0 (socket says 172.21.15.66:58222) 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efed55bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efed00cfff0 0x7efed00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efecffff640 1 -- 172.21.15.66:0/1334165750 learned_addr learned my addr 172.21.15.66:0/1334165750 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efed4dba640 1 --2- 172.21.15.66:0/1334165750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efed006ef50 0x7efed0154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efecffff640 1 -- 172.21.15.66:0/1334165750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efed00cfff0 msgr2=0x7efed00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efecffff640 1 --2- 172.21.15.66:0/1334165750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efed00cfff0 0x7efed00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efecffff640 1 -- 172.21.15.66:0/1334165750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efed006ef50 msgr2=0x7efed0154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efecffff640 1 --2- 172.21.15.66:0/1334165750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efed006ef50 0x7efed0154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.943+0000 7efecffff640 1 -- 172.21.15.66:0/1334165750 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4009400 con 0x7efed0099970 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.944+0000 7efecffff640 1 --2- 172.21.15.66:0/1334165750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed0099970 0x7efed00ca7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efebc009870 tx=0x7efebc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:11.949 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.944+0000 7efecd7fa640 1 -- 172.21.15.66:0/1334165750 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc03a930 con 0x7efed0099970 2023-11-25T04:08:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.944+0000 7efecd7fa640 1 -- 172.21.15.66:0/1334165750 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc03aa90 con 0x7efed0099970 2023-11-25T04:08:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.944+0000 7efed701e640 1 -- 172.21.15.66:0/1334165750 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc0094d0 con 0x7efed0099970 2023-11-25T04:08:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.944+0000 7efecd7fa640 1 -- 172.21.15.66:0/1334165750 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc03ae40 con 0x7efed0099970 2023-11-25T04:08:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.944+0000 7efed701e640 1 -- 172.21.15.66:0/1334165750 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed00c52d0 con 0x7efed0099970 2023-11-25T04:08:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.944+0000 7efecd7fa640 1 -- 172.21.15.66:0/1334165750 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efebc02f050 con 0x7efed0099970 2023-11-25T04:08:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.944+0000 7efecd7fa640 1 -- 172.21.15.66:0/1334165750 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7efebc044580 con 0x7efed0099970 2023-11-25T04:08:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.945+0000 7efed701e640 1 -- 172.21.15.66:0/1334165750 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed00c5a90 con 0x7efed0099970 2023-11-25T04:08:11.950 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:11.947+0000 7efecd7fa640 1 -- 172.21.15.66:0/1334165750 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7efebc035020 con 0x7efed0099970 2023-11-25T04:08:12.022 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.020+0000 7efed701e640 1 -- 172.21.15.66:0/1334165750 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "44938ca7-aceb-48bf-b5cd-a09207612789", "id": 0} v 0) v1 -- 0x7efed009f0b0 con 0x7efed0099970 2023-11-25T04:08:12.025 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.023+0000 7efecd7fa640 1 -- 172.21.15.66:0/1334165750 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "44938ca7-aceb-48bf-b5cd-a09207612789", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7efebc02d040 con 0x7efed0099970 2023-11-25T04:08:12.026 INFO:teuthology.orchestra.run.smithi066.stdout:0 2023-11-25T04:08:12.027 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.024+0000 7efed701e640 1 -- 172.21.15.66:0/1334165750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed0099970 msgr2=0x7efed00ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.027 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.024+0000 7efed701e640 1 --2- 172.21.15.66:0/1334165750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed0099970 0x7efed00ca7d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efebc009870 tx=0x7efebc0046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.027 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.024+0000 7efed701e640 1 -- 172.21.15.66:0/1334165750 shutdown_connections 2023-11-25T04:08:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.024+0000 7efed701e640 1 --2- 172.21.15.66:0/1334165750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efed00cfff0 0x7efed00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.024+0000 7efed701e640 1 --2- 172.21.15.66:0/1334165750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efed0099970 0x7efed00ca7d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.024+0000 7efed701e640 1 --2- 172.21.15.66:0/1334165750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efed006ef50 0x7efed0154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.024+0000 7efed701e640 1 -- 172.21.15.66:0/1334165750 >> 172.21.15.66:0/1334165750 conn(0x7efed00d0f40 msgr2=0x7efed00b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.024+0000 7efed701e640 1 -- 172.21.15.66:0/1334165750 shutdown_connections 2023-11-25T04:08:12.028 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.024+0000 7efed701e640 1 -- 172.21.15.66:0/1334165750 wait complete. 2023-11-25T04:08:12.037 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 8ccfc905-ca85-49a2-b8de-55b046520b69 1 2023-11-25T04:08:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.141+0000 7f2f5273c640 1 Processor -- start 2023-11-25T04:08:12.143 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.141+0000 7f2f5273c640 1 -- start start 2023-11-25T04:08:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.141+0000 7f2f5273c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c06a4d0 0x7f2f4c06a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.141+0000 7f2f5273c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2f4c072590 0x7f2f4c0af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.141+0000 7f2f5273c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c161bc0 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.141+0000 7f2f5273c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0af860 con 0x7f2f4c072590 2023-11-25T04:08:12.144 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.141+0000 7f2f5273c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c0b3d30 con 0x7f2f4c06a4d0 2023-11-25T04:08:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.142+0000 7f2f4bfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c06a4d0 0x7f2f4c06a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.142+0000 7f2f4bfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c06a4d0 0x7f2f4c06a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58236/0 (socket says 172.21.15.66:58236) 2023-11-25T04:08:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.142+0000 7f2f4bfff640 1 -- 172.21.15.66:0/197866064 learned_addr learned my addr 172.21.15.66:0/197866064 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.142+0000 7f2f50cd9640 1 --2- 172.21.15.66:0/197866064 >> v2:172.21.15.66:3300/0 conn(0x7f2f4c072590 0x7f2f4c0af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.142+0000 7f2f4bfff640 1 -- 172.21.15.66:0/197866064 >> v2:172.21.15.66:3300/0 conn(0x7f2f4c072590 msgr2=0x7f2f4c0af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.142+0000 7f2f4bfff640 1 --2- 172.21.15.66:0/197866064 >> v2:172.21.15.66:3300/0 conn(0x7f2f4c072590 0x7f2f4c0af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.142+0000 7f2f4bfff640 1 -- 172.21.15.66:0/197866064 >> v1:172.21.15.2:6789/0 conn(0x7f2f4c0aeec0 legacy=0x7f2f4c15d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.145 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.142+0000 7f2f4bfff640 1 -- 172.21.15.66:0/197866064 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c06adf0 con 0x7f2f4c06a4d0 2023-11-25T04:08:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f4bfff640 1 --2- 172.21.15.66:0/197866064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c06a4d0 0x7f2f4c06a8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009870 tx=0x7f2f3c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba518d9b970c8f67 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f4affd640 1 -- 172.21.15.66:0/197866064 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c030840 con 0x7f2f4c06a4d0 2023-11-25T04:08:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f4affd640 1 -- 172.21.15.66:0/197866064 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0309a0 con 0x7f2f4c06a4d0 2023-11-25T04:08:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f4affd640 1 -- 172.21.15.66:0/197866064 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c030d30 con 0x7f2f4c06a4d0 2023-11-25T04:08:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f5273c640 1 -- 172.21.15.66:0/197866064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c06a4d0 msgr2=0x7f2f4c06a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f5273c640 1 --2- 172.21.15.66:0/197866064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c06a4d0 0x7f2f4c06a8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009870 tx=0x7f2f3c02b980 comp rx=0 tx=0).stop 2023-11-25T04:08:12.147 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f5273c640 1 -- 172.21.15.66:0/197866064 shutdown_connections 2023-11-25T04:08:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f5273c640 1 --2- 172.21.15.66:0/197866064 >> v2:172.21.15.66:3300/0 conn(0x7f2f4c072590 0x7f2f4c0af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f5273c640 1 --2- 172.21.15.66:0/197866064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c06a4d0 0x7f2f4c06a8b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.143+0000 7f2f5273c640 1 -- 172.21.15.66:0/197866064 >> 172.21.15.66:0/197866064 conn(0x7f2f4c0b1be0 msgr2=0x7f2f4c0b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.144+0000 7f2f5273c640 1 -- 172.21.15.66:0/197866064 shutdown_connections 2023-11-25T04:08:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.144+0000 7f2f5273c640 1 -- 172.21.15.66:0/197866064 wait complete. 2023-11-25T04:08:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.145+0000 7f2f5273c640 1 Processor -- start 2023-11-25T04:08:12.148 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.145+0000 7f2f5273c640 1 -- start start 2023-11-25T04:08:12.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f5273c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4c06a4d0 0x7f2f4c13e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f5273c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c072590 0x7f2f4c13fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f5273c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f4c0aeec0 0x7f2f4c141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f5273c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c13ed60 con 0x7f2f4c06a4d0 2023-11-25T04:08:12.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f5273c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c1401c0 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f5273c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c140460 con 0x7f2f4c072590 2023-11-25T04:08:12.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f4b7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c072590 0x7f2f4c13fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f50cd9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f4c0aeec0 0x7f2f4c141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.151 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f4b7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c072590 0x7f2f4c13fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58244/0 (socket says 172.21.15.66:58244) 2023-11-25T04:08:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f50cd9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f4c0aeec0 0x7f2f4c141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38078/0 (socket says 172.21.15.66:38078) 2023-11-25T04:08:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f4b7fe640 1 -- 172.21.15.66:0/466678006 learned_addr learned my addr 172.21.15.66:0/466678006 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f4bfff640 1 --2- 172.21.15.66:0/466678006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4c06a4d0 0x7f2f4c13e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f50cd9640 1 -- 172.21.15.66:0/466678006 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c072590 msgr2=0x7f2f4c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f50cd9640 1 --2- 172.21.15.66:0/466678006 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c072590 0x7f2f4c13fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f50cd9640 1 -- 172.21.15.66:0/466678006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4c06a4d0 msgr2=0x7f2f4c13e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.152 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f50cd9640 1 --2- 172.21.15.66:0/466678006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4c06a4d0 0x7f2f4c13e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f50cd9640 1 -- 172.21.15.66:0/466678006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c0094d0 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f4b7fe640 1 --2- 172.21.15.66:0/466678006 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c072590 0x7f2f4c13fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f50cd9640 1 --2- 172.21.15.66:0/466678006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f4c0aeec0 0x7f2f4c141500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0729a0 tx=0x7f2f4400ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f48ff9640 1 -- 172.21.15.66:0/466678006 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f44009c00 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.146+0000 7f2f48ff9640 1 -- 172.21.15.66:0/466678006 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f4400f040 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.147+0000 7f2f5273c640 1 -- 172.21.15.66:0/466678006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c140740 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.147+0000 7f2f48ff9640 1 -- 172.21.15.66:0/466678006 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f440146c0 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.147+0000 7f2f5273c640 1 -- 172.21.15.66:0/466678006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c140d00 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.147+0000 7f2f48ff9640 1 -- 172.21.15.66:0/466678006 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2f44014b20 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.147+0000 7f2f48ff9640 1 -- 172.21.15.66:0/466678006 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f2f44013790 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.153 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.148+0000 7f2f5273c640 1 -- 172.21.15.66:0/466678006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c06e6c0 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.154 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.151+0000 7f2f48ff9640 1 -- 172.21.15.66:0/466678006 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2f4403bce0 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.226+0000 7f2f5273c640 1 -- 172.21.15.66:0/466678006 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8ccfc905-ca85-49a2-b8de-55b046520b69", "id": 1} v 0) v1 -- 0x7f2f4c0aea30 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.231 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.229+0000 7f2f48ff9640 1 -- 172.21.15.66:0/466678006 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8ccfc905-ca85-49a2-b8de-55b046520b69", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2f4402a070 con 0x7f2f4c0aeec0 2023-11-25T04:08:12.231 INFO:teuthology.orchestra.run.smithi066.stdout:1 2023-11-25T04:08:12.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.230+0000 7f2f5273c640 1 -- 172.21.15.66:0/466678006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f4c0aeec0 msgr2=0x7f2f4c141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.230+0000 7f2f5273c640 1 --2- 172.21.15.66:0/466678006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f4c0aeec0 0x7f2f4c141500 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2f4c0729a0 tx=0x7f2f4400ef90 comp rx=0 tx=0).stop 2023-11-25T04:08:12.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.230+0000 7f2f5273c640 1 -- 172.21.15.66:0/466678006 shutdown_connections 2023-11-25T04:08:12.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.230+0000 7f2f5273c640 1 --2- 172.21.15.66:0/466678006 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f4c0aeec0 0x7f2f4c141500 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.230+0000 7f2f5273c640 1 --2- 172.21.15.66:0/466678006 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f4c072590 0x7f2f4c13fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.230+0000 7f2f5273c640 1 --2- 172.21.15.66:0/466678006 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2f4c06a4d0 0x7f2f4c13e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.230+0000 7f2f5273c640 1 -- 172.21.15.66:0/466678006 >> 172.21.15.66:0/466678006 conn(0x7f2f4c0b1be0 msgr2=0x7f2f4c0b1200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.230+0000 7f2f5273c640 1 -- 172.21.15.66:0/466678006 shutdown_connections 2023-11-25T04:08:12.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.230+0000 7f2f5273c640 1 -- 172.21.15.66:0/466678006 wait complete. 2023-11-25T04:08:12.243 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114 2 2023-11-25T04:08:12.333 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.331+0000 7f6353e12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-25T04:08:12.335 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.333+0000 7f5b27412040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-25T04:08:12.349 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.346+0000 7f446d62d640 1 Processor -- start 2023-11-25T04:08:12.349 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.346+0000 7f446d62d640 1 -- start start 2023-11-25T04:08:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.347+0000 7f446d62d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f446815ea80 0x7f44680cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.347+0000 7f446d62d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680cfe90 con 0x7f44680afee0 2023-11-25T04:08:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.347+0000 7f446d62d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446815ee60 con 0x7f44680b07f0 2023-11-25T04:08:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.347+0000 7f446d62d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44680cef60 con 0x7f446815ea80 2023-11-25T04:08:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.347+0000 7f4466ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f446815ea80 0x7f44680cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.347+0000 7f4466ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f446815ea80 0x7f44680cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38086/0 (socket says 172.21.15.66:38086) 2023-11-25T04:08:12.350 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.347+0000 7f4466ffd640 1 -- 172.21.15.66:0/1098768266 learned_addr learned my addr 172.21.15.66:0/1098768266 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.351 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.348+0000 7f4466ffd640 1 -- 172.21.15.66:0/1098768266 >> v1:172.21.15.66:6789/0 conn(0x7f44680b07f0 legacy=0x7f44680b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.351 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.348+0000 7f4466ffd640 1 -- 172.21.15.66:0/1098768266 >> v1:172.21.15.2:6789/0 conn(0x7f44680afee0 legacy=0x7f44680cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.351 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.348+0000 7f4466ffd640 1 -- 172.21.15.66:0/1098768266 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4468099a10 con 0x7f446815ea80 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.348+0000 7f4466ffd640 1 --2- 172.21.15.66:0/1098768266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f446815ea80 0x7f44680cf240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f445c009870 tx=0x7f445c02ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d3ec21bb179e6c0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f4465ffb640 1 -- 172.21.15.66:0/1098768266 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c02f840 con 0x7f446815ea80 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f4465ffb640 1 -- 172.21.15.66:0/1098768266 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c02f9a0 con 0x7f446815ea80 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f4465ffb640 1 -- 172.21.15.66:0/1098768266 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c02fd30 con 0x7f446815ea80 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f446d62d640 1 -- 172.21.15.66:0/1098768266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f446815ea80 msgr2=0x7f44680cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f446d62d640 1 --2- 172.21.15.66:0/1098768266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f446815ea80 0x7f44680cf240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f445c009870 tx=0x7f445c02ba20 comp rx=0 tx=0).stop 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f446d62d640 1 -- 172.21.15.66:0/1098768266 shutdown_connections 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f446d62d640 1 --2- 172.21.15.66:0/1098768266 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f446815ea80 0x7f44680cf240 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f446d62d640 1 -- 172.21.15.66:0/1098768266 >> 172.21.15.66:0/1098768266 conn(0x7f44680b2ab0 msgr2=0x7f44680b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.352 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f446d62d640 1 -- 172.21.15.66:0/1098768266 shutdown_connections 2023-11-25T04:08:12.353 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.349+0000 7f446d62d640 1 -- 172.21.15.66:0/1098768266 wait complete. 2023-11-25T04:08:12.353 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.351+0000 7f446d62d640 1 Processor -- start 2023-11-25T04:08:12.353 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.351+0000 7f446d62d640 1 -- start start 2023-11-25T04:08:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.351+0000 7f446d62d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44680afee0 0x7f446814af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.355 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.351+0000 7f446d62d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44680b07f0 0x7f44680b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.351+0000 7f446d62d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f446815ea80 0x7f44680caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.351+0000 7f446d62d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44680b5ba0 con 0x7f446815ea80 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.351+0000 7f446d62d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44680b6500 con 0x7f44680b07f0 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.351+0000 7f446d62d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44680b4f20 con 0x7f44680afee0 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f4466ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44680afee0 0x7f446814af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f44667fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44680b07f0 0x7f44680b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f44667fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44680b07f0 0x7f44680b5fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38100/0 (socket says 172.21.15.66:38100) 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f4466ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44680afee0 0x7f446814af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58258/0 (socket says 172.21.15.66:58258) 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f44667fc640 1 -- 172.21.15.66:0/1821409894 learned_addr learned my addr 172.21.15.66:0/1821409894 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f44677fe640 1 --2- 172.21.15.66:0/1821409894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f446815ea80 0x7f44680caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f4466ffd640 1 -- 172.21.15.66:0/1821409894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44680b07f0 msgr2=0x7f44680b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f4466ffd640 1 --2- 172.21.15.66:0/1821409894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44680b07f0 0x7f44680b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.356 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f4466ffd640 1 -- 172.21.15.66:0/1821409894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f446815ea80 msgr2=0x7f44680caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f4466ffd640 1 --2- 172.21.15.66:0/1821409894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f446815ea80 0x7f44680caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f4466ffd640 1 -- 172.21.15.66:0/1821409894 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0094d0 con 0x7f44680afee0 2023-11-25T04:08:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f4466ffd640 1 --2- 172.21.15.66:0/1821409894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44680afee0 0x7f446814af90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f445c033000 tx=0x7f445c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f444f7fe640 1 -- 172.21.15.66:0/1821409894 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c041400 con 0x7f44680afee0 2023-11-25T04:08:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f444f7fe640 1 -- 172.21.15.66:0/1821409894 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c041560 con 0x7f44680afee0 2023-11-25T04:08:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f444f7fe640 1 -- 172.21.15.66:0/1821409894 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c041910 con 0x7f44680afee0 2023-11-25T04:08:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f446d62d640 1 -- 172.21.15.66:0/1821409894 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44680b5200 con 0x7f44680afee0 2023-11-25T04:08:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.352+0000 7f446d62d640 1 -- 172.21.15.66:0/1821409894 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44680b57c0 con 0x7f44680afee0 2023-11-25T04:08:12.357 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.353+0000 7f444f7fe640 1 -- 172.21.15.66:0/1821409894 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f445c04b460 con 0x7f44680afee0 2023-11-25T04:08:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.353+0000 7f444f7fe640 1 -- 172.21.15.66:0/1821409894 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f445c03c070 con 0x7f44680afee0 2023-11-25T04:08:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.353+0000 7f446d62d640 1 -- 172.21.15.66:0/1821409894 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44680b5ce0 con 0x7f44680afee0 2023-11-25T04:08:12.358 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.356+0000 7f444f7fe640 1 -- 172.21.15.66:0/1821409894 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f445c041d70 con 0x7f44680afee0 2023-11-25T04:08:12.390 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.387+0000 7f6353e12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-25T04:08:12.390 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.388+0000 7f5b27412040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-25T04:08:12.431 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.429+0000 7f446d62d640 1 -- 172.21.15.66:0/1821409894 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114", "id": 2} v 0) v1 -- 0x7f44680afd10 con 0x7f44680afee0 2023-11-25T04:08:12.434 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.432+0000 7f444f7fe640 1 -- 172.21.15.66:0/1821409894 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f445c04b850 con 0x7f44680afee0 2023-11-25T04:08:12.434 INFO:teuthology.orchestra.run.smithi066.stdout:2 2023-11-25T04:08:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.433+0000 7f446d62d640 1 -- 172.21.15.66:0/1821409894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44680afee0 msgr2=0x7f446814af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.433+0000 7f446d62d640 1 --2- 172.21.15.66:0/1821409894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44680afee0 0x7f446814af90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f445c033000 tx=0x7f445c004730 comp rx=0 tx=0).stop 2023-11-25T04:08:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.433+0000 7f446d62d640 1 -- 172.21.15.66:0/1821409894 shutdown_connections 2023-11-25T04:08:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.433+0000 7f446d62d640 1 --2- 172.21.15.66:0/1821409894 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f446815ea80 0x7f44680caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.433+0000 7f446d62d640 1 --2- 172.21.15.66:0/1821409894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44680b07f0 0x7f44680b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.433+0000 7f446d62d640 1 --2- 172.21.15.66:0/1821409894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44680afee0 0x7f446814af90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.433+0000 7f446d62d640 1 -- 172.21.15.66:0/1821409894 >> 172.21.15.66:0/1821409894 conn(0x7f44680b2ab0 msgr2=0x7f44680cf0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.433+0000 7f446d62d640 1 -- 172.21.15.66:0/1821409894 shutdown_connections 2023-11-25T04:08:12.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.433+0000 7f446d62d640 1 -- 172.21.15.66:0/1821409894 wait complete. 2023-11-25T04:08:12.437 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.434+0000 7f6353e12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-25T04:08:12.437 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.435+0000 7f5b27412040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-25T04:08:12.446 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49 3 2023-11-25T04:08:12.493 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.491+0000 7f5b27412040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-25T04:08:12.495 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.493+0000 7f6353e12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-25T04:08:12.537 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.535+0000 7f5b27412040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-25T04:08:12.540 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.538+0000 7f6353e12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-25T04:08:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.549+0000 7f979a651640 1 Processor -- start 2023-11-25T04:08:12.552 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.550+0000 7f979a651640 1 -- start start 2023-11-25T04:08:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.550+0000 7f979a651640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9794157ac0 0x7f979406b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.550+0000 7f979a651640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f979406be90 0x7f979406e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.553 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.550+0000 7f979a651640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f979406e6a0 0x7f9794071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.550+0000 7f979a651640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979406c2f0 con 0x7f9794157ac0 2023-11-25T04:08:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.550+0000 7f979a651640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979406eed0 con 0x7f979406e6a0 2023-11-25T04:08:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.550+0000 7f979a651640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979406f1b0 con 0x7f979406be90 2023-11-25T04:08:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f97937fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f979406be90 0x7f979406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f9798bee640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f979406e6a0 0x7f9794071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f97937fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f979406be90 0x7f979406e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58272/0 (socket says 172.21.15.66:58272) 2023-11-25T04:08:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f9798bee640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f979406e6a0 0x7f9794071360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38112/0 (socket says 172.21.15.66:38112) 2023-11-25T04:08:12.554 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f97937fe640 1 -- 172.21.15.66:0/1049795215 learned_addr learned my addr 172.21.15.66:0/1049795215 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.555 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f9793fff640 1 --2- 172.21.15.66:0/1049795215 >> v2:172.21.15.2:3300/0 conn(0x7f9794157ac0 0x7f979406b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.555 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f97937fe640 1 -- 172.21.15.66:0/1049795215 >> v2:172.21.15.66:3300/0 conn(0x7f979406e6a0 msgr2=0x7f9794071360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:12.555 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f97937fe640 1 --2- 172.21.15.66:0/1049795215 >> v2:172.21.15.66:3300/0 conn(0x7f979406e6a0 0x7f9794071360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.555 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f97937fe640 1 -- 172.21.15.66:0/1049795215 >> v2:172.21.15.2:3300/0 conn(0x7f9794157ac0 msgr2=0x7f979406b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:12.555 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f97937fe640 1 --2- 172.21.15.66:0/1049795215 >> v2:172.21.15.2:3300/0 conn(0x7f9794157ac0 0x7f979406b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.555 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f97937fe640 1 -- 172.21.15.66:0/1049795215 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940ad9d0 con 0x7f979406be90 2023-11-25T04:08:12.555 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.551+0000 7f9798bee640 1 --2- 172.21.15.66:0/1049795215 >> v2:172.21.15.66:3300/0 conn(0x7f979406e6a0 0x7f9794071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.552+0000 7f97937fe640 1 --2- 172.21.15.66:0/1049795215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f979406be90 0x7f979406e160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f979415a500 tx=0x7f978402b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbfcf092c63c981b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.552+0000 7f9792ffd640 1 -- 172.21.15.66:0/1049795215 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784031860 con 0x7f979406be90 2023-11-25T04:08:12.559 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.552+0000 7f9792ffd640 1 -- 172.21.15.66:0/1049795215 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840319c0 con 0x7f979406be90 2023-11-25T04:08:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.552+0000 7f9792ffd640 1 -- 172.21.15.66:0/1049795215 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784031d50 con 0x7f979406be90 2023-11-25T04:08:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.552+0000 7f979a651640 1 -- 172.21.15.66:0/1049795215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f979406be90 msgr2=0x7f979406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.552+0000 7f979a651640 1 --2- 172.21.15.66:0/1049795215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f979406be90 0x7f979406e160 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f979415a500 tx=0x7f978402b900 comp rx=0 tx=0).stop 2023-11-25T04:08:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.552+0000 7f979a651640 1 -- 172.21.15.66:0/1049795215 shutdown_connections 2023-11-25T04:08:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.552+0000 7f979a651640 1 --2- 172.21.15.66:0/1049795215 >> v2:172.21.15.66:3300/0 conn(0x7f979406e6a0 0x7f9794071360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.560 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.553+0000 7f979a651640 1 --2- 172.21.15.66:0/1049795215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f979406be90 0x7f979406e160 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.561 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.553+0000 7f979a651640 1 --2- 172.21.15.66:0/1049795215 >> v2:172.21.15.2:3300/0 conn(0x7f9794157ac0 0x7f979406b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.561 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.553+0000 7f979a651640 1 -- 172.21.15.66:0/1049795215 >> 172.21.15.66:0/1049795215 conn(0x7f97940b1e30 msgr2=0x7f97940b2240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.561 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.553+0000 7f979a651640 1 -- 172.21.15.66:0/1049795215 shutdown_connections 2023-11-25T04:08:12.561 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.553+0000 7f979a651640 1 -- 172.21.15.66:0/1049795215 wait complete. 2023-11-25T04:08:12.561 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.554+0000 7f979a651640 1 Processor -- start 2023-11-25T04:08:12.562 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.554+0000 7f979a651640 1 -- start start 2023-11-25T04:08:12.562 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f979a651640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f979406be90 0x7f97941565f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.562 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f979a651640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f979406e6a0 0x7f97940cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.562 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f979a651640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9794157ac0 0x7f97941e2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.562 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f979a651640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97941f0b90 con 0x7f979406e6a0 2023-11-25T04:08:12.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f979a651640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97940cc0f0 con 0x7f979406be90 2023-11-25T04:08:12.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f979a651640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97940cc3d0 con 0x7f9794157ac0 2023-11-25T04:08:12.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9793fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f979406be90 0x7f97941565f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9798bee640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9794157ac0 0x7f97941e2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9793fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f979406be90 0x7f97941565f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38118/0 (socket says 172.21.15.66:38118) 2023-11-25T04:08:12.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9793fff640 1 -- 172.21.15.66:0/2437924906 learned_addr learned my addr 172.21.15.66:0/2437924906 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f97937fe640 1 --2- 172.21.15.66:0/2437924906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f979406e6a0 0x7f97940cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9798bee640 1 -- 172.21.15.66:0/2437924906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f979406be90 msgr2=0x7f97941565f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9798bee640 1 --2- 172.21.15.66:0/2437924906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f979406be90 0x7f97941565f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9798bee640 1 -- 172.21.15.66:0/2437924906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f979406e6a0 msgr2=0x7f97940cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9798bee640 1 --2- 172.21.15.66:0/2437924906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f979406e6a0 0x7f97940cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9798bee640 1 -- 172.21.15.66:0/2437924906 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c009a70 con 0x7f9794157ac0 2023-11-25T04:08:12.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9793fff640 1 --2- 172.21.15.66:0/2437924906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f979406be90 0x7f97941565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:12.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.555+0000 7f9798bee640 1 --2- 172.21.15.66:0/2437924906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9794157ac0 0x7f97941e2720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f978c00eed0 tx=0x7f978c00b480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.556+0000 7f9790ff9640 1 -- 172.21.15.66:0/2437924906 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c010040 con 0x7f9794157ac0 2023-11-25T04:08:12.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.556+0000 7f9790ff9640 1 -- 172.21.15.66:0/2437924906 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c00bd20 con 0x7f9794157ac0 2023-11-25T04:08:12.566 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.556+0000 7f979a651640 1 -- 172.21.15.66:0/2437924906 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97840094d0 con 0x7f9794157ac0 2023-11-25T04:08:12.566 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.557+0000 7f9790ff9640 1 -- 172.21.15.66:0/2437924906 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c003bd0 con 0x7f9794157ac0 2023-11-25T04:08:12.566 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.557+0000 7f979a651640 1 -- 172.21.15.66:0/2437924906 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97941f0e70 con 0x7f9794157ac0 2023-11-25T04:08:12.566 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.557+0000 7f9790ff9640 1 -- 172.21.15.66:0/2437924906 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f978c004320 con 0x7f9794157ac0 2023-11-25T04:08:12.566 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.557+0000 7f9790ff9640 1 -- 172.21.15.66:0/2437924906 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f978c003d90 con 0x7f9794157ac0 2023-11-25T04:08:12.567 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.558+0000 7f979a651640 1 -- 172.21.15.66:0/2437924906 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97940cc8f0 con 0x7f9794157ac0 2023-11-25T04:08:12.567 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.560+0000 7f9790ff9640 1 -- 172.21.15.66:0/2437924906 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f97940cc8f0 con 0x7f9794157ac0 2023-11-25T04:08:12.643 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.641+0000 7f5b27412040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-25T04:08:12.650 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.648+0000 7f979a651640 1 -- 172.21.15.66:0/2437924906 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49", "id": 3} v 0) v1 -- 0x7f979409e0a0 con 0x7f9794157ac0 2023-11-25T04:08:12.654 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.652+0000 7f9790ff9640 1 -- 172.21.15.66:0/2437924906 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f978c018030 con 0x7f9794157ac0 2023-11-25T04:08:12.654 INFO:teuthology.orchestra.run.smithi066.stdout:3 2023-11-25T04:08:12.655 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.652+0000 7f979a651640 1 -- 172.21.15.66:0/2437924906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9794157ac0 msgr2=0x7f97941e2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.655 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.652+0000 7f979a651640 1 --2- 172.21.15.66:0/2437924906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9794157ac0 0x7f97941e2720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f978c00eed0 tx=0x7f978c00b480 comp rx=0 tx=0).stop 2023-11-25T04:08:12.655 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.653+0000 7f979a651640 1 -- 172.21.15.66:0/2437924906 shutdown_connections 2023-11-25T04:08:12.655 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.653+0000 7f979a651640 1 --2- 172.21.15.66:0/2437924906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9794157ac0 0x7f97941e2720 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.655 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.653+0000 7f979a651640 1 --2- 172.21.15.66:0/2437924906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f979406e6a0 0x7f97940cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.653+0000 7f979a651640 1 --2- 172.21.15.66:0/2437924906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f979406be90 0x7f97941565f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.653+0000 7f979a651640 1 -- 172.21.15.66:0/2437924906 >> 172.21.15.66:0/2437924906 conn(0x7f97940b1e30 msgr2=0x7f97940b2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.653+0000 7f979a651640 1 -- 172.21.15.66:0/2437924906 shutdown_connections 2023-11-25T04:08:12.656 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.653+0000 7f979a651640 1 -- 172.21.15.66:0/2437924906 wait complete. 2023-11-25T04:08:12.662 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.660+0000 7f6353e12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-25T04:08:12.665 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 642a0a7a-ab80-492d-b1b1-2ea579d98bb0 4 2023-11-25T04:08:12.717 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.715+0000 7f5b27412040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-25T04:08:12.737 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.735+0000 7f6353e12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-25T04:08:12.764 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.762+0000 7f5b27412040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-25T04:08:12.771 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.769+0000 7fc1a97b0640 1 Processor -- start 2023-11-25T04:08:12.771 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.769+0000 7fc1a97b0640 1 -- start start 2023-11-25T04:08:12.774 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a97b0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1a409a080 0x7fc1a40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.775 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a97b0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1a40cf470 0x7fc1a40b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.775 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a97b0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a40cfca0 con 0x7fc1a415d8d0 2023-11-25T04:08:12.775 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a97b0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a40b0720 con 0x7fc1a40cf470 2023-11-25T04:08:12.775 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a97b0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a40b0a00 con 0x7fc1a409a080 2023-11-25T04:08:12.775 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a27fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1a409a080 0x7fc1a40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.775 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a27fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1a409a080 0x7fc1a40cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38130/0 (socket says 172.21.15.66:38130) 2023-11-25T04:08:12.775 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a27fc640 1 -- 172.21.15.66:0/494514376 learned_addr learned my addr 172.21.15.66:0/494514376 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.776 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a37fe640 1 --2- 172.21.15.66:0/494514376 >> v2:172.21.15.2:3300/0 conn(0x7fc1a40cf470 0x7fc1a40b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.776 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a27fc640 1 -- 172.21.15.66:0/494514376 >> v2:172.21.15.2:3300/0 conn(0x7fc1a40cf470 msgr2=0x7fc1a40b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:12.776 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a27fc640 1 --2- 172.21.15.66:0/494514376 >> v2:172.21.15.2:3300/0 conn(0x7fc1a40cf470 0x7fc1a40b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.776 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a27fc640 1 -- 172.21.15.66:0/494514376 >> v1:172.21.15.2:6789/0 conn(0x7fc1a415d8d0 legacy=0x7fc1a4099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.776 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.770+0000 7fc1a27fc640 1 -- 172.21.15.66:0/494514376 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a40b0ce0 con 0x7fc1a409a080 2023-11-25T04:08:12.776 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.771+0000 7fc1a27fc640 1 --2- 172.21.15.66:0/494514376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 0x7fc1a40cef30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4070db0 tx=0x7fc19402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4759eb6b23771db7 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.776 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.771+0000 7fc1a1ffb640 1 -- 172.21.15.66:0/494514376 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194030860 con 0x7fc1a409a080 2023-11-25T04:08:12.777 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.771+0000 7fc1a1ffb640 1 -- 172.21.15.66:0/494514376 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1940309c0 con 0x7fc1a409a080 2023-11-25T04:08:12.777 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.771+0000 7fc1a1ffb640 1 -- 172.21.15.66:0/494514376 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc194030d50 con 0x7fc1a409a080 2023-11-25T04:08:12.777 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.772+0000 7fc1a97b0640 1 -- 172.21.15.66:0/494514376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 msgr2=0x7fc1a40cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.777 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.772+0000 7fc1a97b0640 1 --2- 172.21.15.66:0/494514376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 0x7fc1a40cef30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4070db0 tx=0x7fc19402b9a0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.777 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.772+0000 7fc1a97b0640 1 -- 172.21.15.66:0/494514376 shutdown_connections 2023-11-25T04:08:12.777 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.772+0000 7fc1a97b0640 1 --2- 172.21.15.66:0/494514376 >> v2:172.21.15.2:3300/0 conn(0x7fc1a40cf470 0x7fc1a40b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.777 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.772+0000 7fc1a97b0640 1 --2- 172.21.15.66:0/494514376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 0x7fc1a40cef30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.778 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.772+0000 7fc1a97b0640 1 -- 172.21.15.66:0/494514376 >> 172.21.15.66:0/494514376 conn(0x7fc1a40b2ab0 msgr2=0x7fc1a40b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.779 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.772+0000 7fc1a97b0640 1 -- 172.21.15.66:0/494514376 shutdown_connections 2023-11-25T04:08:12.779 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.772+0000 7fc1a97b0640 1 -- 172.21.15.66:0/494514376 wait complete. 2023-11-25T04:08:12.783 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.773+0000 7fc1a97b0640 1 Processor -- start 2023-11-25T04:08:12.783 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.773+0000 7fc1a97b0640 1 -- start start 2023-11-25T04:08:12.783 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a97b0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 0x7fc1a40ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.784 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a97b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a40cf470 0x7fc1a414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.784 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a97b0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1a415d8d0 0x7fc1a406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.784 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a97b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a40caef0 con 0x7fc1a40cf470 2023-11-25T04:08:12.784 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a97b0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a40cac10 con 0x7fc1a409a080 2023-11-25T04:08:12.784 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a97b0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a40b46c0 con 0x7fc1a415d8d0 2023-11-25T04:08:12.784 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 0x7fc1a40ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.784 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a37fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1a415d8d0 0x7fc1a406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.785 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a2ffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 0x7fc1a40ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38134/0 (socket says 172.21.15.66:38134) 2023-11-25T04:08:12.785 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a2ffd640 1 -- 172.21.15.66:0/4072370235 learned_addr learned my addr 172.21.15.66:0/4072370235 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.785 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.774+0000 7fc1a27fc640 1 --2- 172.21.15.66:0/4072370235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a40cf470 0x7fc1a414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.785 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc1a2ffd640 1 -- 172.21.15.66:0/4072370235 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1a415d8d0 msgr2=0x7fc1a406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.786 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc1a2ffd640 1 --2- 172.21.15.66:0/4072370235 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1a415d8d0 0x7fc1a406ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.786 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc1a2ffd640 1 -- 172.21.15.66:0/4072370235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a40cf470 msgr2=0x7fc1a414d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.786 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc1a2ffd640 1 --2- 172.21.15.66:0/4072370235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a40cf470 0x7fc1a414d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.786 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc1a2ffd640 1 -- 172.21.15.66:0/4072370235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1940094d0 con 0x7fc1a409a080 2023-11-25T04:08:12.786 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc1a37fe640 1 --2- 172.21.15.66:0/4072370235 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1a415d8d0 0x7fc1a406ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc1a2ffd640 1 --2- 172.21.15.66:0/4072370235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 0x7fc1a40ca5c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc19800c400 tx=0x7fc19800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc18b7fe640 1 -- 172.21.15.66:0/4072370235 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1980052d0 con 0x7fc1a409a080 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc18b7fe640 1 -- 172.21.15.66:0/4072370235 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc198005430 con 0x7fc1a409a080 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc1a97b0640 1 -- 172.21.15.66:0/4072370235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a40b49a0 con 0x7fc1a409a080 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc18b7fe640 1 -- 172.21.15.66:0/4072370235 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc198003830 con 0x7fc1a409a080 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc1a97b0640 1 -- 172.21.15.66:0/4072370235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a414d8f0 con 0x7fc1a409a080 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc18b7fe640 1 -- 172.21.15.66:0/4072370235 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc198003c90 con 0x7fc1a409a080 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.775+0000 7fc18b7fe640 1 -- 172.21.15.66:0/4072370235 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc198012930 con 0x7fc1a409a080 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.776+0000 7fc1a97b0640 1 -- 172.21.15.66:0/4072370235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a40b44f0 con 0x7fc1a409a080 2023-11-25T04:08:12.787 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.778+0000 7fc18b7fe640 1 -- 172.21.15.66:0/4072370235 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc198017070 con 0x7fc1a409a080 2023-11-25T04:08:12.788 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.785+0000 7f6353e12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-25T04:08:12.819 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.817+0000 7f5b27412040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-25T04:08:12.841 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.839+0000 7f6353e12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-25T04:08:12.853 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.851+0000 7fc1a97b0640 1 -- 172.21.15.66:0/4072370235 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "642a0a7a-ab80-492d-b1b1-2ea579d98bb0", "id": 4} v 0) v1 -- 0x7fc1a409f0b0 con 0x7fc1a409a080 2023-11-25T04:08:12.857 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.855+0000 7fc18b7fe640 1 -- 172.21.15.66:0/4072370235 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "642a0a7a-ab80-492d-b1b1-2ea579d98bb0", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc198012b40 con 0x7fc1a409a080 2023-11-25T04:08:12.857 INFO:teuthology.orchestra.run.smithi066.stdout:4 2023-11-25T04:08:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.855+0000 7fc1a97b0640 1 -- 172.21.15.66:0/4072370235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 msgr2=0x7fc1a40ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.855+0000 7fc1a97b0640 1 --2- 172.21.15.66:0/4072370235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 0x7fc1a40ca5c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc19800c400 tx=0x7fc19800c8c0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.856+0000 7fc1a97b0640 1 -- 172.21.15.66:0/4072370235 shutdown_connections 2023-11-25T04:08:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.856+0000 7fc1a97b0640 1 --2- 172.21.15.66:0/4072370235 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1a415d8d0 0x7fc1a406ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.856+0000 7fc1a97b0640 1 --2- 172.21.15.66:0/4072370235 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1a40cf470 0x7fc1a414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.858 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.856+0000 7fc1a97b0640 1 --2- 172.21.15.66:0/4072370235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1a409a080 0x7fc1a40ca5c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.856+0000 7fc1a97b0640 1 -- 172.21.15.66:0/4072370235 >> 172.21.15.66:0/4072370235 conn(0x7fc1a40b2ab0 msgr2=0x7fc1a415bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.856+0000 7fc1a97b0640 1 -- 172.21.15.66:0/4072370235 shutdown_connections 2023-11-25T04:08:12.859 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.856+0000 7fc1a97b0640 1 -- 172.21.15.66:0/4072370235 wait complete. 2023-11-25T04:08:12.868 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new f50fedc1-4042-49ff-845c-219ddccc5211 5 2023-11-25T04:08:12.869 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:12.867+0000 7f5b27412040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-25T04:08:12.892 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:12.890+0000 7f6353e12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-25T04:08:12.974 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.971+0000 7f1bd2533640 1 Processor -- start 2023-11-25T04:08:12.974 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.972+0000 7f1bd2533640 1 -- start start 2023-11-25T04:08:12.976 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.972+0000 7f1bd2533640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1bcc15d590 0x7f1bcc099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.976 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.972+0000 7f1bd2533640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1bcc0b35d0 0x7f1bcc099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.976 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.972+0000 7f1bd2533640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0affe0 0x7f1bcc06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.976 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.972+0000 7f1bd2533640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0cb6b0 con 0x7f1bcc15d590 2023-11-25T04:08:12.976 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.972+0000 7f1bd2533640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0cfb10 con 0x7f1bcc0b35d0 2023-11-25T04:08:12.976 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.972+0000 7f1bd2533640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0cfdb0 con 0x7f1bcc0affe0 2023-11-25T04:08:12.976 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.972+0000 7f1bcb7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1bcc0b35d0 0x7f1bcc099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.976 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.972+0000 7f1bd0ad0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0affe0 0x7f1bcc06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.973+0000 7f1bcb7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1bcc0b35d0 0x7f1bcc099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38144/0 (socket says 172.21.15.66:38144) 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.973+0000 7f1bcb7fe640 1 -- 172.21.15.66:0/2514124277 learned_addr learned my addr 172.21.15.66:0/2514124277 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.973+0000 7f1bcbfff640 1 --2- 172.21.15.66:0/2514124277 >> v2:172.21.15.2:3300/0 conn(0x7f1bcc15d590 0x7f1bcc099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.973+0000 7f1bcb7fe640 1 -- 172.21.15.66:0/2514124277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0affe0 msgr2=0x7f1bcc06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.973+0000 7f1bcb7fe640 1 --2- 172.21.15.66:0/2514124277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0affe0 0x7f1bcc06b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.973+0000 7f1bcb7fe640 1 -- 172.21.15.66:0/2514124277 >> v2:172.21.15.2:3300/0 conn(0x7f1bcc15d590 msgr2=0x7f1bcc099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.973+0000 7f1bcb7fe640 1 --2- 172.21.15.66:0/2514124277 >> v2:172.21.15.2:3300/0 conn(0x7f1bcc15d590 0x7f1bcc099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.973+0000 7f1bcb7fe640 1 -- 172.21.15.66:0/2514124277 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc0d0090 con 0x7f1bcc0b35d0 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.973+0000 7f1bd0ad0640 1 --2- 172.21.15.66:0/2514124277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0affe0 0x7f1bcc06b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bcb7fe640 1 --2- 172.21.15.66:0/2514124277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0b35d0 0x7f1bcc099eb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc072a00 tx=0x7f1bc002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b51a763a6428e35e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bcaffd640 1 -- 172.21.15.66:0/2514124277 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0031870 con 0x7f1bcc0b35d0 2023-11-25T04:08:12.977 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bcaffd640 1 -- 172.21.15.66:0/2514124277 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc00319d0 con 0x7f1bcc0b35d0 2023-11-25T04:08:12.978 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bcaffd640 1 -- 172.21.15.66:0/2514124277 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0031d60 con 0x7f1bcc0b35d0 2023-11-25T04:08:12.980 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bd2533640 1 -- 172.21.15.66:0/2514124277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0b35d0 msgr2=0x7f1bcc099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.980 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bd2533640 1 --2- 172.21.15.66:0/2514124277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0b35d0 0x7f1bcc099eb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc072a00 tx=0x7f1bc002b910 comp rx=0 tx=0).stop 2023-11-25T04:08:12.980 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bd2533640 1 -- 172.21.15.66:0/2514124277 shutdown_connections 2023-11-25T04:08:12.980 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bd2533640 1 --2- 172.21.15.66:0/2514124277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0affe0 0x7f1bcc06b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.980 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bd2533640 1 --2- 172.21.15.66:0/2514124277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0b35d0 0x7f1bcc099eb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.981 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bd2533640 1 --2- 172.21.15.66:0/2514124277 >> v2:172.21.15.2:3300/0 conn(0x7f1bcc15d590 0x7f1bcc099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.981 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.974+0000 7f1bd2533640 1 -- 172.21.15.66:0/2514124277 >> 172.21.15.66:0/2514124277 conn(0x7f1bcc0b2ab0 msgr2=0x7f1bcc0b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:12.981 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.975+0000 7f1bd2533640 1 -- 172.21.15.66:0/2514124277 shutdown_connections 2023-11-25T04:08:12.981 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.975+0000 7f1bd2533640 1 -- 172.21.15.66:0/2514124277 wait complete. 2023-11-25T04:08:12.982 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.976+0000 7f1bd2533640 1 Processor -- start 2023-11-25T04:08:12.982 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.976+0000 7f1bd2533640 1 -- start start 2023-11-25T04:08:12.982 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bd2533640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0affe0 0x7f1bcc15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.982 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bd2533640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0b35d0 0x7f1bcc0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.982 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bd2533640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc15d590 0x7f1bcc0c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:12.983 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bd2533640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0b4570 con 0x7f1bcc15d590 2023-11-25T04:08:12.983 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bd2533640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0c6a70 con 0x7f1bcc0affe0 2023-11-25T04:08:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bd2533640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc0c5c10 con 0x7f1bcc0b35d0 2023-11-25T04:08:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcb7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0b35d0 0x7f1bcc0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0affe0 0x7f1bcc15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcb7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0b35d0 0x7f1bcc0c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58318/0 (socket says 172.21.15.66:58318) 2023-11-25T04:08:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0affe0 0x7f1bcc15bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38154/0 (socket says 172.21.15.66:38154) 2023-11-25T04:08:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcb7fe640 1 -- 172.21.15.66:0/1728481121 learned_addr learned my addr 172.21.15.66:0/1728481121 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bd0ad0640 1 --2- 172.21.15.66:0/1728481121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc15d590 0x7f1bcc0c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcbfff640 1 -- 172.21.15.66:0/1728481121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0b35d0 msgr2=0x7f1bcc0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.984 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcbfff640 1 --2- 172.21.15.66:0/1728481121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0b35d0 0x7f1bcc0c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.985 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcbfff640 1 -- 172.21.15.66:0/1728481121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc15d590 msgr2=0x7f1bcc0c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:12.985 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcbfff640 1 --2- 172.21.15.66:0/1728481121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc15d590 0x7f1bcc0c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:12.985 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcbfff640 1 -- 172.21.15.66:0/1728481121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4009a70 con 0x7f1bcc0affe0 2023-11-25T04:08:12.985 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcb7fe640 1 --2- 172.21.15.66:0/1728481121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0b35d0 0x7f1bcc0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:12.985 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bcbfff640 1 --2- 172.21.15.66:0/1728481121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0affe0 0x7f1bcc15bce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00e850 tx=0x7f1bbc00ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:12.985 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.977+0000 7f1bc8ff9640 1 -- 172.21.15.66:0/1728481121 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc00eea0 con 0x7f1bcc0affe0 2023-11-25T04:08:12.985 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.978+0000 7f1bc8ff9640 1 -- 172.21.15.66:0/1728481121 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc00c940 con 0x7f1bcc0affe0 2023-11-25T04:08:12.985 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.978+0000 7f1bc8ff9640 1 -- 172.21.15.66:0/1728481121 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc00ccf0 con 0x7f1bcc0affe0 2023-11-25T04:08:12.985 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.978+0000 7f1bd2533640 1 -- 172.21.15.66:0/1728481121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc00094d0 con 0x7f1bcc0affe0 2023-11-25T04:08:12.986 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.978+0000 7f1bd2533640 1 -- 172.21.15.66:0/1728481121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc0b47c0 con 0x7f1bcc0affe0 2023-11-25T04:08:12.986 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.978+0000 7f1bc8ff9640 1 -- 172.21.15.66:0/1728481121 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1bbc013770 con 0x7f1bcc0affe0 2023-11-25T04:08:12.986 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.978+0000 7f1bc8ff9640 1 -- 172.21.15.66:0/1728481121 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f1bbc01cca0 con 0x7f1bcc0affe0 2023-11-25T04:08:12.986 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.979+0000 7f1bd2533640 1 -- 172.21.15.66:0/1728481121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc04e920 con 0x7f1bcc0affe0 2023-11-25T04:08:12.986 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:12.981+0000 7f1bc8ff9640 1 -- 172.21.15.66:0/1728481121 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1bbc021060 con 0x7f1bcc0affe0 2023-11-25T04:08:13.056 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.053+0000 7f1bd2533640 1 -- 172.21.15.66:0/1728481121 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f50fedc1-4042-49ff-845c-219ddccc5211", "id": 5} v 0) v1 -- 0x7f1bcc066a90 con 0x7f1bcc0affe0 2023-11-25T04:08:13.059 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.057+0000 7f1bc8ff9640 1 -- 172.21.15.66:0/1728481121 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f50fedc1-4042-49ff-845c-219ddccc5211", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1bbc017070 con 0x7f1bcc0affe0 2023-11-25T04:08:13.059 INFO:teuthology.orchestra.run.smithi066.stdout:5 2023-11-25T04:08:13.060 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.057+0000 7f1bd2533640 1 -- 172.21.15.66:0/1728481121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0affe0 msgr2=0x7f1bcc15bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.060 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.057+0000 7f1bd2533640 1 --2- 172.21.15.66:0/1728481121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0affe0 0x7f1bcc15bce0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc00e850 tx=0x7f1bbc00ec50 comp rx=0 tx=0).stop 2023-11-25T04:08:13.060 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.058+0000 7f1bd2533640 1 -- 172.21.15.66:0/1728481121 shutdown_connections 2023-11-25T04:08:13.060 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.058+0000 7f1bd2533640 1 --2- 172.21.15.66:0/1728481121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc15d590 0x7f1bcc0c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.060 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.058+0000 7f1bd2533640 1 --2- 172.21.15.66:0/1728481121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc0b35d0 0x7f1bcc0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.060 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.058+0000 7f1bd2533640 1 --2- 172.21.15.66:0/1728481121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc0affe0 0x7f1bcc15bce0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.060 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.058+0000 7f1bd2533640 1 -- 172.21.15.66:0/1728481121 >> 172.21.15.66:0/1728481121 conn(0x7f1bcc0b2ab0 msgr2=0x7f1bcc06fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:13.060 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.058+0000 7f1bd2533640 1 -- 172.21.15.66:0/1728481121 shutdown_connections 2023-11-25T04:08:13.061 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.058+0000 7f1bd2533640 1 -- 172.21.15.66:0/1728481121 wait complete. 2023-11-25T04:08:13.070 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 320e932d-0878-4a4a-9cd1-4778a48f8390 6 2023-11-25T04:08:13.220 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.218+0000 7f6dddaad640 1 Processor -- start 2023-11-25T04:08:13.221 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.218+0000 7f6dddaad640 1 -- start start 2023-11-25T04:08:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dddaad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80ceb70 0x7f6dd80b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dddaad640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6dd80b0e40 0x7f6dd815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dddaad640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd809a520 con 0x7f6dd815e8a0 2023-11-25T04:08:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dddaad640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd809a330 con 0x7f6dd80b0e40 2023-11-25T04:08:13.222 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dddaad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd809a800 con 0x7f6dd80ceb70 2023-11-25T04:08:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd6ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80ceb70 0x7f6dd80b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6dd80b0e40 0x7f6dd815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd6ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80ceb70 0x7f6dd80b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58334/0 (socket says 172.21.15.66:58334) 2023-11-25T04:08:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd6ffd640 1 -- 172.21.15.66:0/241138220 learned_addr learned my addr 172.21.15.66:0/241138220 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:13.223 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6dd80b0e40 0x7f6dd815efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38164/0 (socket says 172.21.15.66:38164) 2023-11-25T04:08:13.224 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd77fe640 1 --1- 172.21.15.66:0/241138220 >> v1:172.21.15.2:6789/0 conn(0x7f6dd815e8a0 0x7f6dd80cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.66:55500/0 (socket says 172.21.15.66:55500) 2023-11-25T04:08:13.224 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd7fff640 1 -- 172.21.15.66:0/241138220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80ceb70 msgr2=0x7f6dd80b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:13.224 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd7fff640 1 --2- 172.21.15.66:0/241138220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80ceb70 0x7f6dd80b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.224 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd7fff640 1 -- 172.21.15.66:0/241138220 >> v1:172.21.15.2:6789/0 conn(0x7f6dd815e8a0 legacy=0x7f6dd80cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.225 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd7fff640 1 -- 172.21.15.66:0/241138220 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd80cbf90 con 0x7f6dd80b0e40 2023-11-25T04:08:13.225 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd67fc640 1 -- 172.21.15.66:0/241138220 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916681774 0 0) 0x7f6dd809a520 con 0x7f6dd815e8a0 2023-11-25T04:08:13.225 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.219+0000 7f6dd6ffd640 1 --2- 172.21.15.66:0/241138220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80ceb70 0x7f6dd80b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:13.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dd7fff640 1 --2- 172.21.15.66:0/241138220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd80b0e40 0x7f6dd815efb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009d90 tx=0x7f6dd002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab4c14187249157b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:13.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dd67fc640 1 -- 172.21.15.66:0/241138220 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd002cc50 con 0x7f6dd80b0e40 2023-11-25T04:08:13.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dd67fc640 1 -- 172.21.15.66:0/241138220 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd002cdb0 con 0x7f6dd80b0e40 2023-11-25T04:08:13.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dd67fc640 1 -- 172.21.15.66:0/241138220 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0034660 con 0x7f6dd80b0e40 2023-11-25T04:08:13.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dddaad640 1 -- 172.21.15.66:0/241138220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd80b0e40 msgr2=0x7f6dd815efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dddaad640 1 --2- 172.21.15.66:0/241138220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd80b0e40 0x7f6dd815efb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009d90 tx=0x7f6dd002bea0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dddaad640 1 -- 172.21.15.66:0/241138220 shutdown_connections 2023-11-25T04:08:13.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dddaad640 1 --2- 172.21.15.66:0/241138220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80ceb70 0x7f6dd80b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dddaad640 1 --2- 172.21.15.66:0/241138220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd80b0e40 0x7f6dd815efb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dddaad640 1 -- 172.21.15.66:0/241138220 >> 172.21.15.66:0/241138220 conn(0x7f6dd80b2a90 msgr2=0x7f6dd80b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dddaad640 1 -- 172.21.15.66:0/241138220 shutdown_connections 2023-11-25T04:08:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.221+0000 7f6dddaad640 1 -- 172.21.15.66:0/241138220 wait complete. 2023-11-25T04:08:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.223+0000 7f6dddaad640 1 Processor -- start 2023-11-25T04:08:13.230 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.223+0000 7f6dddaad640 1 -- start start 2023-11-25T04:08:13.231 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.223+0000 7f6dddaad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80b0e40 0x7f6dd80b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.231 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.223+0000 7f6dddaad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80ceb70 0x7f6dd815c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.231 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.223+0000 7f6dddaad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd815e8a0 0x7f6dd80b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.231 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.223+0000 7f6dddaad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80c9c30 con 0x7f6dd80ceb70 2023-11-25T04:08:13.231 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.223+0000 7f6dddaad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd815ce80 con 0x7f6dd815e8a0 2023-11-25T04:08:13.231 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.223+0000 7f6dddaad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80b69b0 con 0x7f6dd80b0e40 2023-11-25T04:08:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd77fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80b0e40 0x7f6dd80b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd815e8a0 0x7f6dd80b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd77fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80b0e40 0x7f6dd80b63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58346/0 (socket says 172.21.15.66:58346) 2023-11-25T04:08:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd77fe640 1 -- 172.21.15.66:0/225439109 learned_addr learned my addr 172.21.15.66:0/225439109 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:13.232 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd6ffd640 1 --2- 172.21.15.66:0/225439109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80ceb70 0x7f6dd815c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd77fe640 1 -- 172.21.15.66:0/225439109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd815e8a0 msgr2=0x7f6dd80b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd77fe640 1 --2- 172.21.15.66:0/225439109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd815e8a0 0x7f6dd80b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd77fe640 1 -- 172.21.15.66:0/225439109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80ceb70 msgr2=0x7f6dd815c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd77fe640 1 --2- 172.21.15.66:0/225439109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80ceb70 0x7f6dd815c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd77fe640 1 -- 172.21.15.66:0/225439109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc80094d0 con 0x7f6dd80b0e40 2023-11-25T04:08:13.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dd77fe640 1 --2- 172.21.15.66:0/225439109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80b0e40 0x7f6dd80b63d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c430 tx=0x7f6dc000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:13.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dcffff640 1 -- 172.21.15.66:0/225439109 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc00074e0 con 0x7f6dd80b0e40 2023-11-25T04:08:13.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dcffff640 1 -- 172.21.15.66:0/225439109 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc0007660 con 0x7f6dd80b0e40 2023-11-25T04:08:13.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dcffff640 1 -- 172.21.15.66:0/225439109 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0004a20 con 0x7f6dd80b0e40 2023-11-25T04:08:13.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dddaad640 1 -- 172.21.15.66:0/225439109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd0009a70 con 0x7f6dd80b0e40 2023-11-25T04:08:13.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.224+0000 7f6dddaad640 1 -- 172.21.15.66:0/225439109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd80c9430 con 0x7f6dd80b0e40 2023-11-25T04:08:13.235 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.225+0000 7f6dcffff640 1 -- 172.21.15.66:0/225439109 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6dc001d3f0 con 0x7f6dd80b0e40 2023-11-25T04:08:13.235 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.225+0000 7f6dcffff640 1 -- 172.21.15.66:0/225439109 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f6dc00139b0 con 0x7f6dd80b0e40 2023-11-25T04:08:13.235 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.225+0000 7f6dddaad640 1 -- 172.21.15.66:0/225439109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd809f0b0 con 0x7f6dd80b0e40 2023-11-25T04:08:13.236 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.227+0000 7f6dcffff640 1 -- 172.21.15.66:0/225439109 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6dc0013bd0 con 0x7f6dd80b0e40 2023-11-25T04:08:13.267 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:13.265+0000 7f5b27412040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-25T04:08:13.301 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:13.299+0000 7f6353e12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-25T04:08:13.304 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.302+0000 7f6dddaad640 1 -- 172.21.15.66:0/225439109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "320e932d-0878-4a4a-9cd1-4778a48f8390", "id": 6} v 0) v1 -- 0x7f6dd815aa10 con 0x7f6dd80b0e40 2023-11-25T04:08:13.307 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.305+0000 7f6dcffff640 1 -- 172.21.15.66:0/225439109 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "320e932d-0878-4a4a-9cd1-4778a48f8390", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6dc00133c0 con 0x7f6dd80b0e40 2023-11-25T04:08:13.307 INFO:teuthology.orchestra.run.smithi066.stdout:6 2023-11-25T04:08:13.308 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.306+0000 7f6dddaad640 1 -- 172.21.15.66:0/225439109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80b0e40 msgr2=0x7f6dd80b63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.308 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.306+0000 7f6dddaad640 1 --2- 172.21.15.66:0/225439109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80b0e40 0x7f6dd80b63d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c430 tx=0x7f6dc000c8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.308 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.306+0000 7f6dddaad640 1 -- 172.21.15.66:0/225439109 shutdown_connections 2023-11-25T04:08:13.308 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.306+0000 7f6dddaad640 1 --2- 172.21.15.66:0/225439109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6dd815e8a0 0x7f6dd80b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.308 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.306+0000 7f6dddaad640 1 --2- 172.21.15.66:0/225439109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6dd80ceb70 0x7f6dd815c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.309 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.306+0000 7f6dddaad640 1 --2- 172.21.15.66:0/225439109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6dd80b0e40 0x7f6dd80b63d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.309 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.306+0000 7f6dddaad640 1 -- 172.21.15.66:0/225439109 >> 172.21.15.66:0/225439109 conn(0x7f6dd80b2a90 msgr2=0x7f6dd80cdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:13.309 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.306+0000 7f6dddaad640 1 -- 172.21.15.66:0/225439109 shutdown_connections 2023-11-25T04:08:13.309 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.306+0000 7f6dddaad640 1 -- 172.21.15.66:0/225439109 wait complete. 2023-11-25T04:08:13.318 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new ec16e94a-6184-41c7-8d89-d034f7a106a8 7 2023-11-25T04:08:13.410 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:13.408+0000 7f5b27412040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-25T04:08:13.424 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.422+0000 7f2c5865c640 1 Processor -- start 2023-11-25T04:08:13.424 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.422+0000 7f2c5865c640 1 -- start start 2023-11-25T04:08:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c5865c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2c50160ad0 0x7f2c500b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c5865c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500d0240 0x7f2c500ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c5865c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c500d16a0 con 0x7f2c500b2110 2023-11-25T04:08:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c5865c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c500d1980 con 0x7f2c50160ad0 2023-11-25T04:08:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c5865c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500d1c60 con 0x7f2c500d0240 2023-11-25T04:08:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c563f8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2c50160ad0 0x7f2c500b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c56bf9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500d0240 0x7f2c500ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.426 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c563f8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2c50160ad0 0x7f2c500b4420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:38168/0 (socket says 172.21.15.66:38168) 2023-11-25T04:08:13.427 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c56bf9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500d0240 0x7f2c500ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58352/0 (socket says 172.21.15.66:58352) 2023-11-25T04:08:13.427 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.423+0000 7f2c563f8640 1 -- 172.21.15.66:0/956188652 learned_addr learned my addr 172.21.15.66:0/956188652 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:13.427 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.424+0000 7f2c56bf9640 1 -- 172.21.15.66:0/956188652 >> v2:172.21.15.66:3300/0 conn(0x7f2c50160ad0 msgr2=0x7f2c500b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:13.427 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.424+0000 7f2c56bf9640 1 --2- 172.21.15.66:0/956188652 >> v2:172.21.15.66:3300/0 conn(0x7f2c50160ad0 0x7f2c500b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.427 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.424+0000 7f2c56bf9640 1 -- 172.21.15.66:0/956188652 >> v1:172.21.15.66:6789/0 conn(0x7f2c500b2110 legacy=0x7f2c500cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.427 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.424+0000 7f2c56bf9640 1 -- 172.21.15.66:0/956188652 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c500d1f40 con 0x7f2c500d0240 2023-11-25T04:08:13.427 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.424+0000 7f2c563f8640 1 --2- 172.21.15.66:0/956188652 >> v2:172.21.15.66:3300/0 conn(0x7f2c50160ad0 0x7f2c500b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:13.428 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.425+0000 7f2c56bf9640 1 --2- 172.21.15.66:0/956188652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500d0240 0x7f2c500ce230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009d90 tx=0x7f2c4802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d20078daf212ed server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:13.429 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.425+0000 7f2c553f6640 1 -- 172.21.15.66:0/956188652 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4802cbc0 con 0x7f2c500d0240 2023-11-25T04:08:13.429 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.425+0000 7f2c553f6640 1 -- 172.21.15.66:0/956188652 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4802cd20 con 0x7f2c500d0240 2023-11-25T04:08:13.429 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.425+0000 7f2c553f6640 1 -- 172.21.15.66:0/956188652 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c48034660 con 0x7f2c500d0240 2023-11-25T04:08:13.429 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.426+0000 7f2c5865c640 1 -- 172.21.15.66:0/956188652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500d0240 msgr2=0x7f2c500ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.429 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.426+0000 7f2c5865c640 1 --2- 172.21.15.66:0/956188652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500d0240 0x7f2c500ce230 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f2c48009d90 tx=0x7f2c4802be10 comp rx=0 tx=0).stop 2023-11-25T04:08:13.430 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.426+0000 7f2c5865c640 1 -- 172.21.15.66:0/956188652 shutdown_connections 2023-11-25T04:08:13.430 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.426+0000 7f2c5865c640 1 --2- 172.21.15.66:0/956188652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500d0240 0x7f2c500ce230 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.430 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.426+0000 7f2c5865c640 1 --2- 172.21.15.66:0/956188652 >> v2:172.21.15.66:3300/0 conn(0x7f2c50160ad0 0x7f2c500b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.430 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.426+0000 7f2c5865c640 1 -- 172.21.15.66:0/956188652 >> 172.21.15.66:0/956188652 conn(0x7f2c5009c500 msgr2=0x7f2c500d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:13.430 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.426+0000 7f2c5865c640 1 -- 172.21.15.66:0/956188652 shutdown_connections 2023-11-25T04:08:13.431 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.426+0000 7f2c5865c640 1 -- 172.21.15.66:0/956188652 wait complete. 2023-11-25T04:08:13.433 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.427+0000 7f2c5865c640 1 Processor -- start 2023-11-25T04:08:13.434 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.427+0000 7f2c5865c640 1 -- start start 2023-11-25T04:08:13.434 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c5865c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500b2110 0x7f2c5015bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.434 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c5865c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c500d0240 0x7f2c501505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.434 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c5865c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c50160ad0 0x7f2c5015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.434 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c5865c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500cab00 con 0x7f2c50160ad0 2023-11-25T04:08:13.435 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c5865c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5015c1c0 con 0x7f2c500d0240 2023-11-25T04:08:13.435 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c5865c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c500b6800 con 0x7f2c500b2110 2023-11-25T04:08:13.435 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c563f8640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500b2110 0x7f2c5015bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.435 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c563f8640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500b2110 0x7f2c5015bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:58366/0 (socket says 172.21.15.66:58366) 2023-11-25T04:08:13.435 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c563f8640 1 -- 172.21.15.66:0/4214402001 learned_addr learned my addr 172.21.15.66:0/4214402001 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-11-25T04:08:13.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c55bf7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c500d0240 0x7f2c501505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c56bf9640 1 --2- 172.21.15.66:0/4214402001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c50160ad0 0x7f2c5015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c563f8640 1 -- 172.21.15.66:0/4214402001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c500d0240 msgr2=0x7f2c501505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c563f8640 1 --2- 172.21.15.66:0/4214402001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c500d0240 0x7f2c501505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.436 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c563f8640 1 -- 172.21.15.66:0/4214402001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c50160ad0 msgr2=0x7f2c5015aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.437 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c563f8640 1 --2- 172.21.15.66:0/4214402001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c50160ad0 0x7f2c5015aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.437 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c563f8640 1 -- 172.21.15.66:0/4214402001 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c400094d0 con 0x7f2c500b2110 2023-11-25T04:08:13.437 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.428+0000 7f2c56bf9640 1 --2- 172.21.15.66:0/4214402001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c50160ad0 0x7f2c5015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:13.437 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.429+0000 7f2c563f8640 1 --2- 172.21.15.66:0/4214402001 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500b2110 0x7f2c5015bc80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000e9e0 tx=0x7f2c4000eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:13.437 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.429+0000 7f2c46ffd640 1 -- 172.21.15.66:0/4214402001 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000c9d0 con 0x7f2c500b2110 2023-11-25T04:08:13.437 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.429+0000 7f2c46ffd640 1 -- 172.21.15.66:0/4214402001 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000cb30 con 0x7f2c500b2110 2023-11-25T04:08:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.429+0000 7f2c5865c640 1 -- 172.21.15.66:0/4214402001 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c48009a70 con 0x7f2c500b2110 2023-11-25T04:08:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.429+0000 7f2c46ffd640 1 -- 172.21.15.66:0/4214402001 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000cea0 con 0x7f2c500b2110 2023-11-25T04:08:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.429+0000 7f2c5865c640 1 -- 172.21.15.66:0/4214402001 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c50150af0 con 0x7f2c500b2110 2023-11-25T04:08:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.429+0000 7f2c46ffd640 1 -- 172.21.15.66:0/4214402001 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2c40005c90 con 0x7f2c500b2110 2023-11-25T04:08:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.429+0000 7f2c46ffd640 1 -- 172.21.15.66:0/4214402001 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2c40013ad0 con 0x7f2c500b2110 2023-11-25T04:08:13.438 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.430+0000 7f2c5865c640 1 -- 172.21.15.66:0/4214402001 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c500a11e0 con 0x7f2c500b2110 2023-11-25T04:08:13.439 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.432+0000 7f2c46ffd640 1 -- 172.21.15.66:0/4214402001 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2c40021060 con 0x7f2c500b2110 2023-11-25T04:08:13.448 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:13.446+0000 7f6353e12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-25T04:08:13.509 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.506+0000 7f2c5865c640 1 -- 172.21.15.66:0/4214402001 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ec16e94a-6184-41c7-8d89-d034f7a106a8", "id": 7} v 0) v1 -- 0x7f2c5004e920 con 0x7f2c500b2110 2023-11-25T04:08:13.514 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.511+0000 7f2c46ffd640 1 -- 172.21.15.66:0/4214402001 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ec16e94a-6184-41c7-8d89-d034f7a106a8", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2c40017070 con 0x7f2c500b2110 2023-11-25T04:08:13.514 INFO:teuthology.orchestra.run.smithi066.stdout:7 2023-11-25T04:08:13.515 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.512+0000 7f2c5865c640 1 -- 172.21.15.66:0/4214402001 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500b2110 msgr2=0x7f2c5015bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.512+0000 7f2c5865c640 1 --2- 172.21.15.66:0/4214402001 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500b2110 0x7f2c5015bc80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000e9e0 tx=0x7f2c4000eea0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.512+0000 7f2c5865c640 1 -- 172.21.15.66:0/4214402001 shutdown_connections 2023-11-25T04:08:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.512+0000 7f2c5865c640 1 --2- 172.21.15.66:0/4214402001 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c50160ad0 0x7f2c5015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.512+0000 7f2c5865c640 1 --2- 172.21.15.66:0/4214402001 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c500d0240 0x7f2c501505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.513+0000 7f2c5865c640 1 --2- 172.21.15.66:0/4214402001 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c500b2110 0x7f2c5015bc80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.516 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.513+0000 7f2c5865c640 1 -- 172.21.15.66:0/4214402001 >> 172.21.15.66:0/4214402001 conn(0x7f2c5009c500 msgr2=0x7f2c500b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:13.517 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.513+0000 7f2c5865c640 1 -- 172.21.15.66:0/4214402001 shutdown_connections 2023-11-25T04:08:13.517 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:13.513+0000 7f2c5865c640 1 -- 172.21.15.66:0/4214402001 wait complete. 2023-11-25T04:08:13.525 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-25T04:08:13.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-25T04:08:13.528 INFO:tasks.ceph.osd.0:Started 2023-11-25T04:08:13.528 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-25T04:08:13.528 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-25T04:08:13.530 INFO:tasks.ceph.osd.1:Started 2023-11-25T04:08:13.530 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-25T04:08:13.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-25T04:08:13.533 INFO:tasks.ceph.osd.2:Started 2023-11-25T04:08:13.533 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-25T04:08:13.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-25T04:08:13.535 INFO:tasks.ceph.osd.3:Started 2023-11-25T04:08:13.536 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-25T04:08:13.536 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-25T04:08:13.537 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:13.536+0000 7f5b27412040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-25T04:08:13.538 INFO:tasks.ceph.osd.4:Started 2023-11-25T04:08:13.538 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-25T04:08:13.538 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-25T04:08:13.540 INFO:tasks.ceph.osd.5:Started 2023-11-25T04:08:13.540 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-25T04:08:13.541 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-25T04:08:13.544 INFO:tasks.ceph.osd.6:Started 2023-11-25T04:08:13.544 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-25T04:08:13.544 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-25T04:08:13.546 INFO:tasks.ceph.osd.7:Started 2023-11-25T04:08:13.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:13.578 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:13.576+0000 7f6353e12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-25T04:08:13.616 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:13.614+0000 7f5b27412040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-25T04:08:13.650 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:13.648+0000 7f6353e12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-25T04:08:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.688+0000 7f2c02701640 1 Processor -- start 2023-11-25T04:08:13.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.688+0000 7f2c02701640 1 -- start start 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.688+0000 7f2c02701640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 0x7f2bfc0d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.688+0000 7f2c02701640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2bfc0b3db0 0x7f2bfc0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.688+0000 7f2c02701640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bfc0b5f90 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.688+0000 7f2c02701640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bfc0d20a0 con 0x7f2bfc0b3db0 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.688+0000 7f2c02701640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0b61e0 con 0x7f2bfc0d1720 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.689+0000 7f2c00c9e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2bfc0b3db0 0x7f2bfc0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.689+0000 7f2bfbfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2bfc15d3e0 0x7f2bfc0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:44994/0 (socket says 172.21.15.2:44994) 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.689+0000 7f2bfbfff640 1 -- 172.21.15.2:0/2653079964 learned_addr learned my addr 172.21.15.2:0/2653079964 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.689+0000 7f2bfb7fe640 1 --2- 172.21.15.2:0/2653079964 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 0x7f2bfc0d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.689+0000 7f2c00c9e640 1 -- 172.21.15.2:0/2653079964 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 msgr2=0x7f2bfc0d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:13.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.689+0000 7f2c00c9e640 1 --2- 172.21.15.2:0/2653079964 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 0x7f2bfc0d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.689+0000 7f2c00c9e640 1 -- 172.21.15.2:0/2653079964 >> v1:172.21.15.2:6789/0 conn(0x7f2bfc15d3e0 legacy=0x7f2bfc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.689+0000 7f2c00c9e640 1 -- 172.21.15.2:0/2653079964 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0b64c0 con 0x7f2bfc0b3db0 2023-11-25T04:08:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2c00c9e640 1 --2- 172.21.15.2:0/2653079964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc0b3db0 0x7f2bfc0b4240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009d90 tx=0x7f2bf402bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe0cf735926dfcb server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2bfaffd640 1 -- 172.21.15.2:0/2653079964 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf402ca10 con 0x7f2bfc0b3db0 2023-11-25T04:08:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2bfaffd640 1 -- 172.21.15.2:0/2653079964 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf402cb70 con 0x7f2bfc0b3db0 2023-11-25T04:08:13.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2bfaffd640 1 -- 172.21.15.2:0/2653079964 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4034440 con 0x7f2bfc0b3db0 2023-11-25T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2c02701640 1 -- 172.21.15.2:0/2653079964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc0b3db0 msgr2=0x7f2bfc0b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2c02701640 1 --2- 172.21.15.2:0/2653079964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc0b3db0 0x7f2bfc0b4240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009d90 tx=0x7f2bf402bce0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2c02701640 1 -- 172.21.15.2:0/2653079964 shutdown_connections 2023-11-25T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2c02701640 1 --2- 172.21.15.2:0/2653079964 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc0b3db0 0x7f2bfc0b4240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2c02701640 1 --2- 172.21.15.2:0/2653079964 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 0x7f2bfc0d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.690+0000 7f2c02701640 1 -- 172.21.15.2:0/2653079964 >> 172.21.15.2:0/2653079964 conn(0x7f2bfc09c480 msgr2=0x7f2bfc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:13.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.691+0000 7f2c02701640 1 -- 172.21.15.2:0/2653079964 shutdown_connections 2023-11-25T04:08:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.691+0000 7f2c02701640 1 -- 172.21.15.2:0/2653079964 wait complete. 2023-11-25T04:08:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.692+0000 7f2c02701640 1 Processor -- start 2023-11-25T04:08:13.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.692+0000 7f2c02701640 1 -- start start 2023-11-25T04:08:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c02701640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bfc0b3db0 0x7f2bfc0b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c02701640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 0x7f2bfc0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c02701640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc15d3e0 0x7f2bfc0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c02701640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc146100 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c02701640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc0cca80 con 0x7f2bfc0b3db0 2023-11-25T04:08:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c02701640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bfc1463a0 con 0x7f2bfc0d1720 2023-11-25T04:08:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2bfbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bfc0b3db0 0x7f2bfc0b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2bfb7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 0x7f2bfc0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2bfbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bfc0b3db0 0x7f2bfc0b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:59908/0 (socket says 172.21.15.2:59908) 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2bfbfff640 1 -- 172.21.15.2:0/969275192 learned_addr learned my addr 172.21.15.2:0/969275192 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c00c9e640 1 --2- 172.21.15.2:0/969275192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc15d3e0 0x7f2bfc0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c00c9e640 1 -- 172.21.15.2:0/969275192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 msgr2=0x7f2bfc0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c00c9e640 1 --2- 172.21.15.2:0/969275192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 0x7f2bfc0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c00c9e640 1 -- 172.21.15.2:0/969275192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bfc0b3db0 msgr2=0x7f2bfc0b3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c00c9e640 1 --2- 172.21.15.2:0/969275192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bfc0b3db0 0x7f2bfc0b3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.693+0000 7f2c00c9e640 1 -- 172.21.15.2:0/969275192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf4009a70 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.694+0000 7f2bfbfff640 1 --2- 172.21.15.2:0/969275192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bfc0b3db0 0x7f2bfc0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.694+0000 7f2c00c9e640 1 --2- 172.21.15.2:0/969275192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc15d3e0 0x7f2bfc0b02b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4033000 tx=0x7f2bf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.694+0000 7f2bf8ff9640 1 -- 172.21.15.2:0/969275192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4040650 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.694+0000 7f2bf8ff9640 1 -- 172.21.15.2:0/969275192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf40407b0 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.694+0000 7f2c02701640 1 -- 172.21.15.2:0/969275192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bfc146680 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.698 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.694+0000 7f2bf8ff9640 1 -- 172.21.15.2:0/969275192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4040b60 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.694+0000 7f2c02701640 1 -- 172.21.15.2:0/969275192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bfc0b3ac0 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.694+0000 7f2bf8ff9640 1 -- 172.21.15.2:0/969275192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2bf4049400 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.694+0000 7f2bf8ff9640 1 -- 172.21.15.2:0/969275192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2bf403ead0 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.695+0000 7f2c02701640 1 -- 172.21.15.2:0/969275192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bfc146ba0 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.701 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.699+0000 7f2bf8ff9640 1 -- 172.21.15.2:0/969275192 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2bf4067ce0 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.727 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:13.726+0000 7f5b27412040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-25T04:08:13.753 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:13.750+0000 7f6353e12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-25T04:08:13.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.760+0000 7f2c02701640 1 -- 172.21.15.2:0/969275192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bfc067420 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.761+0000 7f2bf8ff9640 1 -- 172.21.15.2:0/969275192 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2bf4056030 con 0x7f2bfc15d3e0 2023-11-25T04:08:13.763 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:13.763 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:13.508344+0000","last_up_change":"0.000000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.762+0000 7f2c02701640 1 -- 172.21.15.2:0/969275192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc15d3e0 msgr2=0x7f2bfc0b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.762+0000 7f2c02701640 1 --2- 172.21.15.2:0/969275192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc15d3e0 0x7f2bfc0b02b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4033000 tx=0x7f2bf4004a40 comp rx=0 tx=0).stop 2023-11-25T04:08:13.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.762+0000 7f2c02701640 1 -- 172.21.15.2:0/969275192 shutdown_connections 2023-11-25T04:08:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.762+0000 7f2c02701640 1 --2- 172.21.15.2:0/969275192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2bfc15d3e0 0x7f2bfc0b02b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.762+0000 7f2c02701640 1 --2- 172.21.15.2:0/969275192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bfc0d1720 0x7f2bfc0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.762+0000 7f2c02701640 1 --2- 172.21.15.2:0/969275192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bfc0b3db0 0x7f2bfc0b3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.762+0000 7f2c02701640 1 -- 172.21.15.2:0/969275192 >> 172.21.15.2:0/969275192 conn(0x7f2bfc09c480 msgr2=0x7f2bfc06b140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.762+0000 7f2c02701640 1 -- 172.21.15.2:0/969275192 shutdown_connections 2023-11-25T04:08:13.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:13.762+0000 7f2c02701640 1 -- 172.21.15.2:0/969275192 wait complete. 2023-11-25T04:08:13.779 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-25T04:08:13.779 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-25T04:08:13.828 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:13.826+0000 7f5b27412040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-25T04:08:13.850 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:13.848+0000 7f6353e12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-25T04:08:13.975 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:13.973+0000 7f5b27412040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-25T04:08:13.996 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:13.994+0000 7f6353e12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-25T04:08:14.019 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:14.017+0000 7f5b27412040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-25T04:08:14.040 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:14.038+0000 7f6353e12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-25T04:08:14.134 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T04:08:14.132+0000 7fa333611500 -1 Falling back to public interface 2023-11-25T04:08:14.143 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T04:08:14.141+0000 7f729ca18500 -1 Falling back to public interface 2023-11-25T04:08:14.144 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T04:08:14.141+0000 7f2502838500 -1 Falling back to public interface 2023-11-25T04:08:14.144 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T04:08:14.142+0000 7f468d210500 -1 Falling back to public interface 2023-11-25T04:08:14.150 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T04:08:14.148+0000 7f36e7614500 -1 Falling back to public interface 2023-11-25T04:08:14.166 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T04:08:14.161+0000 7ff002816500 -1 Falling back to public interface 2023-11-25T04:08:14.166 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T04:08:14.162+0000 7fc611620500 -1 Falling back to public interface 2023-11-25T04:08:14.167 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:14.164+0000 7f5b27412040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-25T04:08:14.167 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T04:08:14.163+0000 7f82c86a7500 -1 Falling back to public interface 2023-11-25T04:08:14.194 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:14.191+0000 7f6353e12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-25T04:08:14.585 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:14.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.675+0000 7fa52771d640 1 Processor -- start 2023-11-25T04:08:14.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.676+0000 7fa52771d640 1 -- start start 2023-11-25T04:08:14.681 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.676+0000 7fa52771d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa52015d550 0x7fa5200d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:14.681 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.676+0000 7fa52771d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5200b3120 con 0x7fa5200d3a10 2023-11-25T04:08:14.681 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.676+0000 7fa52771d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5200d1d00 con 0x7fa5200d0240 2023-11-25T04:08:14.681 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.676+0000 7fa52771d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52015d930 con 0x7fa52015d550 2023-11-25T04:08:14.681 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa524cb8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa5200d3a10 0x7fa5200cfb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:45002/0 (socket says 172.21.15.2:45002) 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa524cb8640 1 -- 172.21.15.2:0/3735578462 learned_addr learned my addr 172.21.15.2:0/3735578462 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846847165 0 0) 0x7fa5200b3120 con 0x7fa5200d3a10 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa5254b9640 1 --2- 172.21.15.2:0/3735578462 >> v2:172.21.15.66:3300/0 conn(0x7fa52015d550 0x7fa5200d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa50c003520 con 0x7fa5200d3a10 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1744648305 0 0) 0x7fa50c003520 con 0x7fa5200d3a10 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 >> v2:172.21.15.66:3300/0 conn(0x7fa52015d550 msgr2=0x7fa5200d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 --2- 172.21.15.2:0/3735578462 >> v2:172.21.15.66:3300/0 conn(0x7fa52015d550 0x7fa5200d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 >> v1:172.21.15.66:6789/0 conn(0x7fa5200d0240 legacy=0x7fa5200b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5200b2ad0 con 0x7fa5200d3a10 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7fa51c001670 con 0x7fa5200d3a10 2023-11-25T04:08:14.682 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 >> v1:172.21.15.2:6789/0 conn(0x7fa5200d3a10 legacy=0x7fa5200cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa50c003970 0x7fa50c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c0047c0 0x7fa50c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa50c005180 0x7fa50c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52015d930 con 0x7fa50c005180 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c00c020 con 0x7fa50c0047c0 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c00c1e0 con 0x7fa50c003970 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa525cba640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa50c005180 0x7fa50c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa5254b9640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa50c003970 0x7fa50c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.677+0000 7fa524cb8640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c0047c0 0x7fa50c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.678+0000 7fa525cba640 1 -- 172.21.15.2:0/3735578462 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa50c003970 msgr2=0x7fa50c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:14.683 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.678+0000 7fa525cba640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa50c003970 0x7fa50c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.678+0000 7fa525cba640 1 -- 172.21.15.2:0/3735578462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c0047c0 msgr2=0x7fa50c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.678+0000 7fa525cba640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c0047c0 0x7fa50c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.678+0000 7fa525cba640 1 -- 172.21.15.2:0/3735578462 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c003520 con 0x7fa50c005180 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.678+0000 7fa525cba640 1 -- 172.21.15.2:0/3735578462 reap_dead start 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.678+0000 7fa525cba640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa50c005180 0x7fa50c00b980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa518001e20 tx=0x7fa50c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a043fd811e62fbdf server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518003b70 con 0x7fa50c005180 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518003cd0 con 0x7fa50c005180 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa517fff640 1 -- 172.21.15.2:0/3735578462 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa518005310 con 0x7fa50c005180 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa52771d640 1 -- 172.21.15.2:0/3735578462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa50c005180 msgr2=0x7fa50c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa52771d640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa50c005180 0x7fa50c00b980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa518001e20 tx=0x7fa50c0057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa52771d640 1 -- 172.21.15.2:0/3735578462 shutdown_connections 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa52771d640 1 --2- 172.21.15.2:0/3735578462 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa50c005180 0x7fa50c00b980 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.684 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa52771d640 1 -- 172.21.15.2:0/3735578462 >> 172.21.15.2:0/3735578462 conn(0x7fa52009c480 msgr2=0x7fa5200d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:14.685 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa52771d640 1 -- 172.21.15.2:0/3735578462 shutdown_connections 2023-11-25T04:08:14.685 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.679+0000 7fa52771d640 1 -- 172.21.15.2:0/3735578462 wait complete. 2023-11-25T04:08:14.687 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.680+0000 7fa52771d640 1 Processor -- start 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.680+0000 7fa52771d640 1 -- start start 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa52771d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c005180 0x7fa5200b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa52771d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa52015e4c0 0x7fa5201f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa52771d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa52015e940 0x7fa52015eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa52771d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52015da70 con 0x7fa52015e4c0 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa52771d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5201f34f0 con 0x7fa50c005180 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa52771d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5201f37d0 con 0x7fa52015e940 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa524cb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa52015e4c0 0x7fa5201f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa5254b9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c005180 0x7fa5200b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa524cb8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa52015e4c0 0x7fa5201f29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44486/0 (socket says 172.21.15.2:44486) 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa524cb8640 1 -- 172.21.15.2:0/589809679 learned_addr learned my addr 172.21.15.2:0/589809679 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:14.688 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.681+0000 7fa525cba640 1 --2- 172.21.15.2:0/589809679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa52015e940 0x7fa52015eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa5254b9640 1 -- 172.21.15.2:0/589809679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa52015e940 msgr2=0x7fa52015eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa5254b9640 1 --2- 172.21.15.2:0/589809679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa52015e940 0x7fa52015eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa5254b9640 1 -- 172.21.15.2:0/589809679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa52015e4c0 msgr2=0x7fa5201f29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa5254b9640 1 --2- 172.21.15.2:0/589809679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa52015e4c0 0x7fa5201f29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa5254b9640 1 -- 172.21.15.2:0/589809679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52015dcc0 con 0x7fa50c005180 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa524cb8640 1 --2- 172.21.15.2:0/589809679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa52015e4c0 0x7fa5201f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa5254b9640 1 --2- 172.21.15.2:0/589809679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c005180 0x7fa5200b40a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa510011960 tx=0x7fa510011d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa515ffb640 1 -- 172.21.15.2:0/589809679 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51000fa30 con 0x7fa50c005180 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa515ffb640 1 -- 172.21.15.2:0/589809679 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51000fb90 con 0x7fa50c005180 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa52771d640 1 -- 172.21.15.2:0/589809679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52015dfa0 con 0x7fa50c005180 2023-11-25T04:08:14.689 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa515ffb640 1 -- 172.21.15.2:0/589809679 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa510014440 con 0x7fa50c005180 2023-11-25T04:08:14.690 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa52771d640 1 -- 172.21.15.2:0/589809679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5200b45e0 con 0x7fa50c005180 2023-11-25T04:08:14.690 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa515ffb640 1 -- 172.21.15.2:0/589809679 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa5100148a0 con 0x7fa50c005180 2023-11-25T04:08:14.690 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.682+0000 7fa515ffb640 1 -- 172.21.15.2:0/589809679 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fa51001dd00 con 0x7fa50c005180 2023-11-25T04:08:14.690 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.683+0000 7fa52771d640 1 -- 172.21.15.2:0/589809679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5201f3990 con 0x7fa50c005180 2023-11-25T04:08:14.690 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.685+0000 7fa515ffb640 1 -- 172.21.15.2:0/589809679 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa51003cce0 con 0x7fa50c005180 2023-11-25T04:08:14.749 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.748+0000 7fa52771d640 1 -- 172.21.15.2:0/589809679 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa520067420 con 0x7fa50c005180 2023-11-25T04:08:14.750 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.748+0000 7fa515ffb640 1 -- 172.21.15.2:0/589809679 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fa51002b030 con 0x7fa50c005180 2023-11-25T04:08:14.750 INFO:teuthology.misc.health.smithi002.stdout: 2023-11-25T04:08:14.750 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":10,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:13.508344+0000","last_up_change":"0.000000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:14.752 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.749+0000 7fa52771d640 1 -- 172.21.15.2:0/589809679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c005180 msgr2=0x7fa5200b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:14.752 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.749+0000 7fa52771d640 1 --2- 172.21.15.2:0/589809679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c005180 0x7fa5200b40a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa510011960 tx=0x7fa510011d60 comp rx=0 tx=0).stop 2023-11-25T04:08:14.752 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.749+0000 7fa52771d640 1 -- 172.21.15.2:0/589809679 shutdown_connections 2023-11-25T04:08:14.752 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.749+0000 7fa52771d640 1 --2- 172.21.15.2:0/589809679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa52015e940 0x7fa52015eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.752 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.749+0000 7fa52771d640 1 --2- 172.21.15.2:0/589809679 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa52015e4c0 0x7fa5201f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.752 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.749+0000 7fa52771d640 1 --2- 172.21.15.2:0/589809679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa50c005180 0x7fa5200b40a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:14.752 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.749+0000 7fa52771d640 1 -- 172.21.15.2:0/589809679 >> 172.21.15.2:0/589809679 conn(0x7fa52009c480 msgr2=0x7fa5200b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:14.752 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.750+0000 7fa52771d640 1 -- 172.21.15.2:0/589809679 shutdown_connections 2023-11-25T04:08:14.752 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:14.750+0000 7fa52771d640 1 -- 172.21.15.2:0/589809679 wait complete. 2023-11-25T04:08:14.761 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-25T04:08:15.014 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:15.012+0000 7f5b27412040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-25T04:08:15.154 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:15.151+0000 7f6353e12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-25T04:08:15.299 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:15.297+0000 7f5b27412040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-25T04:08:15.352 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:15.350+0000 7f5b27412040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-25T04:08:15.436 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:15.434+0000 7f6353e12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-25T04:08:15.457 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:15.455+0000 7f5b27412040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-25T04:08:15.491 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:15.488+0000 7f6353e12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-25T04:08:15.597 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-11-25T04:08:15.595+0000 7f6353e12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-25T04:08:16.482 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:16.480+0000 7f5ac839c640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-25T04:08:16.483 INFO:tasks.ceph.mgr.y.smithi002.stderr:2023-11-25T04:08:16.481+0000 7f5ac839c640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-25T04:08:17.585 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T04:08:17.583+0000 7f468d210500 -1 osd.6 0 log_to_monitors true 2023-11-25T04:08:17.638 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T04:08:17.637+0000 7fa333611500 -1 osd.0 0 log_to_monitors true 2023-11-25T04:08:17.651 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T04:08:17.650+0000 7f729ca18500 -1 osd.1 0 log_to_monitors true 2023-11-25T04:08:17.657 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T04:08:17.655+0000 7f2502838500 -1 osd.5 0 log_to_monitors true 2023-11-25T04:08:17.664 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T04:08:17.662+0000 7f36e7614500 -1 osd.7 0 log_to_monitors true 2023-11-25T04:08:17.665 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T04:08:17.663+0000 7f82c86a7500 -1 osd.4 0 log_to_monitors true 2023-11-25T04:08:17.674 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T04:08:17.673+0000 7ff002816500 -1 osd.2 0 log_to_monitors true 2023-11-25T04:08:17.692 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T04:08:17.690+0000 7fc611620500 -1 osd.3 0 log_to_monitors true 2023-11-25T04:08:20.978 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T04:08:20.977+0000 7f7297ac3640 -1 osd.1 0 waiting for initial osdmap 2023-11-25T04:08:20.993 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T04:08:20.992+0000 7f72900fc640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-25T04:08:21.014 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T04:08:21.013+0000 7fa32e69d640 -1 osd.0 0 waiting for initial osdmap 2023-11-25T04:08:21.023 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T04:08:21.022+0000 7feffd95b640 -1 osd.2 0 waiting for initial osdmap 2023-11-25T04:08:21.023 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T04:08:21.023+0000 7fa326cd6640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-25T04:08:21.035 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T04:08:21.035+0000 7fc60c742640 -1 osd.3 0 waiting for initial osdmap 2023-11-25T04:08:21.039 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T04:08:21.039+0000 7feff5f94640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-25T04:08:21.059 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T04:08:21.058+0000 7fc604d7b640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-25T04:08:21.527 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T04:08:21.525+0000 7f468897b640 -1 osd.6 0 waiting for initial osdmap 2023-11-25T04:08:21.544 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T04:08:21.542+0000 7f4680fb4640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-25T04:08:21.570 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:21.627 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T04:08:21.624+0000 7f36e271f640 -1 osd.7 0 waiting for initial osdmap 2023-11-25T04:08:21.646 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T04:08:21.644+0000 7f24fdfa3640 -1 osd.5 0 waiting for initial osdmap 2023-11-25T04:08:21.646 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T04:08:21.644+0000 7f36dad58640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-25T04:08:21.655 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T04:08:21.653+0000 7f82c3e12640 -1 osd.4 0 waiting for initial osdmap 2023-11-25T04:08:21.658 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T04:08:21.656+0000 7f24f65dc640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-25T04:08:21.663 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T04:08:21.661+0000 7f82bc44b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-25T04:08:21.667 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.666+0000 7f727d290640 1 Processor -- start 2023-11-25T04:08:21.667 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.666+0000 7f727d290640 1 -- start start 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.667+0000 7f727d290640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 0x7f727815e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.667+0000 7f727d290640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f727806ee80 0x7f72780cb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.667+0000 7f727d290640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727806ffd0 con 0x7f72780cce70 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.667+0000 7f727d290640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727815e860 con 0x7f727806ee80 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.667+0000 7f727d290640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72780cf420 con 0x7f7278070d00 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.667+0000 7f72777fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f727806ee80 0x7f72780cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.667+0000 7f72777fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f727806ee80 0x7f72780cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59486/0 (socket says 172.21.15.2:59486) 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.667+0000 7f72767fc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 0x7f727815e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.667+0000 7f72777fe640 1 -- 172.21.15.2:0/3857374926 learned_addr learned my addr 172.21.15.2:0/3857374926 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.668+0000 7f72777fe640 1 -- 172.21.15.2:0/3857374926 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 msgr2=0x7f727815e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:21.669 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.668+0000 7f7275ffb640 1 -- 172.21.15.2:0/3857374926 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469063346 0 0) 0x7f727806ffd0 con 0x7f72780cce70 2023-11-25T04:08:21.670 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.668+0000 7f72777fe640 1 --2- 172.21.15.2:0/3857374926 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 0x7f727815e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:21.670 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.668+0000 7f72777fe640 1 -- 172.21.15.2:0/3857374926 >> v1:172.21.15.66:6789/0 conn(0x7f72780cce70 legacy=0x7f727806e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:21.670 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.668+0000 7f72777fe640 1 -- 172.21.15.2:0/3857374926 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278070870 con 0x7f727806ee80 2023-11-25T04:08:21.671 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.668+0000 7f72777fe640 1 --2- 172.21.15.2:0/3857374926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727806ee80 0x7f72780cb600 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7268009e50 tx=0x7f726802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e30649c1da2204 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:21.671 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f7275ffb640 1 -- 172.21.15.2:0/3857374926 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726802cb00 con 0x7f727806ee80 2023-11-25T04:08:21.671 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f7275ffb640 1 -- 172.21.15.2:0/3857374926 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726802cc60 con 0x7f727806ee80 2023-11-25T04:08:21.671 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f7275ffb640 1 -- 172.21.15.2:0/3857374926 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72680343f0 con 0x7f727806ee80 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f727d290640 1 -- 172.21.15.2:0/3857374926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727806ee80 msgr2=0x7f72780cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f727d290640 1 --2- 172.21.15.2:0/3857374926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727806ee80 0x7f72780cb600 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7268009e50 tx=0x7f726802bf60 comp rx=0 tx=0).stop 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f727d290640 1 -- 172.21.15.2:0/3857374926 shutdown_connections 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f727d290640 1 --2- 172.21.15.2:0/3857374926 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f727806ee80 0x7f72780cb600 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f727d290640 1 --2- 172.21.15.2:0/3857374926 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 0x7f727815e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f727d290640 1 -- 172.21.15.2:0/3857374926 >> 172.21.15.2:0/3857374926 conn(0x7f72780b2b80 msgr2=0x7f72780b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f727d290640 1 -- 172.21.15.2:0/3857374926 shutdown_connections 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.669+0000 7f727d290640 1 -- 172.21.15.2:0/3857374926 wait complete. 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f727d290640 1 Processor -- start 2023-11-25T04:08:21.672 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f727d290640 1 -- start start 2023-11-25T04:08:21.677 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f727d290640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f727806ee80 0x7f72780c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:21.677 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f727d290640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 0x7f72780c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:21.677 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f727d290640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72780cce70 0x7f727815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:21.677 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f727d290640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7278156960 con 0x7f72780cce70 2023-11-25T04:08:21.677 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f727d290640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7278156c40 con 0x7f727806ee80 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f727d290640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7278156f20 con 0x7f7278070d00 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f72777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72780cce70 0x7f727815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f72777fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72780cce70 0x7f727815d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:59498/0 (socket says 172.21.15.2:59498) 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.671+0000 7f72777fe640 1 -- 172.21.15.2:0/1699491189 learned_addr learned my addr 172.21.15.2:0/1699491189 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f7276ffd640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f727806ee80 0x7f72780c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f72767fc640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 0x7f72780c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f72777fe640 1 -- 172.21.15.2:0/1699491189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 msgr2=0x7f72780c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f72777fe640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 0x7f72780c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f72777fe640 1 -- 172.21.15.2:0/1699491189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f727806ee80 msgr2=0x7f72780c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f72777fe640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f727806ee80 0x7f72780c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:21.678 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f72777fe640 1 -- 172.21.15.2:0/1699491189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7268009b30 con 0x7f72780cce70 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f72777fe640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72780cce70 0x7f727815d420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7268036040 tx=0x7f7268004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f726f7fe640 1 -- 172.21.15.2:0/1699491189 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7268009510 con 0x7f72780cce70 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f726f7fe640 1 -- 172.21.15.2:0/1699491189 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726803e450 con 0x7f72780cce70 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f726f7fe640 1 -- 172.21.15.2:0/1699491189 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726803e7e0 con 0x7f72780cce70 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7278157200 con 0x7f72780cce70 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.672+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72781577c0 con 0x7f72780cce70 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.673+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7278068400 con 0x7f72780cce70 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.674+0000 7f726f7fe640 1 -- 172.21.15.2:0/1699491189 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f726803e940 con 0x7f72780cce70 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.674+0000 7f726f7fe640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f725806adb0 0x7f725806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.674+0000 7f7276ffd640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f725806adb0 0x7f725806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:21.679 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.674+0000 7f726f7fe640 1 -- 172.21.15.2:0/1699491189 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f72680ab330 con 0x7f72780cce70 2023-11-25T04:08:21.680 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.675+0000 7f7276ffd640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f725806adb0 0x7f725806d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7270000f60 tx=0x7f7270009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:21.680 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.679+0000 7f726f7fe640 1 -- 172.21.15.2:0/1699491189 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7268077300 con 0x7f72780cce70 2023-11-25T04:08:21.857 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.856+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72780b3980 con 0x7f72780cce70 2023-11-25T04:08:21.857 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.857+0000 7f726f7fe640 1 -- 172.21.15.2:0/1699491189 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f726807a920 con 0x7f72780cce70 2023-11-25T04:08:21.858 INFO:teuthology.misc.health.smithi002.stdout: 2023-11-25T04:08:21.858 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":12,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:19.483431+0000","last_up_change":"0.000000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:21.863 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f725806adb0 msgr2=0x7f725806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:21.863 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f725806adb0 0x7f725806d270 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7270000f60 tx=0x7f7270009040 comp rx=0 tx=0).stop 2023-11-25T04:08:21.863 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72780cce70 msgr2=0x7f727815d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:21.863 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72780cce70 0x7f727815d420 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7268036040 tx=0x7f7268004a40 comp rx=0 tx=0).stop 2023-11-25T04:08:21.863 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 shutdown_connections 2023-11-25T04:08:21.863 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f72780cce70 0x7f727815d420 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:21.863 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7278070d00 0x7f72780c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:21.864 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f725806adb0 0x7f725806d270 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:21.864 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 --2- 172.21.15.2:0/1699491189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f727806ee80 0x7f72780c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:21.864 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 >> 172.21.15.2:0/1699491189 conn(0x7f72780b2b80 msgr2=0x7f72780b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:21.864 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 shutdown_connections 2023-11-25T04:08:21.864 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:21.859+0000 7f727d290640 1 -- 172.21.15.2:0/1699491189 wait complete. 2023-11-25T04:08:21.869 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-25T04:08:28.675 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:28.780 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.777+0000 7fbf4a583640 1 Processor -- start 2023-11-25T04:08:28.780 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.777+0000 7fbf4a583640 1 -- start start 2023-11-25T04:08:28.791 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf4a583640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbf440d17a0 0x7fbf440d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:28.792 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf4a583640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbf4415d670 0x7fbf440d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:28.792 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf4a583640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf440d12d0 0x7fbf440c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:28.792 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf4a583640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440cea30 con 0x7fbf440d17a0 2023-11-25T04:08:28.792 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf4a583640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf440ce090 con 0x7fbf4415d670 2023-11-25T04:08:28.793 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf4a583640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440ce370 con 0x7fbf440d12d0 2023-11-25T04:08:28.793 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf43fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbf440d17a0 0x7fbf440d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:28.793 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf43fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbf440d17a0 0x7fbf440d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57658/0 (socket says 172.21.15.2:57658) 2023-11-25T04:08:28.793 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf43fff640 1 -- 172.21.15.2:0/2680481623 learned_addr learned my addr 172.21.15.2:0/2680481623 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:28.793 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf437fe640 1 --2- 172.21.15.2:0/2680481623 >> v2:172.21.15.66:3300/0 conn(0x7fbf4415d670 0x7fbf440d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:28.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf48b20640 1 --2- 172.21.15.2:0/2680481623 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf440d12d0 0x7fbf440c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:28.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf43fff640 1 -- 172.21.15.2:0/2680481623 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf440d12d0 msgr2=0x7fbf440c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:28.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf43fff640 1 --2- 172.21.15.2:0/2680481623 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf440d12d0 0x7fbf440c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf43fff640 1 -- 172.21.15.2:0/2680481623 >> v2:172.21.15.66:3300/0 conn(0x7fbf4415d670 msgr2=0x7fbf440d0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:28.794 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf43fff640 1 --2- 172.21.15.2:0/2680481623 >> v2:172.21.15.66:3300/0 conn(0x7fbf4415d670 0x7fbf440d0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf43fff640 1 -- 172.21.15.2:0/2680481623 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf440ce650 con 0x7fbf440d17a0 2023-11-25T04:08:28.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.778+0000 7fbf437fe640 1 --2- 172.21.15.2:0/2680481623 >> v2:172.21.15.66:3300/0 conn(0x7fbf4415d670 0x7fbf440d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:28.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.779+0000 7fbf43fff640 1 --2- 172.21.15.2:0/2680481623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 0x7fbf440d1b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbf4408d4d0 tx=0x7fbf3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731dd1d408ffe19b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:28.795 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.779+0000 7fbf42ffd640 1 -- 172.21.15.2:0/2680481623 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34031870 con 0x7fbf440d17a0 2023-11-25T04:08:28.796 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.779+0000 7fbf42ffd640 1 -- 172.21.15.2:0/2680481623 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf340319d0 con 0x7fbf440d17a0 2023-11-25T04:08:28.797 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.779+0000 7fbf42ffd640 1 -- 172.21.15.2:0/2680481623 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf34031d60 con 0x7fbf440d17a0 2023-11-25T04:08:28.797 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.780+0000 7fbf4a583640 1 -- 172.21.15.2:0/2680481623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 msgr2=0x7fbf440d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:28.797 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.780+0000 7fbf4a583640 1 --2- 172.21.15.2:0/2680481623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 0x7fbf440d1b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbf4408d4d0 tx=0x7fbf3402b910 comp rx=0 tx=0).stop 2023-11-25T04:08:28.797 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.780+0000 7fbf4a583640 1 -- 172.21.15.2:0/2680481623 shutdown_connections 2023-11-25T04:08:28.797 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.780+0000 7fbf4a583640 1 --2- 172.21.15.2:0/2680481623 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf440d12d0 0x7fbf440c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.798 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.780+0000 7fbf4a583640 1 --2- 172.21.15.2:0/2680481623 >> v2:172.21.15.66:3300/0 conn(0x7fbf4415d670 0x7fbf440d0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.798 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.780+0000 7fbf4a583640 1 --2- 172.21.15.2:0/2680481623 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 0x7fbf440d1b80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.798 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.780+0000 7fbf4a583640 1 -- 172.21.15.2:0/2680481623 >> 172.21.15.2:0/2680481623 conn(0x7fbf4409c490 msgr2=0x7fbf440d31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:28.798 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.780+0000 7fbf4a583640 1 -- 172.21.15.2:0/2680481623 shutdown_connections 2023-11-25T04:08:28.799 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.780+0000 7fbf4a583640 1 -- 172.21.15.2:0/2680481623 wait complete. 2023-11-25T04:08:28.799 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.781+0000 7fbf4a583640 1 Processor -- start 2023-11-25T04:08:28.799 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.781+0000 7fbf4a583640 1 -- start start 2023-11-25T04:08:28.799 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf4a583640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf440d12d0 0x7fbf4415f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:28.799 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf4a583640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 0x7fbf4415f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:28.799 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf4a583640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf4415d670 0x7fbf440b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:28.801 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf4a583640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440b6c80 con 0x7fbf440d17a0 2023-11-25T04:08:28.801 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf4a583640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440b7960 con 0x7fbf440d12d0 2023-11-25T04:08:28.801 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf4a583640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf440b7c40 con 0x7fbf4415d670 2023-11-25T04:08:28.801 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 0x7fbf4415f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:28.801 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf437fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 0x7fbf4415f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57662/0 (socket says 172.21.15.2:57662) 2023-11-25T04:08:28.801 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf437fe640 1 -- 172.21.15.2:0/1731529125 learned_addr learned my addr 172.21.15.2:0/1731529125 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:28.801 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf48b20640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf4415d670 0x7fbf440b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:28.802 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.782+0000 7fbf43fff640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf440d12d0 0x7fbf4415f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:28.802 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf437fe640 1 -- 172.21.15.2:0/1731529125 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf4415d670 msgr2=0x7fbf440b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:28.802 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf437fe640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf4415d670 0x7fbf440b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.802 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf437fe640 1 -- 172.21.15.2:0/1731529125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf440d12d0 msgr2=0x7fbf4415f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:28.802 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf437fe640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf440d12d0 0x7fbf4415f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.802 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf437fe640 1 -- 172.21.15.2:0/1731529125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf340094d0 con 0x7fbf440d17a0 2023-11-25T04:08:28.802 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf437fe640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 0x7fbf4415f5d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00d800 tx=0x7fbf2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:28.802 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf40ff9640 1 -- 172.21.15.2:0/1731529125 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c004030 con 0x7fbf440d17a0 2023-11-25T04:08:28.802 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf40ff9640 1 -- 172.21.15.2:0/1731529125 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2c004190 con 0x7fbf440d17a0 2023-11-25T04:08:28.803 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf440b7f20 con 0x7fbf440d17a0 2023-11-25T04:08:28.803 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf40ff9640 1 -- 172.21.15.2:0/1731529125 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2c004520 con 0x7fbf440d17a0 2023-11-25T04:08:28.803 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.783+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf440b8720 con 0x7fbf440d17a0 2023-11-25T04:08:28.803 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.784+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf440b88e0 con 0x7fbf440d17a0 2023-11-25T04:08:28.803 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.785+0000 7fbf40ff9640 1 -- 172.21.15.2:0/1731529125 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf2c0096a0 con 0x7fbf440d17a0 2023-11-25T04:08:28.803 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.785+0000 7fbf40ff9640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbf2406ae40 0x7fbf2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:28.803 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.785+0000 7fbf40ff9640 1 -- 172.21.15.2:0/1731529125 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbf2c0892a0 con 0x7fbf440d17a0 2023-11-25T04:08:28.803 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.785+0000 7fbf43fff640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbf2406ae40 0x7fbf2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:28.803 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.786+0000 7fbf43fff640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbf2406ae40 0x7fbf2406d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbf34036000 tx=0x7fbf3403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:28.804 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.790+0000 7fbf40ff9640 1 -- 172.21.15.2:0/1731529125 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf2c054750 con 0x7fbf440d17a0 2023-11-25T04:08:28.969 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.966+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf44067420 con 0x7fbf440d17a0 2023-11-25T04:08:28.969 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.967+0000 7fbf40ff9640 1 -- 172.21.15.2:0/1731529125 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12742 (secure 0 0 0) 0x7fbf2c057d70 con 0x7fbf440d17a0 2023-11-25T04:08:28.970 INFO:teuthology.misc.health.smithi002.stdout: 2023-11-25T04:08:28.970 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":16,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:25.549970+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:28.971 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbf2406ae40 msgr2=0x7fbf2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:28.971 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbf2406ae40 0x7fbf2406d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbf34036000 tx=0x7fbf3403c040 comp rx=0 tx=0).stop 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 msgr2=0x7fbf4415f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 0x7fbf4415f5d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbf2c00d800 tx=0x7fbf2c00dcc0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 shutdown_connections 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf4415d670 0x7fbf440b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbf440d17a0 0x7fbf4415f5d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbf2406ae40 0x7fbf2406d300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 --2- 172.21.15.2:0/1731529125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf440d12d0 0x7fbf4415f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 >> 172.21.15.2:0/1731529125 conn(0x7fbf4409c490 msgr2=0x7fbf440c7da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 shutdown_connections 2023-11-25T04:08:28.972 INFO:teuthology.misc.health.smithi002.stderr:2023-11-25T04:08:28.969+0000 7fbf4a583640 1 -- 172.21.15.2:0/1731529125 wait complete. 2023-11-25T04:08:28.981 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-25T04:08:28.981 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-25T04:08:28.982 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-25T04:08:28.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-25T04:08:28.987 INFO:tasks.ceph.mds.a:Started 2023-11-25T04:08:28.987 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-25T04:08:28.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-25T04:08:28.989 INFO:tasks.ceph.mds.c:Started 2023-11-25T04:08:28.990 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-25T04:08:28.990 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-25T04:08:28.993 INFO:tasks.ceph.mds.b:Started 2023-11-25T04:08:28.993 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-25T04:08:28.993 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-25T04:08:28.998 INFO:tasks.ceph.mds.d:Started 2023-11-25T04:08:28.999 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-25T04:08:28.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:29.066 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-25T04:08:29.069 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-25T04:08:29.085 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2023-11-25T04:08:29.089 INFO:tasks.ceph.mds.d.smithi066.stdout:starting mds.d at 2023-11-25T04:08:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.107+0000 7fcefbb53640 1 Processor -- start 2023-11-25T04:08:29.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.107+0000 7fcefbb53640 1 -- start start 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcefbb53640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcef415a1a0 0x7fcef40cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcefbb53640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40af420 0x7fcef40ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcefbb53640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcef40cec80 0x7fcef40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcefbb53640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40cf0f0 con 0x7fcef415a1a0 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcefbb53640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40ce500 con 0x7fcef40cec80 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcefbb53640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef415a580 con 0x7fcef40af420 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcef98ef640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcef415a1a0 0x7fcef40cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcef90ee640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40af420 0x7fcef40ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcefa0f0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcef40cec80 0x7fcef40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcef90ee640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40af420 0x7fcef40ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:42286/0 (socket says 172.21.15.2:42286) 2023-11-25T04:08:29.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.108+0000 7fcef90ee640 1 -- 172.21.15.2:0/318646752 learned_addr learned my addr 172.21.15.2:0/318646752 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:29.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.109+0000 7fcef90ee640 1 -- 172.21.15.2:0/318646752 >> v2:172.21.15.66:3300/0 conn(0x7fcef40cec80 msgr2=0x7fcef40cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:29.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.109+0000 7fcef90ee640 1 --2- 172.21.15.2:0/318646752 >> v2:172.21.15.66:3300/0 conn(0x7fcef40cec80 0x7fcef40cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.109+0000 7fcef90ee640 1 -- 172.21.15.2:0/318646752 >> v2:172.21.15.2:3300/0 conn(0x7fcef415a1a0 msgr2=0x7fcef40cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:29.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.109+0000 7fcef90ee640 1 --2- 172.21.15.2:0/318646752 >> v2:172.21.15.2:3300/0 conn(0x7fcef415a1a0 0x7fcef40cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.109+0000 7fcef90ee640 1 -- 172.21.15.2:0/318646752 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef40ce220 con 0x7fcef40af420 2023-11-25T04:08:29.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.109+0000 7fcef98ef640 1 --2- 172.21.15.2:0/318646752 >> v2:172.21.15.2:3300/0 conn(0x7fcef415a1a0 0x7fcef40cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:29.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcef90ee640 1 --2- 172.21.15.2:0/318646752 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40af420 0x7fcef40ce740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcef40710f0 tx=0x7fcee802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=231090ad1cd30046 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:29.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcef88ed640 1 -- 172.21.15.2:0/318646752 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80317c0 con 0x7fcef40af420 2023-11-25T04:08:29.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcef88ed640 1 -- 172.21.15.2:0/318646752 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee8031920 con 0x7fcef40af420 2023-11-25T04:08:29.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcef88ed640 1 -- 172.21.15.2:0/318646752 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee8031cb0 con 0x7fcef40af420 2023-11-25T04:08:29.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcefbb53640 1 -- 172.21.15.2:0/318646752 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40af420 msgr2=0x7fcef40ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcefbb53640 1 --2- 172.21.15.2:0/318646752 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40af420 0x7fcef40ce740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcef40710f0 tx=0x7fcee802b860 comp rx=0 tx=0).stop 2023-11-25T04:08:29.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcefbb53640 1 -- 172.21.15.2:0/318646752 shutdown_connections 2023-11-25T04:08:29.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcefbb53640 1 --2- 172.21.15.2:0/318646752 >> v2:172.21.15.66:3300/0 conn(0x7fcef40cec80 0x7fcef40cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcefbb53640 1 --2- 172.21.15.2:0/318646752 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40af420 0x7fcef40ce740 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcefbb53640 1 --2- 172.21.15.2:0/318646752 >> v2:172.21.15.2:3300/0 conn(0x7fcef415a1a0 0x7fcef40cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcefbb53640 1 -- 172.21.15.2:0/318646752 >> 172.21.15.2:0/318646752 conn(0x7fcef40cfe00 msgr2=0x7fcef40d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcefbb53640 1 -- 172.21.15.2:0/318646752 shutdown_connections 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.110+0000 7fcefbb53640 1 -- 172.21.15.2:0/318646752 wait complete. 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefbb53640 1 Processor -- start 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefbb53640 1 -- start start 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefbb53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef40af420 0x7fcef414bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefbb53640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40cec80 0x7fcef4152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefbb53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef415a1a0 0x7fcef414ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefbb53640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef41529c0 con 0x7fcef415a1a0 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefbb53640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef4151ff0 con 0x7fcef40af420 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefbb53640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef4153a10 con 0x7fcef40cec80 2023-11-25T04:08:29.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefa0f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef415a1a0 0x7fcef414ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefa0f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef415a1a0 0x7fcef414ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57686/0 (socket says 172.21.15.2:57686) 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.112+0000 7fcefa0f0640 1 -- 172.21.15.2:0/1956170675 learned_addr learned my addr 172.21.15.2:0/1956170675 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcef90ee640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40cec80 0x7fcef4152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcef98ef640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef40af420 0x7fcef414bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcefa0f0640 1 -- 172.21.15.2:0/1956170675 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40cec80 msgr2=0x7fcef4152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcefa0f0640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40cec80 0x7fcef4152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcefa0f0640 1 -- 172.21.15.2:0/1956170675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef40af420 msgr2=0x7fcef414bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcefa0f0640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef40af420 0x7fcef414bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcefa0f0640 1 -- 172.21.15.2:0/1956170675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec009400 con 0x7fcef415a1a0 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcefa0f0640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef415a1a0 0x7fcef414ebc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcee400eed0 tx=0x7fcee400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcef27fc640 1 -- 172.21.15.2:0/1956170675 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4010040 con 0x7fcef415a1a0 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcef27fc640 1 -- 172.21.15.2:0/1956170675 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee4014400 con 0x7fcef415a1a0 2023-11-25T04:08:29.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee80094d0 con 0x7fcef415a1a0 2023-11-25T04:08:29.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcef27fc640 1 -- 172.21.15.2:0/1956170675 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4009ea0 con 0x7fcef415a1a0 2023-11-25T04:08:29.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.113+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef4151c80 con 0x7fcef415a1a0 2023-11-25T04:08:29.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.114+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef4151800 con 0x7fcef415a1a0 2023-11-25T04:08:29.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.115+0000 7fcef27fc640 1 -- 172.21.15.2:0/1956170675 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcee40147b0 con 0x7fcef415a1a0 2023-11-25T04:08:29.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.115+0000 7fcef27fc640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcee006ae40 0x7fcee006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.115+0000 7fcef27fc640 1 -- 172.21.15.2:0/1956170675 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcee4089a60 con 0x7fcef415a1a0 2023-11-25T04:08:29.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.115+0000 7fcef98ef640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcee006ae40 0x7fcee006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.115+0000 7fcef98ef640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcee006ae40 0x7fcee006d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcef415be90 tx=0x7fceec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:29.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.119+0000 7fcef27fc640 1 -- 172.21.15.2:0/1956170675 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcef4151800 con 0x7fcef415a1a0 2023-11-25T04:08:29.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.296+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcef4151800 con 0x7fcef415a1a0 2023-11-25T04:08:29.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.296+0000 7fcef27fc640 1 -- 172.21.15.2:0/1956170675 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12742 (secure 0 0 0) 0x7fcef4151800 con 0x7fcef415a1a0 2023-11-25T04:08:29.298 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:29.299 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:25.549970+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.298+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcee006ae40 msgr2=0x7fcee006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.298+0000 7fcefbb53640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcee006ae40 0x7fcee006d300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcef415be90 tx=0x7fceec008040 comp rx=0 tx=0).stop 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.298+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef415a1a0 msgr2=0x7fcef414ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.298+0000 7fcefbb53640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef415a1a0 0x7fcef414ebc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcee400eed0 tx=0x7fcee400b480 comp rx=0 tx=0).stop 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.299+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 shutdown_connections 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.299+0000 7fcefbb53640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef415a1a0 0x7fcef414ebc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.299+0000 7fcefbb53640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef40cec80 0x7fcef4152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.299+0000 7fcefbb53640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcee006ae40 0x7fcee006d300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.299+0000 7fcefbb53640 1 --2- 172.21.15.2:0/1956170675 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef40af420 0x7fcef414bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.299+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 >> 172.21.15.2:0/1956170675 conn(0x7fcef40cfe00 msgr2=0x7fcef40b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:29.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.299+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 shutdown_connections 2023-11-25T04:08:29.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.299+0000 7fcefbb53640 1 -- 172.21.15.2:0/1956170675 wait complete. 2023-11-25T04:08:29.312 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:08:29.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:08:29.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.419+0000 7faa902d3640 1 Processor -- start 2023-11-25T04:08:29.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.419+0000 7faa902d3640 1 -- start start 2023-11-25T04:08:29.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa902d3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faa8815d7b0 0x7faa880cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa902d3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faa880d0050 0x7faa880b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa902d3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa880b04d0 con 0x7faa880b0ea0 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa902d3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa880d04d0 con 0x7faa880d0050 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa902d3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa880d1e40 con 0x7faa8815d7b0 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa8d86e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faa880d0050 0x7faa880b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa8d86e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faa880d0050 0x7faa880b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57702/0 (socket says 172.21.15.2:57702) 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa8d86e640 1 -- 172.21.15.2:0/2775788687 learned_addr learned my addr 172.21.15.2:0/2775788687 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa8e06f640 1 --2- 172.21.15.2:0/2775788687 >> v2:172.21.15.66:3300/0 conn(0x7faa8815d7b0 0x7faa880cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa8d86e640 1 -- 172.21.15.2:0/2775788687 >> v2:172.21.15.66:3300/0 conn(0x7faa8815d7b0 msgr2=0x7faa880cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa8d86e640 1 --2- 172.21.15.2:0/2775788687 >> v2:172.21.15.66:3300/0 conn(0x7faa8815d7b0 0x7faa880cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa8d86e640 1 -- 172.21.15.2:0/2775788687 >> v1:172.21.15.66:6789/0 conn(0x7faa880b0ea0 legacy=0x7faa880b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.423 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa8d86e640 1 -- 172.21.15.2:0/2775788687 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa880afe80 con 0x7faa880d0050 2023-11-25T04:08:29.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.420+0000 7faa8e06f640 1 --2- 172.21.15.2:0/2775788687 >> v2:172.21.15.66:3300/0 conn(0x7faa8815d7b0 0x7faa880cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:29.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.421+0000 7faa8d86e640 1 --2- 172.21.15.2:0/2775788687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880d0050 0x7faa880b0960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa8808bcb0 tx=0x7faa7c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b895b5f9f8b9cd server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:29.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.421+0000 7faa8d06d640 1 -- 172.21.15.2:0/2775788687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c030860 con 0x7faa880d0050 2023-11-25T04:08:29.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.421+0000 7faa8d06d640 1 -- 172.21.15.2:0/2775788687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c0309c0 con 0x7faa880d0050 2023-11-25T04:08:29.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.421+0000 7faa8d06d640 1 -- 172.21.15.2:0/2775788687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c030d50 con 0x7faa880d0050 2023-11-25T04:08:29.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.422+0000 7faa902d3640 1 -- 172.21.15.2:0/2775788687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880d0050 msgr2=0x7faa880b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.422+0000 7faa902d3640 1 --2- 172.21.15.2:0/2775788687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880d0050 0x7faa880b0960 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7faa8808bcb0 tx=0x7faa7c02b9a0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.422+0000 7faa902d3640 1 -- 172.21.15.2:0/2775788687 shutdown_connections 2023-11-25T04:08:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.422+0000 7faa902d3640 1 --2- 172.21.15.2:0/2775788687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880d0050 0x7faa880b0960 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.422+0000 7faa902d3640 1 --2- 172.21.15.2:0/2775788687 >> v2:172.21.15.66:3300/0 conn(0x7faa8815d7b0 0x7faa880cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.422+0000 7faa902d3640 1 -- 172.21.15.2:0/2775788687 >> 172.21.15.2:0/2775788687 conn(0x7faa8809c480 msgr2=0x7faa880d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.422+0000 7faa902d3640 1 -- 172.21.15.2:0/2775788687 shutdown_connections 2023-11-25T04:08:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.422+0000 7faa902d3640 1 -- 172.21.15.2:0/2775788687 wait complete. 2023-11-25T04:08:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.423+0000 7faa902d3640 1 Processor -- start 2023-11-25T04:08:29.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.423+0000 7faa902d3640 1 -- start start 2023-11-25T04:08:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa902d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880b0ea0 0x7faa880c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa902d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa880d0050 0x7faa881f2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa902d3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa8815d7b0 0x7faa880c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa902d3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8815f410 con 0x7faa880b0ea0 2023-11-25T04:08:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa902d3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8815c700 con 0x7faa880d0050 2023-11-25T04:08:29.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa902d3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa880c7c00 con 0x7faa8815d7b0 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e06f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880b0ea0 0x7faa880c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e06f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880b0ea0 0x7faa880c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57704/0 (socket says 172.21.15.2:57704) 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e06f640 1 -- 172.21.15.2:0/4025038687 learned_addr learned my addr 172.21.15.2:0/4025038687 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8d86e640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa880d0050 0x7faa881f2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e870640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa8815d7b0 0x7faa880c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e06f640 1 -- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa8815d7b0 msgr2=0x7faa880c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e06f640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa8815d7b0 0x7faa880c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e06f640 1 -- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa880d0050 msgr2=0x7faa881f2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e06f640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa880d0050 0x7faa881f2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e06f640 1 -- 172.21.15.2:0/4025038687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c0094d0 con 0x7faa880b0ea0 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8d86e640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa880d0050 0x7faa881f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.424+0000 7faa8e870640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa8815d7b0 0x7faa880c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:29.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.425+0000 7faa8e06f640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880b0ea0 0x7faa880c89c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa80007ef0 tx=0x7faa8000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.425+0000 7faa86ffd640 1 -- 172.21.15.2:0/4025038687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80003b90 con 0x7faa880b0ea0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.425+0000 7faa86ffd640 1 -- 172.21.15.2:0/4025038687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8000f040 con 0x7faa880b0ea0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.425+0000 7faa86ffd640 1 -- 172.21.15.2:0/4025038687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000de80 con 0x7faa880b0ea0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.425+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa880c7ee0 con 0x7faa880b0ea0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.425+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa881f2c80 con 0x7faa880b0ea0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.426+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa880a1160 con 0x7faa880b0ea0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.426+0000 7faa86ffd640 1 -- 172.21.15.2:0/4025038687 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa80004030 con 0x7faa880b0ea0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.427+0000 7faa86ffd640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa7406ae40 0x7faa7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.427+0000 7faa86ffd640 1 -- 172.21.15.2:0/4025038687 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa80089400 con 0x7faa880b0ea0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.427+0000 7faa8d86e640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa7406ae40 0x7faa7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.427+0000 7faa8d86e640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa7406ae40 0x7faa7406d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa7c036000 tx=0x7faa7c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:29.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.431+0000 7faa86ffd640 1 -- 172.21.15.2:0/4025038687 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa80054940 con 0x7faa880b0ea0 2023-11-25T04:08:29.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.605+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa8804e920 con 0x7faa880b0ea0 2023-11-25T04:08:29.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.606+0000 7faa86ffd640 1 -- 172.21.15.2:0/4025038687 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa8001a020 con 0x7faa880b0ea0 2023-11-25T04:08:29.608 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:08:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa7406ae40 msgr2=0x7faa7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa7406ae40 0x7faa7406d300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faa7c036000 tx=0x7faa7c008030 comp rx=0 tx=0).stop 2023-11-25T04:08:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880b0ea0 msgr2=0x7faa880c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880b0ea0 0x7faa880c89c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7faa80007ef0 tx=0x7faa8000d4a0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 shutdown_connections 2023-11-25T04:08:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa8815d7b0 0x7faa880c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa7406ae40 0x7faa7406d300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa880d0050 0x7faa881f2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 --2- 172.21.15.2:0/4025038687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa880b0ea0 0x7faa880c89c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 >> 172.21.15.2:0/4025038687 conn(0x7faa8809c480 msgr2=0x7faa8806c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 shutdown_connections 2023-11-25T04:08:29.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.608+0000 7faa902d3640 1 -- 172.21.15.2:0/4025038687 wait complete. 2023-11-25T04:08:29.621 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:08:29.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.726+0000 7f892e1d5640 1 Processor -- start 2023-11-25T04:08:29.728 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.726+0000 7f892e1d5640 1 -- start start 2023-11-25T04:08:29.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f892e1d5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f89280d30e0 0x7f89280d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f892e1d5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89280b39b0 0x7f89280b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f892e1d5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89280cf260 con 0x7f892815d460 2023-11-25T04:08:29.730 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f892e1d5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89280d3ab0 con 0x7f89280b39b0 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f892e1d5640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89280ceca0 con 0x7f89280d30e0 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f8927fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89280b39b0 0x7f89280b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f89277fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f892815d460 0x7f89280d1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36896/0 (socket says 172.21.15.2:36896) 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f8927fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f89280b39b0 0x7f89280b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57710/0 (socket says 172.21.15.2:57710) 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f89277fe640 1 -- 172.21.15.2:0/4000741770 learned_addr learned my addr 172.21.15.2:0/4000741770 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f8926ffd640 1 --2- 172.21.15.2:0/4000741770 >> v2:172.21.15.66:3300/0 conn(0x7f89280d30e0 0x7f89280d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f8927fff640 1 -- 172.21.15.2:0/4000741770 >> v2:172.21.15.66:3300/0 conn(0x7f89280d30e0 msgr2=0x7f89280d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f8927fff640 1 --2- 172.21.15.2:0/4000741770 >> v2:172.21.15.66:3300/0 conn(0x7f89280d30e0 0x7f89280d3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f8927fff640 1 -- 172.21.15.2:0/4000741770 >> v1:172.21.15.2:6789/0 conn(0x7f892815d460 legacy=0x7f89280d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f8927fff640 1 -- 172.21.15.2:0/4000741770 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280cef80 con 0x7f89280b39b0 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.727+0000 7f89267fc640 1 -- 172.21.15.2:0/4000741770 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3749356213 0 0) 0x7f89280cf260 con 0x7f892815d460 2023-11-25T04:08:29.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.728+0000 7f8927fff640 1 --2- 172.21.15.2:0/4000741770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 0x7f89280b3e20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8920009d90 tx=0x7f892002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90bce2ae7ed5a9d server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:29.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.728+0000 7f89267fc640 1 -- 172.21.15.2:0/4000741770 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892002cbd0 con 0x7f89280b39b0 2023-11-25T04:08:29.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.728+0000 7f89267fc640 1 -- 172.21.15.2:0/4000741770 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892002cd30 con 0x7f89280b39b0 2023-11-25T04:08:29.732 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.728+0000 7f89267fc640 1 -- 172.21.15.2:0/4000741770 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892002cea0 con 0x7f89280b39b0 2023-11-25T04:08:29.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.729+0000 7f892e1d5640 1 -- 172.21.15.2:0/4000741770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 msgr2=0x7f89280b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.729+0000 7f892e1d5640 1 --2- 172.21.15.2:0/4000741770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 0x7f89280b3e20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8920009d90 tx=0x7f892002be20 comp rx=0 tx=0).stop 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.729+0000 7f892e1d5640 1 -- 172.21.15.2:0/4000741770 shutdown_connections 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.729+0000 7f892e1d5640 1 --2- 172.21.15.2:0/4000741770 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 0x7f89280b3e20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.729+0000 7f892e1d5640 1 --2- 172.21.15.2:0/4000741770 >> v2:172.21.15.66:3300/0 conn(0x7f89280d30e0 0x7f89280d3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.729+0000 7f892e1d5640 1 -- 172.21.15.2:0/4000741770 >> 172.21.15.2:0/4000741770 conn(0x7f892808cb60 msgr2=0x7f892809c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.729+0000 7f892e1d5640 1 -- 172.21.15.2:0/4000741770 shutdown_connections 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.729+0000 7f892e1d5640 1 -- 172.21.15.2:0/4000741770 wait complete. 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.730+0000 7f892e1d5640 1 Processor -- start 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.730+0000 7f892e1d5640 1 -- start start 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f892e1d5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 0x7f89280c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f892e1d5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89280d30e0 0x7f89280ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f892e1d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f892815d460 0x7f89280cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f892e1d5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89281496f0 con 0x7f89280b39b0 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f892e1d5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8928148e00 con 0x7f892815d460 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f892e1d5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89281490a0 con 0x7f89280d30e0 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f89277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 0x7f89280c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f89277fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 0x7f89280c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57722/0 (socket says 172.21.15.2:57722) 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f89277fe640 1 -- 172.21.15.2:0/1778801459 learned_addr learned my addr 172.21.15.2:0/1778801459 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f8926ffd640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89280d30e0 0x7f89280ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f8927fff640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f892815d460 0x7f89280cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f89277fe640 1 -- 172.21.15.2:0/1778801459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89280d30e0 msgr2=0x7f89280ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f89277fe640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89280d30e0 0x7f89280ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f89277fe640 1 -- 172.21.15.2:0/1778801459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f892815d460 msgr2=0x7f89280cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f89277fe640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f892815d460 0x7f89280cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.736 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f89277fe640 1 -- 172.21.15.2:0/1778801459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920009a70 con 0x7f89280b39b0 2023-11-25T04:08:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.731+0000 7f8927fff640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f892815d460 0x7f89280cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.732+0000 7f89277fe640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 0x7f89280c9920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f891800c430 tx=0x7f891800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.732+0000 7f890ffff640 1 -- 172.21.15.2:0/1778801459 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180074e0 con 0x7f89280b39b0 2023-11-25T04:08:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.732+0000 7f890ffff640 1 -- 172.21.15.2:0/1778801459 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8918007660 con 0x7f89280b39b0 2023-11-25T04:08:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.732+0000 7f890ffff640 1 -- 172.21.15.2:0/1778801459 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8918004a20 con 0x7f89280b39b0 2023-11-25T04:08:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.732+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8928149380 con 0x7f89280b39b0 2023-11-25T04:08:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.732+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89280c9e60 con 0x7f89280b39b0 2023-11-25T04:08:29.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.733+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8928067420 con 0x7f89280b39b0 2023-11-25T04:08:29.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.733+0000 7f890ffff640 1 -- 172.21.15.2:0/1778801459 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8918004b80 con 0x7f89280b39b0 2023-11-25T04:08:29.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.734+0000 7f890ffff640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f891406ae40 0x7f891406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:29.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.734+0000 7f890ffff640 1 -- 172.21.15.2:0/1778801459 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8918089030 con 0x7f89280b39b0 2023-11-25T04:08:29.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.734+0000 7f8926ffd640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f891406ae40 0x7f891406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:29.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.734+0000 7f8926ffd640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f891406ae40 0x7f891406d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f892815be10 tx=0x7f891c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:29.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.738+0000 7f890ffff640 1 -- 172.21.15.2:0/1778801459 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8918054440 con 0x7f89280b39b0 2023-11-25T04:08:29.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.948+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f89280b26c0 con 0x7f89280b39b0 2023-11-25T04:08:29.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.948+0000 7f890ffff640 1 -- 172.21.15.2:0/1778801459 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f8918057a60 con 0x7f89280b39b0 2023-11-25T04:08:29.950 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:29.950 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-25T04:08:29.951 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 2 2023-11-25T04:08:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f891406ae40 msgr2=0x7f891406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f891406ae40 0x7f891406d300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f892815be10 tx=0x7f891c008040 comp rx=0 tx=0).stop 2023-11-25T04:08:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 msgr2=0x7f89280c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 0x7f89280c9920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f891800c430 tx=0x7f891800c8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 shutdown_connections 2023-11-25T04:08:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f891406ae40 0x7f891406d300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f892815d460 0x7f89280cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89280d30e0 0x7f89280ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 --2- 172.21.15.2:0/1778801459 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89280b39b0 0x7f89280c9920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:29.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 >> 172.21.15.2:0/1778801459 conn(0x7f892808cb60 msgr2=0x7f89280b7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:29.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 shutdown_connections 2023-11-25T04:08:29.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:29.950+0000 7f892e1d5640 1 -- 172.21.15.2:0/1778801459 wait complete. 2023-11-25T04:08:31.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:08:32.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.083+0000 7fa577a61640 1 Processor -- start 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.083+0000 7fa577a61640 1 -- start start 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa577a61640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa570160ab0 0x7fa5700afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa577a61640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa5700b2450 0x7fa5700cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa577a61640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700d0030 0x7fa5700d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa577a61640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5700cdd30 con 0x7fa570160ab0 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa577a61640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5700ce2d0 con 0x7fa5700b2450 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa577a61640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700d0a90 con 0x7fa5700d0030 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa5757fd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa570160ab0 0x7fa5700afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa5757fd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa570160ab0 0x7fa5700afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57736/0 (socket says 172.21.15.2:57736) 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa5757fd640 1 -- 172.21.15.2:0/1726771835 learned_addr learned my addr 172.21.15.2:0/1726771835 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:32.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa575ffe640 1 --2- 172.21.15.2:0/1726771835 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700d0030 0x7fa5700d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.084+0000 7fa574ffc640 1 --2- 172.21.15.2:0/1726771835 >> v2:172.21.15.66:3300/0 conn(0x7fa5700b2450 0x7fa5700cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.085+0000 7fa5757fd640 1 -- 172.21.15.2:0/1726771835 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700d0030 msgr2=0x7fa5700d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.085+0000 7fa5757fd640 1 --2- 172.21.15.2:0/1726771835 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700d0030 0x7fa5700d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.085+0000 7fa5757fd640 1 -- 172.21.15.2:0/1726771835 >> v2:172.21.15.66:3300/0 conn(0x7fa5700b2450 msgr2=0x7fa5700cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.085+0000 7fa5757fd640 1 --2- 172.21.15.2:0/1726771835 >> v2:172.21.15.66:3300/0 conn(0x7fa5700b2450 0x7fa5700cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.085+0000 7fa5757fd640 1 -- 172.21.15.2:0/1726771835 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700b02f0 con 0x7fa570160ab0 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.085+0000 7fa5757fd640 1 --2- 172.21.15.2:0/1726771835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa570160ab0 0x7fa5700afdb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa57008d970 tx=0x7fa56c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a0528a3897cff7 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.085+0000 7fa567fff640 1 -- 172.21.15.2:0/1726771835 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c0317e0 con 0x7fa570160ab0 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa567fff640 1 -- 172.21.15.2:0/1726771835 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c031940 con 0x7fa570160ab0 2023-11-25T04:08:32.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa567fff640 1 -- 172.21.15.2:0/1726771835 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c031cd0 con 0x7fa570160ab0 2023-11-25T04:08:32.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa577a61640 1 -- 172.21.15.2:0/1726771835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa570160ab0 msgr2=0x7fa5700afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa577a61640 1 --2- 172.21.15.2:0/1726771835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa570160ab0 0x7fa5700afdb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fa57008d970 tx=0x7fa56c02b880 comp rx=0 tx=0).stop 2023-11-25T04:08:32.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa577a61640 1 -- 172.21.15.2:0/1726771835 shutdown_connections 2023-11-25T04:08:32.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa577a61640 1 --2- 172.21.15.2:0/1726771835 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700d0030 0x7fa5700d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa577a61640 1 --2- 172.21.15.2:0/1726771835 >> v2:172.21.15.66:3300/0 conn(0x7fa5700b2450 0x7fa5700cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa577a61640 1 --2- 172.21.15.2:0/1726771835 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa570160ab0 0x7fa5700afdb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa577a61640 1 -- 172.21.15.2:0/1726771835 >> 172.21.15.2:0/1726771835 conn(0x7fa57009c450 msgr2=0x7fa5700d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:32.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa577a61640 1 -- 172.21.15.2:0/1726771835 shutdown_connections 2023-11-25T04:08:32.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.086+0000 7fa577a61640 1 -- 172.21.15.2:0/1726771835 wait complete. 2023-11-25T04:08:32.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.087+0000 7fa577a61640 1 Processor -- start 2023-11-25T04:08:32.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.087+0000 7fa577a61640 1 -- start start 2023-11-25T04:08:32.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa577a61640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700b2450 0x7fa5700b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa577a61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5700d0030 0x7fa570158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa577a61640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa570160ab0 0x7fa57006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa577a61640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700b7700 con 0x7fa5700d0030 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa577a61640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700b6120 con 0x7fa5700b2450 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa577a61640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700b6400 con 0x7fa570160ab0 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa574ffc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5700d0030 0x7fa570158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa574ffc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5700d0030 0x7fa570158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57744/0 (socket says 172.21.15.2:57744) 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa574ffc640 1 -- 172.21.15.2:0/4246624601 learned_addr learned my addr 172.21.15.2:0/4246624601 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa575ffe640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa570160ab0 0x7fa57006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.088+0000 7fa5757fd640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700b2450 0x7fa5700b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa574ffc640 1 -- 172.21.15.2:0/4246624601 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa570160ab0 msgr2=0x7fa57006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa574ffc640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa570160ab0 0x7fa57006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa574ffc640 1 -- 172.21.15.2:0/4246624601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700b2450 msgr2=0x7fa5700b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa574ffc640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700b2450 0x7fa5700b71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa574ffc640 1 -- 172.21.15.2:0/4246624601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56c0094d0 con 0x7fa5700d0030 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa5757fd640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700b2450 0x7fa5700b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa574ffc640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5700d0030 0x7fa570158680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa56000e890 tx=0x7fa56000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa565ffb640 1 -- 172.21.15.2:0/4246624601 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56000c940 con 0x7fa5700d0030 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa565ffb640 1 -- 172.21.15.2:0/4246624601 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56000caa0 con 0x7fa5700d0030 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5700b66e0 con 0x7fa5700d0030 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa565ffb640 1 -- 172.21.15.2:0/4246624601 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56000ce30 con 0x7fa5700d0030 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.089+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5700b6ca0 con 0x7fa5700d0030 2023-11-25T04:08:32.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.090+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa570067420 con 0x7fa5700d0030 2023-11-25T04:08:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.091+0000 7fa565ffb640 1 -- 172.21.15.2:0/4246624601 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa560013470 con 0x7fa5700d0030 2023-11-25T04:08:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.091+0000 7fa565ffb640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa55406ae40 0x7fa55406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.091+0000 7fa565ffb640 1 -- 172.21.15.2:0/4246624601 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa5600894d0 con 0x7fa5700d0030 2023-11-25T04:08:32.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.091+0000 7fa5757fd640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa55406ae40 0x7fa55406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.092+0000 7fa5757fd640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa55406ae40 0x7fa55406d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa56c036000 tx=0x7fa56c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:32.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.096+0000 7fa565ffb640 1 -- 172.21.15.2:0/4246624601 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5600548d0 con 0x7fa5700d0030 2023-11-25T04:08:32.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.308+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5700d1020 con 0x7fa5700d0030 2023-11-25T04:08:32.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.309+0000 7fa565ffb640 1 -- 172.21.15.2:0/4246624601 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7fa560021e80 con 0x7fa5700d0030 2023-11-25T04:08:32.311 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:32.311 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1227253459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1227253459},{"type":"v1","addr":"172.21.15.66:6835","nonce":1227253459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3032459629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3032459629},{"type":"v1","addr":"172.21.15.2:6835","nonce":3032459629}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/1650670057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1650670057},{"type":"v1","addr":"172.21.15.66:6833","nonce":1650670057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-25T04:08:32.311 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 3 2023-11-25T04:08:32.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa55406ae40 msgr2=0x7fa55406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa55406ae40 0x7fa55406d300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa56c036000 tx=0x7fa56c03d040 comp rx=0 tx=0).stop 2023-11-25T04:08:32.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5700d0030 msgr2=0x7fa570158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5700d0030 0x7fa570158680 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa56000e890 tx=0x7fa56000ed50 comp rx=0 tx=0).stop 2023-11-25T04:08:32.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 shutdown_connections 2023-11-25T04:08:32.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa570160ab0 0x7fa57006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa5700d0030 0x7fa570158680 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa55406ae40 0x7fa55406d300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 --2- 172.21.15.2:0/4246624601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700b2450 0x7fa5700b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 >> 172.21.15.2:0/4246624601 conn(0x7fa57009c450 msgr2=0x7fa57006c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:32.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 shutdown_connections 2023-11-25T04:08:32.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.311+0000 7fa577a61640 1 -- 172.21.15.2:0/4246624601 wait complete. 2023-11-25T04:08:32.323 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:32.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.428+0000 7f96d56a6640 1 Processor -- start 2023-11-25T04:08:32.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.428+0000 7f96d56a6640 1 -- start start 2023-11-25T04:08:32.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.428+0000 7f96d56a6640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96d015d3e0 0x7f96d00ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.431 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.428+0000 7f96d56a6640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d00b5f90 con 0x7f96d00d1e30 2023-11-25T04:08:32.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.428+0000 7f96d56a6640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d00b61e0 con 0x7f96d00ced30 2023-11-25T04:08:32.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.428+0000 7f96d56a6640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d00cf170 con 0x7f96d015d3e0 2023-11-25T04:08:32.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.429+0000 7f96ceffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f96d015d3e0 0x7f96d00ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.429+0000 7f96cf7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f96d00d1e30 0x7f96d00b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36908/0 (socket says 172.21.15.2:36908) 2023-11-25T04:08:32.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.429+0000 7f96cf7fe640 1 -- 172.21.15.2:0/1686438774 learned_addr learned my addr 172.21.15.2:0/1686438774 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:32.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.429+0000 7f96ceffd640 1 -- 172.21.15.2:0/1686438774 >> v1:172.21.15.66:6789/0 conn(0x7f96d00ced30 legacy=0x7f96d00d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.429+0000 7f96ceffd640 1 -- 172.21.15.2:0/1686438774 >> v1:172.21.15.2:6789/0 conn(0x7f96d00d1e30 legacy=0x7f96d00b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.429+0000 7f96ceffd640 1 -- 172.21.15.2:0/1686438774 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d00b64c0 con 0x7f96d015d3e0 2023-11-25T04:08:32.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.429+0000 7f96ce7fc640 1 -- 172.21.15.2:0/1686438774 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442777694 0 0) 0x7f96d00b5f90 con 0x7f96d00d1e30 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96ceffd640 1 --2- 172.21.15.2:0/1686438774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d015d3e0 0x7f96d00ce7f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f96c00097a0 tx=0x7f96c002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3b5adba6a79bc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96ce7fc640 1 -- 172.21.15.2:0/1686438774 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c002f810 con 0x7f96d015d3e0 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96ce7fc640 1 -- 172.21.15.2:0/1686438774 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c002f970 con 0x7f96d015d3e0 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96ce7fc640 1 -- 172.21.15.2:0/1686438774 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c002fd00 con 0x7f96d015d3e0 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96d56a6640 1 -- 172.21.15.2:0/1686438774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d015d3e0 msgr2=0x7f96d00ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96d56a6640 1 --2- 172.21.15.2:0/1686438774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d015d3e0 0x7f96d00ce7f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f96c00097a0 tx=0x7f96c002b9f0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96d56a6640 1 -- 172.21.15.2:0/1686438774 shutdown_connections 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96d56a6640 1 --2- 172.21.15.2:0/1686438774 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d015d3e0 0x7f96d00ce7f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96d56a6640 1 -- 172.21.15.2:0/1686438774 >> 172.21.15.2:0/1686438774 conn(0x7f96d009c480 msgr2=0x7f96d00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96d56a6640 1 -- 172.21.15.2:0/1686438774 shutdown_connections 2023-11-25T04:08:32.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.430+0000 7f96d56a6640 1 -- 172.21.15.2:0/1686438774 wait complete. 2023-11-25T04:08:32.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.432+0000 7f96d56a6640 1 Processor -- start 2023-11-25T04:08:32.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.432+0000 7f96d56a6640 1 -- start start 2023-11-25T04:08:32.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.432+0000 7f96d56a6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d00ced30 0x7f96d0151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.432+0000 7f96d56a6640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00d1e30 0x7f96d00b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.432+0000 7f96d56a6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d015d3e0 0x7f96d00cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.432+0000 7f96d56a6640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d014b580 con 0x7f96d00d1e30 2023-11-25T04:08:32.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.432+0000 7f96d56a6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00b4e00 con 0x7f96d015d3e0 2023-11-25T04:08:32.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.432+0000 7f96d56a6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00cc1b0 con 0x7f96d00ced30 2023-11-25T04:08:32.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00d1e30 0x7f96d00b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c67fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00d1e30 0x7f96d00b48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57762/0 (socket says 172.21.15.2:57762) 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c67fc640 1 -- 172.21.15.2:0/1839077067 learned_addr learned my addr 172.21.15.2:0/1839077067 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c67fc640 1 -- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d00ced30 msgr2=0x7f96d0151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96cf7fe640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d015d3e0 0x7f96d00cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96ceffd640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d00ced30 0x7f96d0151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c67fc640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d00ced30 0x7f96d0151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c67fc640 1 -- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d015d3e0 msgr2=0x7f96d00cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c67fc640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d015d3e0 0x7f96d00cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c67fc640 1 -- 172.21.15.2:0/1839077067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c0009400 con 0x7f96d00d1e30 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96cf7fe640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d015d3e0 0x7f96d00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96ceffd640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d00ced30 0x7f96d0151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c67fc640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00d1e30 0x7f96d00b48c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96b800c450 tx=0x7f96b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:32.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c7fff640 1 -- 172.21.15.2:0/1839077067 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b80052d0 con 0x7f96d00d1e30 2023-11-25T04:08:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c7fff640 1 -- 172.21.15.2:0/1839077067 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b8005430 con 0x7f96d00d1e30 2023-11-25T04:08:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d00cc450 con 0x7f96d00d1e30 2023-11-25T04:08:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96c7fff640 1 -- 172.21.15.2:0/1839077067 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8012870 con 0x7f96d00d1e30 2023-11-25T04:08:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.433+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d00cca10 con 0x7f96d00d1e30 2023-11-25T04:08:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.434+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d014b6c0 con 0x7f96d00d1e30 2023-11-25T04:08:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.435+0000 7f96c7fff640 1 -- 172.21.15.2:0/1839077067 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96b80129d0 con 0x7f96d00d1e30 2023-11-25T04:08:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.435+0000 7f96c7fff640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f96b006ae40 0x7f96b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.435+0000 7f96c7fff640 1 -- 172.21.15.2:0/1839077067 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f96b8088e10 con 0x7f96d00d1e30 2023-11-25T04:08:32.439 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.435+0000 7f96ceffd640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f96b006ae40 0x7f96b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.436+0000 7f96ceffd640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f96b006ae40 0x7f96b006d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96c0036000 tx=0x7f96c0039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:32.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.439+0000 7f96c7fff640 1 -- 172.21.15.2:0/1839077067 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96d014b6c0 con 0x7f96d00d1e30 2023-11-25T04:08:32.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.615+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96d0067420 con 0x7f96d00d1e30 2023-11-25T04:08:32.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.616+0000 7f96c7fff640 1 -- 172.21.15.2:0/1839077067 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12742 (secure 0 0 0) 0x7f96b8054210 con 0x7f96d00d1e30 2023-11-25T04:08:32.618 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:32.618 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":16,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:25.549970+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f96b006ae40 msgr2=0x7f96b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f96b006ae40 0x7f96b006d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f96c0036000 tx=0x7f96c0039040 comp rx=0 tx=0).stop 2023-11-25T04:08:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00d1e30 msgr2=0x7f96d00b48c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00d1e30 0x7f96d00b48c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96b800c450 tx=0x7f96b800c910 comp rx=0 tx=0).stop 2023-11-25T04:08:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 shutdown_connections 2023-11-25T04:08:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f96b006ae40 0x7f96b006d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d015d3e0 0x7f96d00cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f96d00d1e30 0x7f96d00b48c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 --2- 172.21.15.2:0/1839077067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d00ced30 0x7f96d0151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 >> 172.21.15.2:0/1839077067 conn(0x7f96d009c480 msgr2=0x7f96d01600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 shutdown_connections 2023-11-25T04:08:32.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.618+0000 7f96d56a6640 1 -- 172.21.15.2:0/1839077067 wait complete. 2023-11-25T04:08:32.637 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:08:32.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:08:32.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.745+0000 7f64e560e640 1 Processor -- start 2023-11-25T04:08:32.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.745+0000 7f64e560e640 1 -- start start 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64e560e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f64e006ec60 0x7f64e015e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64e560e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f64e015d690 0x7f64e006f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64e560e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 0x7f64e0160f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64e560e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e015e9d0 con 0x7f64e015d690 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64e560e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e009a720 con 0x7f64e006ec60 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64e560e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e006f580 con 0x7f64e006e460 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64de7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f64e015d690 0x7f64e006f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64de7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f64e015d690 0x7f64e006f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57770/0 (socket says 172.21.15.2:57770) 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64de7fc640 1 -- 172.21.15.2:0/3234541263 learned_addr learned my addr 172.21.15.2:0/3234541263 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:32.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64df7fe640 1 --2- 172.21.15.2:0/3234541263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 0x7f64e0160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64deffd640 1 --2- 172.21.15.2:0/3234541263 >> v2:172.21.15.66:3300/0 conn(0x7f64e006ec60 0x7f64e015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64de7fc640 1 -- 172.21.15.2:0/3234541263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 msgr2=0x7f64e0160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64de7fc640 1 --2- 172.21.15.2:0/3234541263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 0x7f64e0160f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64de7fc640 1 -- 172.21.15.2:0/3234541263 >> v2:172.21.15.66:3300/0 conn(0x7f64e006ec60 msgr2=0x7f64e015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64de7fc640 1 --2- 172.21.15.2:0/3234541263 >> v2:172.21.15.66:3300/0 conn(0x7f64e006ec60 0x7f64e015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64de7fc640 1 -- 172.21.15.2:0/3234541263 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0099b10 con 0x7f64e015d690 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.746+0000 7f64deffd640 1 --2- 172.21.15.2:0/3234541263 >> v2:172.21.15.66:3300/0 conn(0x7f64e006ec60 0x7f64e015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64de7fc640 1 --2- 172.21.15.2:0/3234541263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e015d690 0x7f64e006f040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64e0071b50 tx=0x7f64d402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd9ec864507a310 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64ddffb640 1 -- 172.21.15.2:0/3234541263 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4031750 con 0x7f64e015d690 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64ddffb640 1 -- 172.21.15.2:0/3234541263 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d40318b0 con 0x7f64e015d690 2023-11-25T04:08:32.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64ddffb640 1 -- 172.21.15.2:0/3234541263 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4031c40 con 0x7f64e015d690 2023-11-25T04:08:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64e560e640 1 -- 172.21.15.2:0/3234541263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e015d690 msgr2=0x7f64e006f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64e560e640 1 --2- 172.21.15.2:0/3234541263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e015d690 0x7f64e006f040 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64e0071b50 tx=0x7f64d402b7f0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64e560e640 1 -- 172.21.15.2:0/3234541263 shutdown_connections 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64e560e640 1 --2- 172.21.15.2:0/3234541263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 0x7f64e0160f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64e560e640 1 --2- 172.21.15.2:0/3234541263 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e015d690 0x7f64e006f040 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64e560e640 1 --2- 172.21.15.2:0/3234541263 >> v2:172.21.15.66:3300/0 conn(0x7f64e006ec60 0x7f64e015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.747+0000 7f64e560e640 1 -- 172.21.15.2:0/3234541263 >> 172.21.15.2:0/3234541263 conn(0x7f64e00b2a20 msgr2=0x7f64e00b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.748+0000 7f64e560e640 1 -- 172.21.15.2:0/3234541263 shutdown_connections 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.748+0000 7f64e560e640 1 -- 172.21.15.2:0/3234541263 wait complete. 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.749+0000 7f64e560e640 1 Processor -- start 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.749+0000 7f64e560e640 1 -- start start 2023-11-25T04:08:32.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64e560e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 0x7f64e015bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64e560e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64e006ec60 0x7f64e00b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64e560e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e00af3e0 0x7f64e00af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64e560e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00c7a50 con 0x7f64e00af3e0 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64e560e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00afdb0 con 0x7f64e006ec60 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64e560e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00c6f60 con 0x7f64e006e460 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e00af3e0 0x7f64e00af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64df7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e00af3e0 0x7f64e00af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57782/0 (socket says 172.21.15.2:57782) 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64df7fe640 1 -- 172.21.15.2:0/2694679710 learned_addr learned my addr 172.21.15.2:0/2694679710 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64de7fc640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64e006ec60 0x7f64e00b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64deffd640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 0x7f64e015bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64df7fe640 1 -- 172.21.15.2:0/2694679710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 msgr2=0x7f64e015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64df7fe640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 0x7f64e015bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64df7fe640 1 -- 172.21.15.2:0/2694679710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64e006ec60 msgr2=0x7f64e00b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64df7fe640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64e006ec60 0x7f64e00b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64df7fe640 1 -- 172.21.15.2:0/2694679710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d40094d0 con 0x7f64e00af3e0 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64deffd640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 0x7f64e015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64df7fe640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e00af3e0 0x7f64e00af870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f64d8007e60 tx=0x7f64d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64c77fe640 1 -- 172.21.15.2:0/2694679710 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d8014620 con 0x7f64e00af3e0 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64c77fe640 1 -- 172.21.15.2:0/2694679710 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d800ee90 con 0x7f64e00af3e0 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e00c71b0 con 0x7f64e00af3e0 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.750+0000 7f64c77fe640 1 -- 172.21.15.2:0/2694679710 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d80149e0 con 0x7f64e00af3e0 2023-11-25T04:08:32.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.751+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e00c7770 con 0x7f64e00af3e0 2023-11-25T04:08:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.752+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64e009a080 con 0x7f64e00af3e0 2023-11-25T04:08:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.752+0000 7f64c77fe640 1 -- 172.21.15.2:0/2694679710 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f64d8014b40 con 0x7f64e00af3e0 2023-11-25T04:08:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.752+0000 7f64c77fe640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f64cc06ae40 0x7f64cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.752+0000 7f64c77fe640 1 -- 172.21.15.2:0/2694679710 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64d8089b20 con 0x7f64e00af3e0 2023-11-25T04:08:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.752+0000 7f64deffd640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f64cc06ae40 0x7f64cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:32.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.753+0000 7f64deffd640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f64cc06ae40 0x7f64cc06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64d0006fd0 tx=0x7f64d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:32.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.757+0000 7f64c77fe640 1 -- 172.21.15.2:0/2694679710 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f64d8054f20 con 0x7f64e00af3e0 2023-11-25T04:08:32.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.933+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64e004e920 con 0x7f64e00af3e0 2023-11-25T04:08:32.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.933+0000 7f64c77fe640 1 -- 172.21.15.2:0/2694679710 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64d8058540 con 0x7f64e00af3e0 2023-11-25T04:08:32.935 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:08:32.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f64cc06ae40 msgr2=0x7f64cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f64cc06ae40 0x7f64cc06d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f64d0006fd0 tx=0x7f64d0008040 comp rx=0 tx=0).stop 2023-11-25T04:08:32.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e00af3e0 msgr2=0x7f64e00af870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:32.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e00af3e0 0x7f64e00af870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f64d8007e60 tx=0x7f64d800e4b0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 shutdown_connections 2023-11-25T04:08:32.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f64e00af3e0 0x7f64e00af870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f64cc06ae40 0x7f64cc06d300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64e006ec60 0x7f64e00b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 --2- 172.21.15.2:0/2694679710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64e006e460 0x7f64e015bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:32.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 >> 172.21.15.2:0/2694679710 conn(0x7f64e00b2a20 msgr2=0x7f64e006b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:32.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 shutdown_connections 2023-11-25T04:08:32.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:32.935+0000 7f64e560e640 1 -- 172.21.15.2:0/2694679710 wait complete. 2023-11-25T04:08:32.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-25T04:08:33.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.052+0000 7fc5e9d97640 1 Processor -- start 2023-11-25T04:08:33.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.052+0000 7fc5e9d97640 1 -- start start 2023-11-25T04:08:33.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.053+0000 7fc5e9d97640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc5e40d30e0 0x7fc5e40d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.053+0000 7fc5e9d97640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e40cf260 con 0x7fc5e415d460 2023-11-25T04:08:33.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.053+0000 7fc5e9d97640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e40ceca0 con 0x7fc5e40b39b0 2023-11-25T04:08:33.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.053+0000 7fc5e9d97640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e40d3ab0 con 0x7fc5e40d30e0 2023-11-25T04:08:33.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.053+0000 7fc5e37fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc5e415d460 0x7fc5e40d1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36910/0 (socket says 172.21.15.2:36910) 2023-11-25T04:08:33.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.053+0000 7fc5e37fe640 1 -- 172.21.15.2:0/2725100008 learned_addr learned my addr 172.21.15.2:0/2725100008 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:33.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.053+0000 7fc5e2ffd640 1 --2- 172.21.15.2:0/2725100008 >> v2:172.21.15.66:3300/0 conn(0x7fc5e40d30e0 0x7fc5e40d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.053+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461448003 0 0) 0x7fc5e40cf260 con 0x7fc5e415d460 2023-11-25T04:08:33.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.053+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5cc003520 con 0x7fc5e415d460 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2777607736 0 0) 0x7fc5cc003520 con 0x7fc5e415d460 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 >> v2:172.21.15.66:3300/0 conn(0x7fc5e40d30e0 msgr2=0x7fc5e40d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 --2- 172.21.15.2:0/2725100008 >> v2:172.21.15.66:3300/0 conn(0x7fc5e40d30e0 0x7fc5e40d3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 >> v1:172.21.15.66:6789/0 conn(0x7fc5e40b39b0 legacy=0x7fc5e40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40cef80 con 0x7fc5e415d460 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7fc5d4001670 con 0x7fc5e415d460 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 >> v1:172.21.15.2:6789/0 conn(0x7fc5e415d460 legacy=0x7fc5e40d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5cc0039a0 0x7fc5cc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5cc0047c0 0x7fc5cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0051d0 0x7fc5cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e40d3ab0 con 0x7fc5cc0039a0 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc00c100 con 0x7fc5cc0047c0 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc00c2c0 con 0x7fc5cc0051d0 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e37fe640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5cc0039a0 0x7fc5cc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e2ffd640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5cc0047c0 0x7fc5cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e3fff640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0051d0 0x7fc5cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e37fe640 1 -- 172.21.15.2:0/2725100008 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0051d0 msgr2=0x7fc5cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e37fe640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0051d0 0x7fc5cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e37fe640 1 -- 172.21.15.2:0/2725100008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5cc0047c0 msgr2=0x7fc5cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e37fe640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5cc0047c0 0x7fc5cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e37fe640 1 -- 172.21.15.2:0/2725100008 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc003520 con 0x7fc5cc0039a0 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e3fff640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0051d0 0x7fc5cc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:33.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.054+0000 7fc5e3fff640 1 -- 172.21.15.2:0/2725100008 reap_dead start 2023-11-25T04:08:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.055+0000 7fc5e37fe640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5cc0039a0 0x7fc5cc003dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400c240 tx=0x7fc5cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fdf429bd5c205a server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.055+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d4005ad0 con 0x7fc5cc0039a0 2023-11-25T04:08:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.055+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d4005c30 con 0x7fc5cc0039a0 2023-11-25T04:08:33.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.055+0000 7fc5e27fc640 1 -- 172.21.15.2:0/2725100008 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d402caf0 con 0x7fc5cc0039a0 2023-11-25T04:08:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.055+0000 7fc5e9d97640 1 -- 172.21.15.2:0/2725100008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5cc0039a0 msgr2=0x7fc5cc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.055+0000 7fc5e9d97640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5cc0039a0 0x7fc5cc003dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400c240 tx=0x7fc5cc0057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.055+0000 7fc5e9d97640 1 -- 172.21.15.2:0/2725100008 shutdown_connections 2023-11-25T04:08:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.055+0000 7fc5e9d97640 1 --2- 172.21.15.2:0/2725100008 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5cc0039a0 0x7fc5cc003dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.055+0000 7fc5e9d97640 1 -- 172.21.15.2:0/2725100008 >> 172.21.15.2:0/2725100008 conn(0x7fc5e408cb60 msgr2=0x7fc5e409c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.056+0000 7fc5e9d97640 1 -- 172.21.15.2:0/2725100008 shutdown_connections 2023-11-25T04:08:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.056+0000 7fc5e9d97640 1 -- 172.21.15.2:0/2725100008 wait complete. 2023-11-25T04:08:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.057+0000 7fc5e9d97640 1 Processor -- start 2023-11-25T04:08:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.057+0000 7fc5e9d97640 1 -- start start 2023-11-25T04:08:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e9d97640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0039a0 0x7fc5e4157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e9d97640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5e41601c0 0x7fc5e40c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e9d97640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e415e870 0x7fc5e40b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e9d97640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e415e450 con 0x7fc5e415e870 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e9d97640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e4157d90 con 0x7fc5e41601c0 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e9d97640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e415db40 con 0x7fc5cc0039a0 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e415e870 0x7fc5e40b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e415e870 0x7fc5e40b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57804/0 (socket says 172.21.15.2:57804) 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e3fff640 1 -- 172.21.15.2:0/3308914529 learned_addr learned my addr 172.21.15.2:0/3308914529 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e37fe640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0039a0 0x7fc5e4157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e2ffd640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5e41601c0 0x7fc5e40c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e3fff640 1 -- 172.21.15.2:0/3308914529 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0039a0 msgr2=0x7fc5e4157850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e3fff640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0039a0 0x7fc5e4157850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e3fff640 1 -- 172.21.15.2:0/3308914529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5e41601c0 msgr2=0x7fc5e40c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e3fff640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5e41601c0 0x7fc5e40c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e3fff640 1 -- 172.21.15.2:0/3308914529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40c8990 con 0x7fc5e415e870 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e3fff640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e415e870 0x7fc5e40b1720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc000f80 tx=0x7fc5dc00ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5cbfff640 1 -- 172.21.15.2:0/3308914529 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc017070 con 0x7fc5e415e870 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5cbfff640 1 -- 172.21.15.2:0/3308914529 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc003b80 con 0x7fc5e415e870 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e415dd90 con 0x7fc5e415e870 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5cbfff640 1 -- 172.21.15.2:0/3308914529 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc003d30 con 0x7fc5e415e870 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.058+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e40c8560 con 0x7fc5e415e870 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.059+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e415e590 con 0x7fc5e415e870 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.060+0000 7fc5cbfff640 1 -- 172.21.15.2:0/3308914529 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5dc0050d0 con 0x7fc5e415e870 2023-11-25T04:08:33.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.060+0000 7fc5cbfff640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5d006ae70 0x7fc5d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.060+0000 7fc5cbfff640 1 -- 172.21.15.2:0/3308914529 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc5dc0884d0 con 0x7fc5e415e870 2023-11-25T04:08:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.060+0000 7fc5e37fe640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5d006ae70 0x7fc5d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.061+0000 7fc5e37fe640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5d006ae70 0x7fc5d006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4034000 tx=0x7fc5d4009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:33.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.064+0000 7fc5cbfff640 1 -- 172.21.15.2:0/3308914529 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5e415e590 con 0x7fc5e415e870 2023-11-25T04:08:33.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.246+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc5e415e590 con 0x7fc5e415e870 2023-11-25T04:08:33.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.246+0000 7fc5cbfff640 1 -- 172.21.15.2:0/3308914529 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc5e415e590 con 0x7fc5e415e870 2023-11-25T04:08:33.248 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:33.248 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-25T04:08:33.249 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:08:33.249 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-25T04:08:33.249 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-25T04:08:33.249 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:08:33.249 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-25T04:08:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5d006ae70 msgr2=0x7fc5d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5d006ae70 0x7fc5d006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4034000 tx=0x7fc5d4009030 comp rx=0 tx=0).stop 2023-11-25T04:08:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e415e870 msgr2=0x7fc5e40b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e415e870 0x7fc5e40b1720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc5dc000f80 tx=0x7fc5dc00ead0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 shutdown_connections 2023-11-25T04:08:33.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5e415e870 0x7fc5e40b1720 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5d006ae70 0x7fc5d006d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5e41601c0 0x7fc5e40c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 --2- 172.21.15.2:0/3308914529 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5cc0039a0 0x7fc5e4157850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 >> 172.21.15.2:0/3308914529 conn(0x7fc5e408cb60 msgr2=0x7fc5e40cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 shutdown_connections 2023-11-25T04:08:33.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.248+0000 7fc5e9d97640 1 -- 172.21.15.2:0/3308914529 wait complete. 2023-11-25T04:08:33.261 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-25T04:08:33.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-25T04:08:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.369+0000 7fd4b758a640 1 Processor -- start 2023-11-25T04:08:33.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.369+0000 7fd4b758a640 1 -- start start 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.370+0000 7fd4b758a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd4b006c970 0x7fd4b006f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.370+0000 7fd4b758a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b0161d10 0x7fd4b006fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.370+0000 7fd4b758a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b006b990 con 0x7fd4b0099970 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.370+0000 7fd4b758a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b006bc70 con 0x7fd4b006c970 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.370+0000 7fd4b758a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b0161230 con 0x7fd4b0161d10 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.370+0000 7fd4b4b25640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b0161d10 0x7fd4b006fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4b5326640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd4b006c970 0x7fd4b006f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4b5326640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd4b006c970 0x7fd4b006f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:38818/0 (socket says 172.21.15.2:38818) 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4b5326640 1 -- 172.21.15.2:0/725450547 learned_addr learned my addr 172.21.15.2:0/725450547 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:33.373 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4b5b27640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd4b0099970 0x7fd4b006e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:36966/0 (socket says 172.21.15.2:36966) 2023-11-25T04:08:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4b5326640 1 -- 172.21.15.2:0/725450547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b0161d10 msgr2=0x7fd4b006fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4b5326640 1 --2- 172.21.15.2:0/725450547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b0161d10 0x7fd4b006fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4b5326640 1 -- 172.21.15.2:0/725450547 >> v1:172.21.15.66:6789/0 conn(0x7fd4b0099970 legacy=0x7fd4b006e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4b5326640 1 -- 172.21.15.2:0/725450547 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b0161510 con 0x7fd4b006c970 2023-11-25T04:08:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4affff640 1 -- 172.21.15.2:0/725450547 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938238258 0 0) 0x7fd4b006b990 con 0x7fd4b0099970 2023-11-25T04:08:33.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.371+0000 7fd4b4b25640 1 --2- 172.21.15.2:0/725450547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b0161d10 0x7fd4b006fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4b5326640 1 --2- 172.21.15.2:0/725450547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b006c970 0x7fd4b006f5d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009870 tx=0x7fd4a802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48b0b95a71f034d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4affff640 1 -- 172.21.15.2:0/725450547 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8030840 con 0x7fd4b006c970 2023-11-25T04:08:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4affff640 1 -- 172.21.15.2:0/725450547 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a80309a0 con 0x7fd4b006c970 2023-11-25T04:08:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4affff640 1 -- 172.21.15.2:0/725450547 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8030d30 con 0x7fd4b006c970 2023-11-25T04:08:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4b758a640 1 -- 172.21.15.2:0/725450547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b006c970 msgr2=0x7fd4b006f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4b758a640 1 --2- 172.21.15.2:0/725450547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b006c970 0x7fd4b006f5d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009870 tx=0x7fd4a802b980 comp rx=0 tx=0).stop 2023-11-25T04:08:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4b758a640 1 -- 172.21.15.2:0/725450547 shutdown_connections 2023-11-25T04:08:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4b758a640 1 --2- 172.21.15.2:0/725450547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b0161d10 0x7fd4b006fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4b758a640 1 --2- 172.21.15.2:0/725450547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b006c970 0x7fd4b006f5d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.372+0000 7fd4b758a640 1 -- 172.21.15.2:0/725450547 >> 172.21.15.2:0/725450547 conn(0x7fd4b00b2a90 msgr2=0x7fd4b00b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.373+0000 7fd4b758a640 1 -- 172.21.15.2:0/725450547 shutdown_connections 2023-11-25T04:08:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.373+0000 7fd4b758a640 1 -- 172.21.15.2:0/725450547 wait complete. 2023-11-25T04:08:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.374+0000 7fd4b758a640 1 Processor -- start 2023-11-25T04:08:33.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.374+0000 7fd4b758a640 1 -- start start 2023-11-25T04:08:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b758a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b0099970 0x7fd4b00b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b758a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0161d10 0x7fd4b00cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b758a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b015de50 0x7fd4b00b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b758a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b00b4c50 con 0x7fd4b0099970 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b758a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b00cdc60 con 0x7fd4b0161d10 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b758a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b01f4af0 con 0x7fd4b015de50 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5326640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b0099970 0x7fd4b00b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5326640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b0099970 0x7fd4b00b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57816/0 (socket says 172.21.15.2:57816) 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5326640 1 -- 172.21.15.2:0/3161342463 learned_addr learned my addr 172.21.15.2:0/3161342463 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5b27640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b015de50 0x7fd4b00b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b4b25640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0161d10 0x7fd4b00cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5326640 1 -- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b015de50 msgr2=0x7fd4b00b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5326640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b015de50 0x7fd4b00b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5326640 1 -- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0161d10 msgr2=0x7fd4b00cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:33.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5326640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0161d10 0x7fd4b00cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5326640 1 -- 172.21.15.2:0/3161342463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a4009400 con 0x7fd4b0099970 2023-11-25T04:08:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5b27640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b015de50 0x7fd4b00b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b4b25640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0161d10 0x7fd4b00cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b5326640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b0099970 0x7fd4b00b3af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80090b0 tx=0x7fd4a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4adffb640 1 -- 172.21.15.2:0/3161342463 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a803e040 con 0x7fd4b0099970 2023-11-25T04:08:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4adffb640 1 -- 172.21.15.2:0/3161342463 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a8039cb0 con 0x7fd4b0099970 2023-11-25T04:08:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a80094d0 con 0x7fd4b0099970 2023-11-25T04:08:33.381 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.375+0000 7fd4adffb640 1 -- 172.21.15.2:0/3161342463 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8004270 con 0x7fd4b0099970 2023-11-25T04:08:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.376+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b00b43b0 con 0x7fd4b0099970 2023-11-25T04:08:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.377+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b0067420 con 0x7fd4b0099970 2023-11-25T04:08:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.377+0000 7fd4adffb640 1 -- 172.21.15.2:0/3161342463 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4a80043d0 con 0x7fd4b0099970 2023-11-25T04:08:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.377+0000 7fd4adffb640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd49c06ae40 0x7fd49c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.378+0000 7fd4adffb640 1 -- 172.21.15.2:0/3161342463 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd4a80abd10 con 0x7fd4b0099970 2023-11-25T04:08:33.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.378+0000 7fd4b4b25640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd49c06ae40 0x7fd49c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:33.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.378+0000 7fd4b4b25640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd49c06ae40 0x7fd49c06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00cd440 tx=0x7fd4a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:33.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.382+0000 7fd4adffb640 1 -- 172.21.15.2:0/3161342463 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4a80771a0 con 0x7fd4b0099970 2023-11-25T04:08:33.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:33.558+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd4b00ce470 con 0x7fd4b0099970 2023-11-25T04:08:34.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.141+0000 7fd4adffb640 1 -- 172.21.15.2:0/3161342463 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd4a80490b0 con 0x7fd4b0099970 2023-11-25T04:08:34.143 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-25T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd49c06ae40 msgr2=0x7fd49c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd49c06ae40 0x7fd49c06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd4b00cd440 tx=0x7fd4a4008040 comp rx=0 tx=0).stop 2023-11-25T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b0099970 msgr2=0x7fd4b00b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b0099970 0x7fd4b00b3af0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80090b0 tx=0x7fd4a8004730 comp rx=0 tx=0).stop 2023-11-25T04:08:34.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 shutdown_connections 2023-11-25T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b015de50 0x7fd4b00b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd49c06ae40 0x7fd49c06d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b0161d10 0x7fd4b00cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 --2- 172.21.15.2:0/3161342463 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4b0099970 0x7fd4b00b3af0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 >> 172.21.15.2:0/3161342463 conn(0x7fd4b00b2a90 msgr2=0x7fd4b006ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 shutdown_connections 2023-11-25T04:08:34.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.144+0000 7fd4b758a640 1 -- 172.21.15.2:0/3161342463 wait complete. 2023-11-25T04:08:34.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-25T04:08:34.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.280+0000 7fe05b61e640 1 Processor -- start 2023-11-25T04:08:34.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.280+0000 7fe05b61e640 1 -- start start 2023-11-25T04:08:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.281+0000 7fe05b61e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0540d34d0 0x7fe054168030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.281+0000 7fe05b61e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540cf3d0 con 0x7fe05415d200 2023-11-25T04:08:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.281+0000 7fe05b61e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0540d0f70 con 0x7fe0540ce330 2023-11-25T04:08:34.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.281+0000 7fe05b61e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540cf860 con 0x7fe0540d34d0 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.281+0000 7fe0593ba640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe05415d200 0x7fe0540cdc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36918/0 (socket says 172.21.15.2:36918) 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.281+0000 7fe0593ba640 1 -- 172.21.15.2:0/307687941 learned_addr learned my addr 172.21.15.2:0/307687941 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe059bbb640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0540d34d0 0x7fe054168030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046794351 0 0) 0x7fe0540cf3d0 con 0x7fe05415d200 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe03c003520 con 0x7fe05415d200 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3911669029 0 0) 0x7fe03c003520 con 0x7fe05415d200 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0540d34d0 msgr2=0x7fe054168030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0540d34d0 0x7fe054168030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 >> v1:172.21.15.66:6789/0 conn(0x7fe0540ce330 legacy=0x7fe0540d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540ce7c0 con 0x7fe05415d200 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7fe04c001690 con 0x7fe05415d200 2023-11-25T04:08:34.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe059bbb640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0540d34d0 0x7fe054168030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 >> v1:172.21.15.2:6789/0 conn(0x7fe05415d200 legacy=0x7fe0540cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe03c0039a0 0x7fe03c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0540d34d0 0x7fe03c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe03c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540cf860 con 0x7fe03c004d00 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c00bb10 con 0x7fe03c0039a0 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c00bcd0 con 0x7fe0540d34d0 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe059bbb640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe03c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe058bb9640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0540d34d0 0x7fe03c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe0593ba640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe03c0039a0 0x7fe03c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe059bbb640 1 -- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0540d34d0 msgr2=0x7fe03c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:34.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe059bbb640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0540d34d0 0x7fe03c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe059bbb640 1 -- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe03c0039a0 msgr2=0x7fe03c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:34.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe059bbb640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe03c0039a0 0x7fe03c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.282+0000 7fe059bbb640 1 -- 172.21.15.2:0/307687941 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c003520 con 0x7fe03c004d00 2023-11-25T04:08:34.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.283+0000 7fe059bbb640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe03c005180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0440073b0 tx=0x7fe03c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec56517a7cd51d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:34.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.283+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04402cd30 con 0x7fe03c004d00 2023-11-25T04:08:34.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.283+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04402ce90 con 0x7fe03c004d00 2023-11-25T04:08:34.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.283+0000 7fe053fff640 1 -- 172.21.15.2:0/307687941 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044034640 con 0x7fe03c004d00 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.284+0000 7fe05b61e640 1 -- 172.21.15.2:0/307687941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 msgr2=0x7fe03c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.284+0000 7fe05b61e640 1 --2- 172.21.15.2:0/307687941 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe03c005180 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0440073b0 tx=0x7fe03c0057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.284+0000 7fe059bbb640 1 -- 172.21.15.2:0/307687941 reap_dead start 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.284+0000 7fe05b61e640 1 -- 172.21.15.2:0/307687941 shutdown_connections 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.284+0000 7fe05b61e640 1 -- 172.21.15.2:0/307687941 >> 172.21.15.2:0/307687941 conn(0x7fe05408cac0 msgr2=0x7fe05409c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.284+0000 7fe05b61e640 1 -- 172.21.15.2:0/307687941 shutdown_connections 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.284+0000 7fe05b61e640 1 -- 172.21.15.2:0/307687941 wait complete. 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.285+0000 7fe05b61e640 1 Processor -- start 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.285+0000 7fe05b61e640 1 -- start start 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe05b61e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe0540cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe05b61e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0540b8900 0x7fe0541602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:34.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe05b61e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0541f1b00 0x7fe0541f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe05b61e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540cbc40 con 0x7fe03c004d00 2023-11-25T04:08:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe05b61e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540cc4a0 con 0x7fe0540b8900 2023-11-25T04:08:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe05b61e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0540b8e20 con 0x7fe0541f1b00 2023-11-25T04:08:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe0593ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe0540cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe0593ba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe0540cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57836/0 (socket says 172.21.15.2:57836) 2023-11-25T04:08:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe0593ba640 1 -- 172.21.15.2:0/2156248010 learned_addr learned my addr 172.21.15.2:0/2156248010 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe058bb9640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0540b8900 0x7fe0541602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe059bbb640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0541f1b00 0x7fe0541f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:34.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe0593ba640 1 -- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0541f1b00 msgr2=0x7fe0541f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe0593ba640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0541f1b00 0x7fe0541f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe0593ba640 1 -- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0540b8900 msgr2=0x7fe0541602b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe0593ba640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0540b8900 0x7fe0541602b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe0593ba640 1 -- 172.21.15.2:0/2156248010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0540cbe50 con 0x7fe03c004d00 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe059bbb640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0541f1b00 0x7fe0541f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe058bb9640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0540b8900 0x7fe0541602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.286+0000 7fe0593ba640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe0540cc930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0072c0 tx=0x7fe04c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.287+0000 7fe051ffb640 1 -- 172.21.15.2:0/2156248010 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00f960 con 0x7fe03c004d00 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.287+0000 7fe051ffb640 1 -- 172.21.15.2:0/2156248010 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c00fac0 con 0x7fe03c004d00 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.287+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0540cc130 con 0x7fe03c004d00 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.287+0000 7fe051ffb640 1 -- 172.21.15.2:0/2156248010 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c00fe50 con 0x7fe03c004d00 2023-11-25T04:08:34.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.287+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0541607f0 con 0x7fe03c004d00 2023-11-25T04:08:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.288+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0540737a0 con 0x7fe03c004d00 2023-11-25T04:08:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.288+0000 7fe051ffb640 1 -- 172.21.15.2:0/2156248010 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe04c01d460 con 0x7fe03c004d00 2023-11-25T04:08:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.289+0000 7fe051ffb640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe04006ae70 0x7fe04006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.289+0000 7fe051ffb640 1 -- 172.21.15.2:0/2156248010 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe04c089620 con 0x7fe03c004d00 2023-11-25T04:08:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.289+0000 7fe058bb9640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe04006ae70 0x7fe04006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.289+0000 7fe058bb9640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe04006ae70 0x7fe04006d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0540b5ca0 tx=0x7fe048009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:34.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.293+0000 7fe051ffb640 1 -- 172.21.15.2:0/2156248010 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe04c058340 con 0x7fe03c004d00 2023-11-25T04:08:34.473 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:34.470+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe05404e8b0 con 0x7fe03c004d00 2023-11-25T04:08:35.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.143+0000 7fe051ffb640 1 -- 172.21.15.2:0/2156248010 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe04c057ed0 con 0x7fe03c004d00 2023-11-25T04:08:35.145 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-25T04:08:35.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.147+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe04006ae70 msgr2=0x7fe04006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe04006ae70 0x7fe04006d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe0540b5ca0 tx=0x7fe048009040 comp rx=0 tx=0).stop 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 msgr2=0x7fe0540cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe0540cc930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe04c0072c0 tx=0x7fe04c007780 comp rx=0 tx=0).stop 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 shutdown_connections 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0541f1b00 0x7fe0541f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe04006ae70 0x7fe04006d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0540b8900 0x7fe0541602b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 --2- 172.21.15.2:0/2156248010 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe03c004d00 0x7fe0540cc930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 >> 172.21.15.2:0/2156248010 conn(0x7fe05408cac0 msgr2=0x7fe05406bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.148+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 shutdown_connections 2023-11-25T04:08:35.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.149+0000 7fe05b61e640 1 -- 172.21.15.2:0/2156248010 wait complete. 2023-11-25T04:08:35.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-25T04:08:35.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.286+0000 7efc1eed3640 1 Processor -- start 2023-11-25T04:08:35.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.286+0000 7efc1eed3640 1 -- start start 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc1eed3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 0x7efc180ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc1eed3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc180cf730 0x7efc180d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc1eed3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efc180d1c40 0x7efc18161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc1eed3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180d08b0 con 0x7efc180cf730 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc1eed3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc180d20f0 con 0x7efc180d1c40 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc1eed3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc180cfc30 con 0x7efc1815d4c0 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc17fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc180cf730 0x7efc180d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc17fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efc180cf730 0x7efc180d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57852/0 (socket says 172.21.15.2:57852) 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc17fff640 1 -- 172.21.15.2:0/1639453248 learned_addr learned my addr 172.21.15.2:0/1639453248 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:35.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc17fff640 1 -- 172.21.15.2:0/1639453248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 msgr2=0x7efc180ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc1cc6f640 1 --2- 172.21.15.2:0/1639453248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 0x7efc180ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.287+0000 7efc1d470640 1 --2- 172.21.15.2:0/1639453248 >> v2:172.21.15.66:3300/0 conn(0x7efc180d1c40 0x7efc18161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.288+0000 7efc17fff640 1 --2- 172.21.15.2:0/1639453248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 0x7efc180ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.288+0000 7efc17fff640 1 -- 172.21.15.2:0/1639453248 >> v2:172.21.15.66:3300/0 conn(0x7efc180d1c40 msgr2=0x7efc18161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.288+0000 7efc17fff640 1 --2- 172.21.15.2:0/1639453248 >> v2:172.21.15.66:3300/0 conn(0x7efc180d1c40 0x7efc18161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.288+0000 7efc17fff640 1 -- 172.21.15.2:0/1639453248 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc180cff10 con 0x7efc180cf730 2023-11-25T04:08:35.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.288+0000 7efc1d470640 1 --2- 172.21.15.2:0/1639453248 >> v2:172.21.15.66:3300/0 conn(0x7efc180d1c40 0x7efc18161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:35.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.288+0000 7efc17fff640 1 --2- 172.21.15.2:0/1639453248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 0x7efc180d1700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc180b91a0 tx=0x7efc0c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1710f84b59f6c1a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:35.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.288+0000 7efc177fe640 1 -- 172.21.15.2:0/1639453248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c031870 con 0x7efc180cf730 2023-11-25T04:08:35.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc177fe640 1 -- 172.21.15.2:0/1639453248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0c0319d0 con 0x7efc180cf730 2023-11-25T04:08:35.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc177fe640 1 -- 172.21.15.2:0/1639453248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0c031d60 con 0x7efc180cf730 2023-11-25T04:08:35.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc1eed3640 1 -- 172.21.15.2:0/1639453248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 msgr2=0x7efc180d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:35.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1639453248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 0x7efc180d1700 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efc180b91a0 tx=0x7efc0c02b910 comp rx=0 tx=0).stop 2023-11-25T04:08:35.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc1eed3640 1 -- 172.21.15.2:0/1639453248 shutdown_connections 2023-11-25T04:08:35.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1639453248 >> v2:172.21.15.66:3300/0 conn(0x7efc180d1c40 0x7efc18161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1639453248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 0x7efc180d1700 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1639453248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 0x7efc180ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc1eed3640 1 -- 172.21.15.2:0/1639453248 >> 172.21.15.2:0/1639453248 conn(0x7efc1809c460 msgr2=0x7efc180d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc1eed3640 1 -- 172.21.15.2:0/1639453248 shutdown_connections 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.289+0000 7efc1eed3640 1 -- 172.21.15.2:0/1639453248 wait complete. 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.290+0000 7efc1eed3640 1 Processor -- start 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.290+0000 7efc1eed3640 1 -- start start 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1eed3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 0x7efc18157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1eed3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc180d1c40 0x7efc180b4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1eed3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 0x7efc180b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1eed3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b6cb0 con 0x7efc180cf730 2023-11-25T04:08:35.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1eed3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b6f90 con 0x7efc180d1c40 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1eed3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc180b7270 con 0x7efc1815d4c0 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1cc6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 0x7efc18157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1cc6f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 0x7efc18157460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57868/0 (socket says 172.21.15.2:57868) 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1cc6f640 1 -- 172.21.15.2:0/1934253789 learned_addr learned my addr 172.21.15.2:0/1934253789 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc1d470640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 0x7efc180b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.291+0000 7efc17fff640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc180d1c40 0x7efc180b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc1cc6f640 1 -- 172.21.15.2:0/1934253789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 msgr2=0x7efc180b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc1cc6f640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 0x7efc180b4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc1cc6f640 1 -- 172.21.15.2:0/1934253789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc180d1c40 msgr2=0x7efc180b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc1cc6f640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc180d1c40 0x7efc180b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc1cc6f640 1 -- 172.21.15.2:0/1934253789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc0c0094d0 con 0x7efc180cf730 2023-11-25T04:08:35.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc1cc6f640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 0x7efc18157460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c7f0 tx=0x7efc0800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc157fa640 1 -- 172.21.15.2:0/1934253789 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08004220 con 0x7efc180cf730 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc157fa640 1 -- 172.21.15.2:0/1934253789 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08004380 con 0x7efc180cf730 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc157fa640 1 -- 172.21.15.2:0/1934253789 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08007840 con 0x7efc180cf730 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc180b7550 con 0x7efc180cf730 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.292+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc181579a0 con 0x7efc180cf730 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.293+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc180b7a70 con 0x7efc180cf730 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.294+0000 7efc157fa640 1 -- 172.21.15.2:0/1934253789 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc08007bb0 con 0x7efc180cf730 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.294+0000 7efc157fa640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efc0406ae70 0x7efc0406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.294+0000 7efc157fa640 1 -- 172.21.15.2:0/1934253789 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7efc08089540 con 0x7efc180cf730 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.294+0000 7efc17fff640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efc0406ae70 0x7efc0406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:35.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.294+0000 7efc17fff640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efc0406ae70 0x7efc0406d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc0c036000 tx=0x7efc0c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:35.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.298+0000 7efc157fa640 1 -- 172.21.15.2:0/1934253789 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc180b7a70 con 0x7efc180cf730 2023-11-25T04:08:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:35.510+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7efc180b7a70 con 0x7efc180cf730 2023-11-25T04:08:36.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.167+0000 7efc157fa640 1 -- 172.21.15.2:0/1934253789 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7efc180b7a70 con 0x7efc180cf730 2023-11-25T04:08:36.169 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 2 and data pool 3 2023-11-25T04:08:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.169+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efc0406ae70 msgr2=0x7efc0406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.169+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efc0406ae70 0x7efc0406d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc0c036000 tx=0x7efc0c03c040 comp rx=0 tx=0).stop 2023-11-25T04:08:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 msgr2=0x7efc18157460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 0x7efc18157460 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c7f0 tx=0x7efc0800ccb0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 shutdown_connections 2023-11-25T04:08:36.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc1815d4c0 0x7efc180b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efc0406ae70 0x7efc0406d330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc180d1c40 0x7efc180b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 --2- 172.21.15.2:0/1934253789 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efc180cf730 0x7efc18157460 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 >> 172.21.15.2:0/1934253789 conn(0x7efc1809c460 msgr2=0x7efc1815dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:36.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 shutdown_connections 2023-11-25T04:08:36.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.170+0000 7efc1eed3640 1 -- 172.21.15.2:0/1934253789 wait complete. 2023-11-25T04:08:36.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:36.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.298+0000 7fbc65c7c640 1 Processor -- start 2023-11-25T04:08:36.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.298+0000 7fbc65c7c640 1 -- start start 2023-11-25T04:08:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc65c7c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc600b2690 0x7fbc6015d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc65c7c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 0x7fbc6006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc65c7c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6006e9e0 con 0x7fbc6006cc50 2023-11-25T04:08:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc65c7c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6006d0d0 con 0x7fbc600b2690 2023-11-25T04:08:36.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc65c7c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6006d2e0 con 0x7fbc6006a8b0 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc5f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc600b2690 0x7fbc6015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc5f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbc600b2690 0x7fbc6015d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57874/0 (socket says 172.21.15.2:57874) 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc5f7fe640 1 -- 172.21.15.2:0/2307935665 learned_addr learned my addr 172.21.15.2:0/2307935665 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc5ffff640 1 --2- 172.21.15.2:0/2307935665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 0x7fbc6006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc5f7fe640 1 -- 172.21.15.2:0/2307935665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 msgr2=0x7fbc6006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc5f7fe640 1 --2- 172.21.15.2:0/2307935665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 0x7fbc6006ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc5f7fe640 1 -- 172.21.15.2:0/2307935665 >> v1:172.21.15.66:6789/0 conn(0x7fbc6006cc50 legacy=0x7fbc600b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc5f7fe640 1 -- 172.21.15.2:0/2307935665 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6006de60 con 0x7fbc600b2690 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.299+0000 7fbc5ffff640 1 --2- 172.21.15.2:0/2307935665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 0x7fbc6006ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.300+0000 7fbc5f7fe640 1 --2- 172.21.15.2:0/2307935665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc600b2690 0x7fbc6015d800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009870 tx=0x7fbc5002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08c9e461da6e83b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:36.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.300+0000 7fbc5e7fc640 1 -- 172.21.15.2:0/2307935665 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc500317c0 con 0x7fbc600b2690 2023-11-25T04:08:36.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.300+0000 7fbc5e7fc640 1 -- 172.21.15.2:0/2307935665 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc50031920 con 0x7fbc600b2690 2023-11-25T04:08:36.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.300+0000 7fbc5e7fc640 1 -- 172.21.15.2:0/2307935665 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50031cb0 con 0x7fbc600b2690 2023-11-25T04:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.301+0000 7fbc65c7c640 1 -- 172.21.15.2:0/2307935665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc600b2690 msgr2=0x7fbc6015d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.301+0000 7fbc65c7c640 1 --2- 172.21.15.2:0/2307935665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc600b2690 0x7fbc6015d800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009870 tx=0x7fbc5002b860 comp rx=0 tx=0).stop 2023-11-25T04:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.301+0000 7fbc65c7c640 1 -- 172.21.15.2:0/2307935665 shutdown_connections 2023-11-25T04:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.301+0000 7fbc65c7c640 1 --2- 172.21.15.2:0/2307935665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 0x7fbc6006ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.301+0000 7fbc65c7c640 1 --2- 172.21.15.2:0/2307935665 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc600b2690 0x7fbc6015d800 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.301+0000 7fbc65c7c640 1 -- 172.21.15.2:0/2307935665 >> 172.21.15.2:0/2307935665 conn(0x7fbc600cf6a0 msgr2=0x7fbc600cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:36.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.301+0000 7fbc65c7c640 1 -- 172.21.15.2:0/2307935665 shutdown_connections 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.301+0000 7fbc65c7c640 1 -- 172.21.15.2:0/2307935665 wait complete. 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.302+0000 7fbc65c7c640 1 Processor -- start 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.302+0000 7fbc65c7c640 1 -- start start 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc65c7c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 0x7fbc6014c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc65c7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc6006cc50 0x7fbc60154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc65c7c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc600b2690 0x7fbc60155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc65c7c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600cc4f0 con 0x7fbc6006cc50 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc65c7c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60157270 con 0x7fbc600b2690 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc65c7c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6014caa0 con 0x7fbc6006a8b0 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc6006cc50 0x7fbc60154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc6006cc50 0x7fbc60154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57876/0 (socket says 172.21.15.2:57876) 2023-11-25T04:08:36.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5effd640 1 -- 172.21.15.2:0/3201720545 learned_addr learned my addr 172.21.15.2:0/3201720545 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5ffff640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc600b2690 0x7fbc60155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5f7fe640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 0x7fbc6014c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5effd640 1 -- 172.21.15.2:0/3201720545 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 msgr2=0x7fbc6014c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5effd640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 0x7fbc6014c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5effd640 1 -- 172.21.15.2:0/3201720545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc600b2690 msgr2=0x7fbc60155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5effd640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc600b2690 0x7fbc60155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5effd640 1 -- 172.21.15.2:0/3201720545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc500094d0 con 0x7fbc6006cc50 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.303+0000 7fbc5ffff640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc600b2690 0x7fbc60155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.304+0000 7fbc5effd640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc6006cc50 0x7fbc60154dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c430 tx=0x7fbc5400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.304+0000 7fbc47fff640 1 -- 172.21.15.2:0/3201720545 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54011790 con 0x7fbc6006cc50 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.304+0000 7fbc47fff640 1 -- 172.21.15.2:0/3201720545 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc540118f0 con 0x7fbc6006cc50 2023-11-25T04:08:36.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.304+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc60155940 con 0x7fbc6006cc50 2023-11-25T04:08:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.304+0000 7fbc47fff640 1 -- 172.21.15.2:0/3201720545 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54011ce0 con 0x7fbc6006cc50 2023-11-25T04:08:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.304+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc600cbea0 con 0x7fbc6006cc50 2023-11-25T04:08:36.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.305+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc600cc660 con 0x7fbc6006cc50 2023-11-25T04:08:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.305+0000 7fbc47fff640 1 -- 172.21.15.2:0/3201720545 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc5401c460 con 0x7fbc6006cc50 2023-11-25T04:08:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.306+0000 7fbc47fff640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbc4c06ae40 0x7fbc4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.306+0000 7fbc5f7fe640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbc4c06ae40 0x7fbc4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.306+0000 7fbc47fff640 1 -- 172.21.15.2:0/3201720545 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc540894d0 con 0x7fbc6006cc50 2023-11-25T04:08:36.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.306+0000 7fbc5f7fe640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbc4c06ae40 0x7fbc4c06d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc50036000 tx=0x7fbc5003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:36.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.310+0000 7fbc47fff640 1 -- 172.21.15.2:0/3201720545 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc54054610 con 0x7fbc6006cc50 2023-11-25T04:08:36.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:08:36.400 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:08:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.489+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc60067420 con 0x7fbc6006cc50 2023-11-25T04:08:36.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.490+0000 7fbc47fff640 1 -- 172.21.15.2:0/3201720545 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16410 (secure 0 0 0) 0x7fbc54057c30 con 0x7fbc6006cc50 2023-11-25T04:08:36.493 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:36.493 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:35.512014+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbc4c06ae40 msgr2=0x7fbc4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbc4c06ae40 0x7fbc4c06d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc50036000 tx=0x7fbc5003d040 comp rx=0 tx=0).stop 2023-11-25T04:08:36.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc6006cc50 msgr2=0x7fbc60154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc6006cc50 0x7fbc60154dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400c430 tx=0x7fbc5400c8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 shutdown_connections 2023-11-25T04:08:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbc4c06ae40 0x7fbc4c06d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc600b2690 0x7fbc60155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbc6006cc50 0x7fbc60154dd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 --2- 172.21.15.2:0/3201720545 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc6006a8b0 0x7fbc6014c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 >> 172.21.15.2:0/3201720545 conn(0x7fbc600cf6a0 msgr2=0x7fbc6006b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 shutdown_connections 2023-11-25T04:08:36.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.492+0000 7fbc65c7c640 1 -- 172.21.15.2:0/3201720545 wait complete. 2023-11-25T04:08:36.505 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:36.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.649+0000 7fb01eda9640 1 Processor -- start 2023-11-25T04:08:36.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.650+0000 7fb01eda9640 1 -- start start 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.650+0000 7fb01eda9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb01815d3e0 0x7fb0180ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.650+0000 7fb01eda9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb0180ced30 0x7fb0180d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.650+0000 7fb01eda9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180d1c60 0x7fb0180b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.650+0000 7fb01eda9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180cf170 con 0x7fb01815d3e0 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.650+0000 7fb01eda9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180d20f0 con 0x7fb0180ced30 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.650+0000 7fb01eda9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180b5f90 con 0x7fb0180d1c60 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb01cb45640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb01815d3e0 0x7fb0180ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb01cb45640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb01815d3e0 0x7fb0180ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57888/0 (socket says 172.21.15.2:57888) 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb01cb45640 1 -- 172.21.15.2:0/409194503 learned_addr learned my addr 172.21.15.2:0/409194503 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb01d346640 1 --2- 172.21.15.2:0/409194503 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180d1c60 0x7fb0180b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb017fff640 1 --2- 172.21.15.2:0/409194503 >> v2:172.21.15.66:3300/0 conn(0x7fb0180ced30 0x7fb0180d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb01cb45640 1 -- 172.21.15.2:0/409194503 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180d1c60 msgr2=0x7fb0180b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:36.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb01cb45640 1 --2- 172.21.15.2:0/409194503 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180d1c60 0x7fb0180b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb01cb45640 1 -- 172.21.15.2:0/409194503 >> v2:172.21.15.66:3300/0 conn(0x7fb0180ced30 msgr2=0x7fb0180d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:36.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb01cb45640 1 --2- 172.21.15.2:0/409194503 >> v2:172.21.15.66:3300/0 conn(0x7fb0180ced30 0x7fb0180d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.651+0000 7fb01cb45640 1 -- 172.21.15.2:0/409194503 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180b61e0 con 0x7fb01815d3e0 2023-11-25T04:08:36.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01cb45640 1 --2- 172.21.15.2:0/409194503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 0x7fb0180ce7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb018073d50 tx=0x7fb01002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff44f28e124a51f server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:36.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb0177fe640 1 -- 172.21.15.2:0/409194503 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01002cb00 con 0x7fb01815d3e0 2023-11-25T04:08:36.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb0177fe640 1 -- 172.21.15.2:0/409194503 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01002cc60 con 0x7fb01815d3e0 2023-11-25T04:08:36.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb0177fe640 1 -- 172.21.15.2:0/409194503 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100343f0 con 0x7fb01815d3e0 2023-11-25T04:08:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01eda9640 1 -- 172.21.15.2:0/409194503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 msgr2=0x7fb0180ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01eda9640 1 --2- 172.21.15.2:0/409194503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 0x7fb0180ce7f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb018073d50 tx=0x7fb01002bf60 comp rx=0 tx=0).stop 2023-11-25T04:08:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01eda9640 1 -- 172.21.15.2:0/409194503 shutdown_connections 2023-11-25T04:08:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01eda9640 1 --2- 172.21.15.2:0/409194503 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180d1c60 0x7fb0180b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01eda9640 1 --2- 172.21.15.2:0/409194503 >> v2:172.21.15.66:3300/0 conn(0x7fb0180ced30 0x7fb0180d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01eda9640 1 --2- 172.21.15.2:0/409194503 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 0x7fb0180ce7f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01eda9640 1 -- 172.21.15.2:0/409194503 >> 172.21.15.2:0/409194503 conn(0x7fb01809c480 msgr2=0x7fb0180d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01eda9640 1 -- 172.21.15.2:0/409194503 shutdown_connections 2023-11-25T04:08:36.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.652+0000 7fb01eda9640 1 -- 172.21.15.2:0/409194503 wait complete. 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.653+0000 7fb01eda9640 1 Processor -- start 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.654+0000 7fb01eda9640 1 -- start start 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.654+0000 7fb01eda9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180ced30 0x7fb01815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.654+0000 7fb01eda9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0180d1c60 0x7fb01809deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.654+0000 7fb01eda9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 0x7fb01809fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.654+0000 7fb01eda9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01815ad00 con 0x7fb01815d3e0 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.654+0000 7fb01eda9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01809f540 con 0x7fb0180d1c60 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.654+0000 7fb01eda9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01809e930 con 0x7fb0180ced30 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01d346640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 0x7fb01809fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01d346640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 0x7fb01809fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57902/0 (socket says 172.21.15.2:57902) 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01d346640 1 -- 172.21.15.2:0/981147281 learned_addr learned my addr 172.21.15.2:0/981147281 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:36.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb017fff640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0180d1c60 0x7fb01809deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01cb45640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180ced30 0x7fb01815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01d346640 1 -- 172.21.15.2:0/981147281 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180ced30 msgr2=0x7fb01815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01d346640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180ced30 0x7fb01815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01d346640 1 -- 172.21.15.2:0/981147281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0180d1c60 msgr2=0x7fb01809deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01d346640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0180d1c60 0x7fb01809deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01d346640 1 -- 172.21.15.2:0/981147281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010009b30 con 0x7fb01815d3e0 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01d346640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 0x7fb01809fe90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb00800d800 tx=0x7fb00800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb0157fa640 1 -- 172.21.15.2:0/981147281 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800b6c0 con 0x7fb01815d3e0 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb0157fa640 1 -- 172.21.15.2:0/981147281 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00800b840 con 0x7fb01815d3e0 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01809ec10 con 0x7fb01815d3e0 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb0157fa640 1 -- 172.21.15.2:0/981147281 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00800bbf0 con 0x7fb01815d3e0 2023-11-25T04:08:36.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.655+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01809f1d0 con 0x7fb01815d3e0 2023-11-25T04:08:36.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.656+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01809f6b0 con 0x7fb01815d3e0 2023-11-25T04:08:36.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.657+0000 7fb0157fa640 1 -- 172.21.15.2:0/981147281 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb00800bd50 con 0x7fb01815d3e0 2023-11-25T04:08:36.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.657+0000 7fb0157fa640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faff806ae40 0x7faff806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.657+0000 7fb0157fa640 1 -- 172.21.15.2:0/981147281 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb008089a80 con 0x7fb01815d3e0 2023-11-25T04:08:36.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.657+0000 7fb01cb45640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faff806ae40 0x7faff806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.658+0000 7fb01cb45640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faff806ae40 0x7faff806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb010035000 tx=0x7fb010030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:36.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.661+0000 7fb0157fa640 1 -- 172.21.15.2:0/981147281 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb008054b40 con 0x7fb01815d3e0 2023-11-25T04:08:36.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.839+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb018067420 con 0x7fb01815d3e0 2023-11-25T04:08:36.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.840+0000 7fb0157fa640 1 -- 172.21.15.2:0/981147281 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16410 (secure 0 0 0) 0x7fb008058160 con 0x7fb01815d3e0 2023-11-25T04:08:36.842 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:36.842 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":19,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:35.512014+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.841+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faff806ae40 msgr2=0x7faff806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.841+0000 7fb01eda9640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faff806ae40 0x7faff806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb010035000 tx=0x7fb010030000 comp rx=0 tx=0).stop 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.841+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 msgr2=0x7fb01809fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.841+0000 7fb01eda9640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 0x7fb01809fe90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb00800d800 tx=0x7fb00800dcc0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.842+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 shutdown_connections 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.842+0000 7fb01eda9640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb01815d3e0 0x7fb01809fe90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.842+0000 7fb01eda9640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faff806ae40 0x7faff806d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.842+0000 7fb01eda9640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0180d1c60 0x7fb01809deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.842+0000 7fb01eda9640 1 --2- 172.21.15.2:0/981147281 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0180ced30 0x7fb01815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.842+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 >> 172.21.15.2:0/981147281 conn(0x7fb01809c480 msgr2=0x7fb0180b8470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.842+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 shutdown_connections 2023-11-25T04:08:36.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.842+0000 7fb01eda9640 1 -- 172.21.15.2:0/981147281 wait complete. 2023-11-25T04:08:36.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-25T04:08:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.964+0000 7faa59789640 1 Processor -- start 2023-11-25T04:08:36.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.964+0000 7faa59789640 1 -- start start 2023-11-25T04:08:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.965+0000 7faa59789640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faa540b2aa0 0x7faa54168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.965+0000 7faa59789640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa540ce360 con 0x7faa54160b70 2023-11-25T04:08:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.965+0000 7faa59789640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa540d19f0 con 0x7faa540d1570 2023-11-25T04:08:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.965+0000 7faa59789640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa540cdd50 con 0x7faa540b2aa0 2023-11-25T04:08:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.965+0000 7faa52ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7faa54160b70 0x7faa540ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36934/0 (socket says 172.21.15.2:36934) 2023-11-25T04:08:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.965+0000 7faa52ffd640 1 -- 172.21.15.2:0/660052547 learned_addr learned my addr 172.21.15.2:0/660052547 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:36.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.965+0000 7faa537fe640 1 --2- 172.21.15.2:0/660052547 >> v2:172.21.15.66:3300/0 conn(0x7faa540b2aa0 0x7faa54168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.965+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683520377 0 0) 0x7faa540ce360 con 0x7faa54160b70 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.965+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa40003520 con 0x7faa54160b70 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670841477 0 0) 0x7faa40003520 con 0x7faa54160b70 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 >> v2:172.21.15.66:3300/0 conn(0x7faa540b2aa0 msgr2=0x7faa54168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 --2- 172.21.15.2:0/660052547 >> v2:172.21.15.66:3300/0 conn(0x7faa540b2aa0 0x7faa54168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 >> v1:172.21.15.66:6789/0 conn(0x7faa540d1570 legacy=0x7faa540cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540b2ed0 con 0x7faa54160b70 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7faa4c001670 con 0x7faa54160b70 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa537fe640 1 --2- 172.21.15.2:0/660052547 >> v2:172.21.15.66:3300/0 conn(0x7faa540b2aa0 0x7faa54168560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 >> v1:172.21.15.2:6789/0 conn(0x7faa54160b70 legacy=0x7faa540ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa40003970 0x7faa40003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa400047c0 0x7faa40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa40005180 0x7faa4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa540cdd50 con 0x7faa400047c0 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4000bfd0 con 0x7faa40005180 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4000c190 con 0x7faa40003970 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa527fc640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa400047c0 0x7faa40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa52ffd640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa40003970 0x7faa40003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa537fe640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa40005180 0x7faa4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa527fc640 1 -- 172.21.15.2:0/660052547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa40003970 msgr2=0x7faa40003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa527fc640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa40003970 0x7faa40003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa527fc640 1 -- 172.21.15.2:0/660052547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa40005180 msgr2=0x7faa4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa527fc640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa40005180 0x7faa4000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa527fc640 1 -- 172.21.15.2:0/660052547 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa40003520 con 0x7faa400047c0 2023-11-25T04:08:36.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa537fe640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa40005180 0x7faa4000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.966+0000 7faa537fe640 1 -- 172.21.15.2:0/660052547 reap_dead start 2023-11-25T04:08:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.967+0000 7faa527fc640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa400047c0 0x7faa40004c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faa3c001860 tx=0x7faa400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3069fcddbb09257c server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.967+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c02f050 con 0x7faa400047c0 2023-11-25T04:08:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.967+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c033610 con 0x7faa400047c0 2023-11-25T04:08:36.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.967+0000 7faa51ffb640 1 -- 172.21.15.2:0/660052547 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0339c0 con 0x7faa400047c0 2023-11-25T04:08:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.968+0000 7faa59789640 1 -- 172.21.15.2:0/660052547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa400047c0 msgr2=0x7faa40004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.968+0000 7faa59789640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa400047c0 0x7faa40004c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faa3c001860 tx=0x7faa400057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.968+0000 7faa59789640 1 -- 172.21.15.2:0/660052547 shutdown_connections 2023-11-25T04:08:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.968+0000 7faa59789640 1 --2- 172.21.15.2:0/660052547 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa400047c0 0x7faa40004c40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.968+0000 7faa59789640 1 -- 172.21.15.2:0/660052547 >> 172.21.15.2:0/660052547 conn(0x7faa5409c470 msgr2=0x7faa540d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.968+0000 7faa59789640 1 -- 172.21.15.2:0/660052547 shutdown_connections 2023-11-25T04:08:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.968+0000 7faa59789640 1 -- 172.21.15.2:0/660052547 wait complete. 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.969+0000 7faa59789640 1 Processor -- start 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.969+0000 7faa59789640 1 -- start start 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa59789640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa400047c0 0x7faa540c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa59789640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa541f4890 0x7faa540b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa59789640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa540b5bc0 0x7faa541f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa59789640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541f5a80 con 0x7faa541f4890 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa59789640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa540b6040 con 0x7faa540b5bc0 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa59789640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa541f4e00 con 0x7faa400047c0 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa541f4890 0x7faa540b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa527fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa541f4890 0x7faa540b5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57910/0 (socket says 172.21.15.2:57910) 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa527fc640 1 -- 172.21.15.2:0/1949819344 learned_addr learned my addr 172.21.15.2:0/1949819344 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:36.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa52ffd640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa400047c0 0x7faa540c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa537fe640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa540b5bc0 0x7faa541f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa527fc640 1 -- 172.21.15.2:0/1949819344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa400047c0 msgr2=0x7faa540c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa527fc640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa400047c0 0x7faa540c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa527fc640 1 -- 172.21.15.2:0/1949819344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa540b5bc0 msgr2=0x7faa541f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa527fc640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa540b5bc0 0x7faa541f5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa527fc640 1 -- 172.21.15.2:0/1949819344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa541f50e0 con 0x7faa541f4890 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.970+0000 7faa527fc640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa541f4890 0x7faa540b5680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faa3c02bd30 tx=0x7faa3c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.971+0000 7faa4b7fe640 1 -- 172.21.15.2:0/1949819344 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c007460 con 0x7faa541f4890 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.971+0000 7faa4b7fe640 1 -- 172.21.15.2:0/1949819344 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c0075c0 con 0x7faa541f4890 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.971+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa541f53c0 con 0x7faa541f4890 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.971+0000 7faa4b7fe640 1 -- 172.21.15.2:0/1949819344 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c0069d0 con 0x7faa541f4890 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.971+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa540c7930 con 0x7faa541f4890 2023-11-25T04:08:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.972+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa541f5bc0 con 0x7faa541f4890 2023-11-25T04:08:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.972+0000 7faa4b7fe640 1 -- 172.21.15.2:0/1949819344 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa3c006b30 con 0x7faa541f4890 2023-11-25T04:08:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.972+0000 7faa4b7fe640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa3406ae70 0x7faa3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.972+0000 7faa4b7fe640 1 -- 172.21.15.2:0/1949819344 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa3c0ab7e0 con 0x7faa541f4890 2023-11-25T04:08:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.972+0000 7faa52ffd640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa3406ae70 0x7faa3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.973+0000 7faa52ffd640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa3406ae70 0x7faa3406d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa4c007c80 tx=0x7faa4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:36.976+0000 7faa4b7fe640 1 -- 172.21.15.2:0/1949819344 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa541f5bc0 con 0x7faa541f4890 2023-11-25T04:08:37.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:37.194+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7faa540a1150 con 0x7faa541f4890 2023-11-25T04:08:38.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.175+0000 7faa4b7fe640 1 -- 172.21.15.2:0/1949819344 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7faa3c0410b0 con 0x7faa541f4890 2023-11-25T04:08:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa3406ae70 msgr2=0x7faa3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa3406ae70 0x7faa3406d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faa4c007c80 tx=0x7faa4c009040 comp rx=0 tx=0).stop 2023-11-25T04:08:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa541f4890 msgr2=0x7faa540b5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa541f4890 0x7faa540b5680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faa3c02bd30 tx=0x7faa3c001230 comp rx=0 tx=0).stop 2023-11-25T04:08:38.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 shutdown_connections 2023-11-25T04:08:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faa3406ae70 0x7faa3406d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa540b5bc0 0x7faa541f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faa541f4890 0x7faa540b5680 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 --2- 172.21.15.2:0/1949819344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa400047c0 0x7faa540c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 >> 172.21.15.2:0/1949819344 conn(0x7faa5409c470 msgr2=0x7faa540b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 shutdown_connections 2023-11-25T04:08:38.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.179+0000 7faa59789640 1 -- 172.21.15.2:0/1949819344 wait complete. 2023-11-25T04:08:38.194 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-25T04:08:38.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-25T04:08:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.308+0000 7fd214e31640 1 Processor -- start 2023-11-25T04:08:38.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.308+0000 7fd214e31640 1 -- start start 2023-11-25T04:08:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.309+0000 7fd214e31640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd210071640 0x7fd210164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.309+0000 7fd214e31640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21015b530 con 0x7fd21015b0d0 2023-11-25T04:08:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.309+0000 7fd214e31640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2100ce060 con 0x7fd21013f750 2023-11-25T04:08:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.309+0000 7fd214e31640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2100cec70 con 0x7fd210071640 2023-11-25T04:08:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.309+0000 7fd20dd9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd21015b0d0 0x7fd2100cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:36940/0 (socket says 172.21.15.2:36940) 2023-11-25T04:08:38.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.309+0000 7fd20dd9b640 1 -- 172.21.15.2:0/1633582233 learned_addr learned my addr 172.21.15.2:0/1633582233 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.309+0000 7fd20ed9d640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd210071640 0x7fd210164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.309+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007228734 0 0) 0x7fd21015b530 con 0x7fd21015b0d0 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1fc005730 con 0x7fd21015b0d0 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4090666111 0 0) 0x7fd1fc005730 con 0x7fd21015b0d0 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd210071640 msgr2=0x7fd210164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd210071640 0x7fd210164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 >> v1:172.21.15.66:6789/0 conn(0x7fd21013f750 legacy=0x7fd21013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2100ce340 con 0x7fd21015b0d0 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7fd1f8001690 con 0x7fd21015b0d0 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 >> v1:172.21.15.2:6789/0 conn(0x7fd21015b0d0 legacy=0x7fd2100cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1fc005bb0 0x7fd1fc005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:38.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd210071640 0x7fd1fc0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1fc006f10 0x7fd1fc007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2100cec70 con 0x7fd1fc005bb0 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc00dbc0 con 0x7fd1fc006f10 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1fc00dd80 con 0x7fd210071640 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20e59c640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1fc005bb0 0x7fd1fc005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20dd9b640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd210071640 0x7fd1fc0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20ed9d640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1fc006f10 0x7fd1fc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20e59c640 1 -- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd210071640 msgr2=0x7fd1fc0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20e59c640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd210071640 0x7fd1fc0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20e59c640 1 -- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1fc006f10 msgr2=0x7fd1fc007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20e59c640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1fc006f10 0x7fd1fc007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:38.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.310+0000 7fd20e59c640 1 -- 172.21.15.2:0/1633582233 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc005730 con 0x7fd1fc005bb0 2023-11-25T04:08:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.311+0000 7fd20e59c640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1fc005bb0 0x7fd1fc005f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd200001f60 tx=0x7fd1fc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb62c29c345a7b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.311+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20002d670 con 0x7fd1fc005bb0 2023-11-25T04:08:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.311+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20002d7f0 con 0x7fd1fc005bb0 2023-11-25T04:08:38.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.311+0000 7fd20d59a640 1 -- 172.21.15.2:0/1633582233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20002dba0 con 0x7fd1fc005bb0 2023-11-25T04:08:38.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.312+0000 7fd214e31640 1 -- 172.21.15.2:0/1633582233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1fc005bb0 msgr2=0x7fd1fc005f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:38.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.312+0000 7fd214e31640 1 --2- 172.21.15.2:0/1633582233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1fc005bb0 0x7fd1fc005f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd200001f60 tx=0x7fd1fc007a00 comp rx=0 tx=0).stop 2023-11-25T04:08:38.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.312+0000 7fd20ed9d640 1 -- 172.21.15.2:0/1633582233 reap_dead start 2023-11-25T04:08:38.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.312+0000 7fd214e31640 1 -- 172.21.15.2:0/1633582233 shutdown_connections 2023-11-25T04:08:38.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.312+0000 7fd214e31640 1 -- 172.21.15.2:0/1633582233 >> 172.21.15.2:0/1633582233 conn(0x7fd21006a8f0 msgr2=0x7fd21006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:38.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.312+0000 7fd214e31640 1 -- 172.21.15.2:0/1633582233 shutdown_connections 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.312+0000 7fd214e31640 1 -- 172.21.15.2:0/1633582233 wait complete. 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.313+0000 7fd214e31640 1 Processor -- start 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.313+0000 7fd214e31640 1 -- start start 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd214e31640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1fc005bb0 0x7fd2101f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd214e31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd210134cd0 0x7fd210156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd214e31640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2100b0ab0 0x7fd2100b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd214e31640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2100b14a0 con 0x7fd210134cd0 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd214e31640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd210157c90 con 0x7fd2100b0ab0 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd214e31640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd210156bf0 con 0x7fd1fc005bb0 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd210134cd0 0x7fd210156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20dd9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd210134cd0 0x7fd210156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:57932/0 (socket says 172.21.15.2:57932) 2023-11-25T04:08:38.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20dd9b640 1 -- 172.21.15.2:0/3693715326 learned_addr learned my addr 172.21.15.2:0/3693715326 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20e59c640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1fc005bb0 0x7fd2101f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20ed9d640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2100b0ab0 0x7fd2100b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20dd9b640 1 -- 172.21.15.2:0/3693715326 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1fc005bb0 msgr2=0x7fd2101f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20dd9b640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1fc005bb0 0x7fd2101f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20dd9b640 1 -- 172.21.15.2:0/3693715326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2100b0ab0 msgr2=0x7fd2100b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20dd9b640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2100b0ab0 0x7fd2100b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.314+0000 7fd20dd9b640 1 -- 172.21.15.2:0/3693715326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd210156ed0 con 0x7fd210134cd0 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.315+0000 7fd20dd9b640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd210134cd0 0x7fd210156280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8007290 tx=0x7fd1f8007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.315+0000 7fd206ffd640 1 -- 172.21.15.2:0/3693715326 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800f960 con 0x7fd210134cd0 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.315+0000 7fd206ffd640 1 -- 172.21.15.2:0/3693715326 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f800fb00 con 0x7fd210134cd0 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.315+0000 7fd206ffd640 1 -- 172.21.15.2:0/3693715326 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f800feb0 con 0x7fd210134cd0 2023-11-25T04:08:38.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.315+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2101571b0 con 0x7fd210134cd0 2023-11-25T04:08:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.315+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd210157770 con 0x7fd210134cd0 2023-11-25T04:08:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.316+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2100b1b70 con 0x7fd210134cd0 2023-11-25T04:08:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.316+0000 7fd206ffd640 1 -- 172.21.15.2:0/3693715326 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1f801d460 con 0x7fd210134cd0 2023-11-25T04:08:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.317+0000 7fd206ffd640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd1f006ae40 0x7fd1f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.317+0000 7fd206ffd640 1 -- 172.21.15.2:0/3693715326 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1f80895e0 con 0x7fd210134cd0 2023-11-25T04:08:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.317+0000 7fd20e59c640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd1f006ae40 0x7fd1f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:38.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.317+0000 7fd20e59c640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd1f006ae40 0x7fd1f006d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd200036000 tx=0x7fd200031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:38.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.321+0000 7fd206ffd640 1 -- 172.21.15.2:0/3693715326 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1f8054720 con 0x7fd210134cd0 2023-11-25T04:08:38.535 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:38.533+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd21004e920 con 0x7fd210134cd0 2023-11-25T04:08:39.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.179+0000 7fd206ffd640 1 -- 172.21.15.2:0/3693715326 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd1f8057d40 con 0x7fd210134cd0 2023-11-25T04:08:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd1f006ae40 msgr2=0x7fd1f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd1f006ae40 0x7fd1f006d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd200036000 tx=0x7fd200031000 comp rx=0 tx=0).stop 2023-11-25T04:08:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd210134cd0 msgr2=0x7fd210156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd210134cd0 0x7fd210156280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd1f8007290 tx=0x7fd1f8007690 comp rx=0 tx=0).stop 2023-11-25T04:08:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 shutdown_connections 2023-11-25T04:08:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd1f006ae40 0x7fd1f006d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2100b0ab0 0x7fd2100b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd210134cd0 0x7fd210156280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 --2- 172.21.15.2:0/3693715326 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1fc005bb0 0x7fd2101f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 >> 172.21.15.2:0/3693715326 conn(0x7fd21006a8f0 msgr2=0x7fd210159870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:39.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 shutdown_connections 2023-11-25T04:08:39.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.182+0000 7fd214e31640 1 -- 172.21.15.2:0/3693715326 wait complete. 2023-11-25T04:08:39.198 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-25T04:08:39.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:08:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.310+0000 7fb2a9a31640 1 Processor -- start 2023-11-25T04:08:39.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.310+0000 7fb2a9a31640 1 -- start start 2023-11-25T04:08:39.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a9a31640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb2a40cce70 0x7fb2a4099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a9a31640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d0ab0 0x7fb2a4099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a9a31640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2a40d1c50 0x7fb2a406e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a9a31640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a406bfa0 con 0x7fb2a40d1c50 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a9a31640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a406f9d0 con 0x7fb2a40cce70 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a9a31640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a406c190 con 0x7fb2a40d0ab0 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2a40d1c50 0x7fb2a406e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb2a40d1c50 0x7fb2a406e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52972/0 (socket says 172.21.15.2:52972) 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a37fe640 1 -- 172.21.15.2:0/1953289975 learned_addr learned my addr 172.21.15.2:0/1953289975 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a2ffd640 1 --2- 172.21.15.2:0/1953289975 >> v2:172.21.15.66:3300/0 conn(0x7fb2a40cce70 0x7fb2a4099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a27fc640 1 --2- 172.21.15.2:0/1953289975 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d0ab0 0x7fb2a4099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a37fe640 1 -- 172.21.15.2:0/1953289975 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d0ab0 msgr2=0x7fb2a4099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a37fe640 1 --2- 172.21.15.2:0/1953289975 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d0ab0 0x7fb2a4099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a37fe640 1 -- 172.21.15.2:0/1953289975 >> v2:172.21.15.66:3300/0 conn(0x7fb2a40cce70 msgr2=0x7fb2a4099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:39.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a37fe640 1 --2- 172.21.15.2:0/1953289975 >> v2:172.21.15.66:3300/0 conn(0x7fb2a40cce70 0x7fb2a4099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.311+0000 7fb2a37fe640 1 -- 172.21.15.2:0/1953289975 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a406c470 con 0x7fb2a40d1c50 2023-11-25T04:08:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.312+0000 7fb2a27fc640 1 --2- 172.21.15.2:0/1953289975 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d0ab0 0x7fb2a4099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.312+0000 7fb2a37fe640 1 --2- 172.21.15.2:0/1953289975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40d1c50 0x7fb2a406e570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40720c0 tx=0x7fb29402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c05c1eecbe9238c server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.312+0000 7fb2a1ffb640 1 -- 172.21.15.2:0/1953289975 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29402ca70 con 0x7fb2a40d1c50 2023-11-25T04:08:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.312+0000 7fb2a1ffb640 1 -- 172.21.15.2:0/1953289975 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29402cbd0 con 0x7fb2a40d1c50 2023-11-25T04:08:39.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.312+0000 7fb2a1ffb640 1 -- 172.21.15.2:0/1953289975 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2940343f0 con 0x7fb2a40d1c50 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.313+0000 7fb2a9a31640 1 -- 172.21.15.2:0/1953289975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40d1c50 msgr2=0x7fb2a406e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.313+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/1953289975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40d1c50 0x7fb2a406e570 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40720c0 tx=0x7fb29402bed0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.313+0000 7fb2a9a31640 1 -- 172.21.15.2:0/1953289975 shutdown_connections 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.313+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/1953289975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40d1c50 0x7fb2a406e570 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.313+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/1953289975 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d0ab0 0x7fb2a4099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.313+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/1953289975 >> v2:172.21.15.66:3300/0 conn(0x7fb2a40cce70 0x7fb2a4099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.313+0000 7fb2a9a31640 1 -- 172.21.15.2:0/1953289975 >> 172.21.15.2:0/1953289975 conn(0x7fb2a40d0f20 msgr2=0x7fb2a40d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.313+0000 7fb2a9a31640 1 -- 172.21.15.2:0/1953289975 shutdown_connections 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.313+0000 7fb2a9a31640 1 -- 172.21.15.2:0/1953289975 wait complete. 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.314+0000 7fb2a9a31640 1 Processor -- start 2023-11-25T04:08:39.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a9a31640 1 -- start start 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a9a31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cce70 0x7fb2a40c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a9a31640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a40d0ab0 0x7fb2a4153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a9a31640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d1c50 0x7fb2a415e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a9a31640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a415f2f0 con 0x7fb2a40cce70 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a9a31640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40c5b80 con 0x7fb2a40d0ab0 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a9a31640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a415f010 con 0x7fb2a40d1c50 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cce70 0x7fb2a40c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a2ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cce70 0x7fb2a40c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52974/0 (socket says 172.21.15.2:52974) 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.315+0000 7fb2a2ffd640 1 -- 172.21.15.2:0/835355582 learned_addr learned my addr 172.21.15.2:0/835355582 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a27fc640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a40d0ab0 0x7fb2a4153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a37fe640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d1c50 0x7fb2a415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a2ffd640 1 -- 172.21.15.2:0/835355582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d1c50 msgr2=0x7fb2a415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a2ffd640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d1c50 0x7fb2a415e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a2ffd640 1 -- 172.21.15.2:0/835355582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a40d0ab0 msgr2=0x7fb2a4153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a2ffd640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a40d0ab0 0x7fb2a4153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a2ffd640 1 -- 172.21.15.2:0/835355582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb294009b30 con 0x7fb2a40cce70 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a2ffd640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cce70 0x7fb2a40c7ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00e870 tx=0x7fb29c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb28bfff640 1 -- 172.21.15.2:0/835355582 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c00ee60 con 0x7fb2a40cce70 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb28bfff640 1 -- 172.21.15.2:0/835355582 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c00c940 con 0x7fb2a40cce70 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a40c5dd0 con 0x7fb2a40cce70 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb28bfff640 1 -- 172.21.15.2:0/835355582 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c00ccf0 con 0x7fb2a40cce70 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.316+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a40c6390 con 0x7fb2a40cce70 2023-11-25T04:08:39.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.317+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a4067420 con 0x7fb2a40cce70 2023-11-25T04:08:39.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.318+0000 7fb28bfff640 1 -- 172.21.15.2:0/835355582 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb29c013470 con 0x7fb2a40cce70 2023-11-25T04:08:39.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.318+0000 7fb28bfff640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb29006ae40 0x7fb29006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.318+0000 7fb2a27fc640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb29006ae40 0x7fb29006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.318+0000 7fb28bfff640 1 -- 172.21.15.2:0/835355582 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb29c0895a0 con 0x7fb2a40cce70 2023-11-25T04:08:39.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.319+0000 7fb2a27fc640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb29006ae40 0x7fb29006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb2a41604e0 tx=0x7fb298008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:39.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.322+0000 7fb28bfff640 1 -- 172.21.15.2:0/835355582 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb29c054700 con 0x7fb2a40cce70 2023-11-25T04:08:39.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.534+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2a4066a00 con 0x7fb2a40cce70 2023-11-25T04:08:39.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.535+0000 7fb28bfff640 1 -- 172.21.15.2:0/835355582 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7fb29c057d20 con 0x7fb2a40cce70 2023-11-25T04:08:39.537 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:39.537 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1227253459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1227253459},{"type":"v1","addr":"172.21.15.66:6835","nonce":1227253459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3032459629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3032459629},{"type":"v1","addr":"172.21.15.2:6835","nonce":3032459629}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:08:35.512348+0000","modified":"2023-11-25T04:08:38.534749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/1650670057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1650670057},{"type":"v1","addr":"172.21.15.66:6833","nonce":1650670057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-25T04:08:39.538 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-25T04:08:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb29006ae40 msgr2=0x7fb29006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb29006ae40 0x7fb29006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb2a41604e0 tx=0x7fb298008040 comp rx=0 tx=0).stop 2023-11-25T04:08:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cce70 msgr2=0x7fb2a40c7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cce70 0x7fb2a40c7ff0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00e870 tx=0x7fb29c00ed30 comp rx=0 tx=0).stop 2023-11-25T04:08:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 shutdown_connections 2023-11-25T04:08:39.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2a40d1c50 0x7fb2a415e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb29006ae40 0x7fb29006d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2a40d0ab0 0x7fb2a4153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 --2- 172.21.15.2:0/835355582 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb2a40cce70 0x7fb2a40c7ff0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 >> 172.21.15.2:0/835355582 conn(0x7fb2a40d0f20 msgr2=0x7fb2a40ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 shutdown_connections 2023-11-25T04:08:39.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.537+0000 7fb2a9a31640 1 -- 172.21.15.2:0/835355582 wait complete. 2023-11-25T04:08:39.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:39.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.654+0000 7f476d8e7640 1 Processor -- start 2023-11-25T04:08:39.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.654+0000 7f476d8e7640 1 -- start start 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f476d8e7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47680b4810 0x7f476815b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f476d8e7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476815bd90 0x7f47680cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f476d8e7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476806de80 con 0x7f476813e2d0 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f476d8e7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476815fc60 con 0x7f47680b4810 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f476d8e7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476806d5c0 con 0x7f476815bd90 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f47667fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47680b4810 0x7f476815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f47667fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47680b4810 0x7f476815b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52984/0 (socket says 172.21.15.2:52984) 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f47667fc640 1 -- 172.21.15.2:0/1042148975 learned_addr learned my addr 172.21.15.2:0/1042148975 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f47677fe640 1 --2- 172.21.15.2:0/1042148975 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476815bd90 0x7f47680cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f47667fc640 1 -- 172.21.15.2:0/1042148975 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476815bd90 msgr2=0x7f47680cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f47667fc640 1 --2- 172.21.15.2:0/1042148975 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476815bd90 0x7f47680cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.655+0000 7f47667fc640 1 -- 172.21.15.2:0/1042148975 >> v1:172.21.15.66:6789/0 conn(0x7f476813e2d0 legacy=0x7f47680b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:39.659 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.656+0000 7f47667fc640 1 -- 172.21.15.2:0/1042148975 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476806d830 con 0x7f47680b4810 2023-11-25T04:08:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.656+0000 7f47667fc640 1 --2- 172.21.15.2:0/1042148975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47680b4810 0x7f476815b850 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f475c009870 tx=0x7f475c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae69b1270036ea5e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.656+0000 7f4765ffb640 1 -- 172.21.15.2:0/1042148975 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c031640 con 0x7f47680b4810 2023-11-25T04:08:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.656+0000 7f4765ffb640 1 -- 172.21.15.2:0/1042148975 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c0317a0 con 0x7f47680b4810 2023-11-25T04:08:39.660 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.656+0000 7f4765ffb640 1 -- 172.21.15.2:0/1042148975 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c031b30 con 0x7f47680b4810 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.657+0000 7f476d8e7640 1 -- 172.21.15.2:0/1042148975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47680b4810 msgr2=0x7f476815b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.657+0000 7f476d8e7640 1 --2- 172.21.15.2:0/1042148975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47680b4810 0x7f476815b850 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f475c009870 tx=0x7f475c02b8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.657+0000 7f476d8e7640 1 -- 172.21.15.2:0/1042148975 shutdown_connections 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.657+0000 7f476d8e7640 1 --2- 172.21.15.2:0/1042148975 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476815bd90 0x7f47680cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.657+0000 7f476d8e7640 1 --2- 172.21.15.2:0/1042148975 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47680b4810 0x7f476815b850 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.657+0000 7f476d8e7640 1 -- 172.21.15.2:0/1042148975 >> 172.21.15.2:0/1042148975 conn(0x7f47680b0af0 msgr2=0x7f47680b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.657+0000 7f476d8e7640 1 -- 172.21.15.2:0/1042148975 shutdown_connections 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.657+0000 7f476d8e7640 1 -- 172.21.15.2:0/1042148975 wait complete. 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.658+0000 7f476d8e7640 1 Processor -- start 2023-11-25T04:08:39.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.658+0000 7f476d8e7640 1 -- start start 2023-11-25T04:08:39.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f476d8e7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47680b4810 0x7f4768153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f476d8e7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476813e2d0 0x7f4768154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f476d8e7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476815bd90 0x7f4768155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f476d8e7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47680b3aa0 con 0x7f476815bd90 2023-11-25T04:08:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f476d8e7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47680b2ba0 con 0x7f47680b4810 2023-11-25T04:08:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f476d8e7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47680b3ec0 con 0x7f476813e2d0 2023-11-25T04:08:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f47677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476815bd90 0x7f4768155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f47677fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476815bd90 0x7f4768155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:52992/0 (socket says 172.21.15.2:52992) 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f47677fe640 1 -- 172.21.15.2:0/445021842 learned_addr learned my addr 172.21.15.2:0/445021842 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.659+0000 7f47667fc640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476813e2d0 0x7f4768154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f4766ffd640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47680b4810 0x7f4768153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f47677fe640 1 -- 172.21.15.2:0/445021842 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476813e2d0 msgr2=0x7f4768154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f47677fe640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476813e2d0 0x7f4768154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f47677fe640 1 -- 172.21.15.2:0/445021842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47680b4810 msgr2=0x7f4768153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f47677fe640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47680b4810 0x7f4768153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f47677fe640 1 -- 172.21.15.2:0/445021842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c0094d0 con 0x7f476815bd90 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f47677fe640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476815bd90 0x7f4768155050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f476000d800 tx=0x7f476000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f474ffff640 1 -- 172.21.15.2:0/445021842 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476000b6c0 con 0x7f476815bd90 2023-11-25T04:08:39.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f474ffff640 1 -- 172.21.15.2:0/445021842 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476000b840 con 0x7f476815bd90 2023-11-25T04:08:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476806e490 con 0x7f476815bd90 2023-11-25T04:08:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f474ffff640 1 -- 172.21.15.2:0/445021842 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476000bbf0 con 0x7f476815bd90 2023-11-25T04:08:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.660+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47680b3100 con 0x7f476815bd90 2023-11-25T04:08:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.661+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476806e2f0 con 0x7f476815bd90 2023-11-25T04:08:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.662+0000 7f474ffff640 1 -- 172.21.15.2:0/445021842 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f476000bd50 con 0x7f476815bd90 2023-11-25T04:08:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.662+0000 7f474ffff640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f475406ae40 0x7f475406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.662+0000 7f474ffff640 1 -- 172.21.15.2:0/445021842 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4760089a90 con 0x7f476815bd90 2023-11-25T04:08:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.662+0000 7f4766ffd640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f475406ae40 0x7f475406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.662+0000 7f4766ffd640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f475406ae40 0x7f475406d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4758005520 tx=0x7f4758009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:39.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.666+0000 7f474ffff640 1 -- 172.21.15.2:0/445021842 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f476806e2f0 con 0x7f476815bd90 2023-11-25T04:08:39.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.843+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f476806e2f0 con 0x7f476815bd90 2023-11-25T04:08:39.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.844+0000 7f474ffff640 1 -- 172.21.15.2:0/445021842 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f476806e2f0 con 0x7f476815bd90 2023-11-25T04:08:39.848 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:39.848 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:39.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f475406ae40 msgr2=0x7f475406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f475406ae40 0x7f475406d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4758005520 tx=0x7f4758009040 comp rx=0 tx=0).stop 2023-11-25T04:08:39.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476815bd90 msgr2=0x7f4768155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476815bd90 0x7f4768155050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f476000d800 tx=0x7f476000dcc0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 shutdown_connections 2023-11-25T04:08:39.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476815bd90 0x7f4768155050 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476813e2d0 0x7f4768154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f475406ae40 0x7f475406d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 --2- 172.21.15.2:0/445021842 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47680b4810 0x7f4768153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 >> 172.21.15.2:0/445021842 conn(0x7f47680b0af0 msgr2=0x7f476815b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:39.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 shutdown_connections 2023-11-25T04:08:39.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.846+0000 7f476d8e7640 1 -- 172.21.15.2:0/445021842 wait complete. 2023-11-25T04:08:39.862 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-25T04:08:39.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-25T04:08:39.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.966+0000 7efdedd01640 1 Processor -- start 2023-11-25T04:08:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.966+0000 7efdedd01640 1 -- start start 2023-11-25T04:08:39.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.967+0000 7efdedd01640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efde80b3020 0x7efde80cfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.967+0000 7efdedd01640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde80b1270 con 0x7efde815b270 2023-11-25T04:08:39.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.967+0000 7efdedd01640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde80b1550 con 0x7efde80b0cb0 2023-11-25T04:08:39.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.967+0000 7efdedd01640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde80cbb50 con 0x7efde80b3020 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.967+0000 7efde77fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7efde815b270 0x7efde80ce280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:32990/0 (socket says 172.21.15.2:32990) 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.967+0000 7efde77fe640 1 -- 172.21.15.2:0/826658533 learned_addr learned my addr 172.21.15.2:0/826658533 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde7fff640 1 --2- 172.21.15.2:0/826658533 >> v2:172.21.15.66:3300/0 conn(0x7efde80b3020 0x7efde80cfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227095570 0 0) 0x7efde80b1270 con 0x7efde815b270 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdd0003520 con 0x7efde815b270 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4149810080 0 0) 0x7efdd0003520 con 0x7efde815b270 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 >> v2:172.21.15.66:3300/0 conn(0x7efde80b3020 msgr2=0x7efde80cfcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 --2- 172.21.15.2:0/826658533 >> v2:172.21.15.66:3300/0 conn(0x7efde80b3020 0x7efde80cfcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 >> v1:172.21.15.66:6789/0 conn(0x7efde80b0cb0 legacy=0x7efde80b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde80b1830 con 0x7efde815b270 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7efdd8001690 con 0x7efde815b270 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde7fff640 1 --2- 172.21.15.2:0/826658533 >> v2:172.21.15.66:3300/0 conn(0x7efde80b3020 0x7efde80cfcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 >> v1:172.21.15.2:6789/0 conn(0x7efde815b270 legacy=0x7efde80ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdd0003970 0x7efdd0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd00047c0 0x7efdd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdd0005180 0x7efdd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde80cbb50 con 0x7efdd0005180 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd000c120 con 0x7efdd0003970 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd000c2e0 con 0x7efdd00047c0 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde7fff640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdd0005180 0x7efdd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde77fe640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdd0003970 0x7efdd0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde6ffd640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd00047c0 0x7efdd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde7fff640 1 -- 172.21.15.2:0/826658533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd00047c0 msgr2=0x7efdd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde7fff640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd00047c0 0x7efdd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde7fff640 1 -- 172.21.15.2:0/826658533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdd0003970 msgr2=0x7efdd0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde7fff640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efdd0003970 0x7efdd0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde7fff640 1 -- 172.21.15.2:0/826658533 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd0003520 con 0x7efdd0005180 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.968+0000 7efde6ffd640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd00047c0 0x7efdd0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.969+0000 7efde7fff640 1 -- 172.21.15.2:0/826658533 reap_dead start 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.969+0000 7efde7fff640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdd0005180 0x7efdd000b980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efde000e350 tx=0x7efdd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62368df64e6b9818 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.969+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde002ce00 con 0x7efdd0005180 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.969+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde000f040 con 0x7efdd0005180 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.969+0000 7efde67fc640 1 -- 172.21.15.2:0/826658533 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0003bd0 con 0x7efdd0005180 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.970+0000 7efdedd01640 1 -- 172.21.15.2:0/826658533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdd0005180 msgr2=0x7efdd000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.970+0000 7efdedd01640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdd0005180 0x7efdd000b980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7efde000e350 tx=0x7efdd00057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.970+0000 7efdedd01640 1 -- 172.21.15.2:0/826658533 shutdown_connections 2023-11-25T04:08:39.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.970+0000 7efdedd01640 1 --2- 172.21.15.2:0/826658533 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efdd0005180 0x7efdd000b980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.970+0000 7efdedd01640 1 -- 172.21.15.2:0/826658533 >> 172.21.15.2:0/826658533 conn(0x7efde80d0f60 msgr2=0x7efde80d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.970+0000 7efdedd01640 1 -- 172.21.15.2:0/826658533 shutdown_connections 2023-11-25T04:08:39.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.970+0000 7efdedd01640 1 -- 172.21.15.2:0/826658533 wait complete. 2023-11-25T04:08:39.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.971+0000 7efdedd01640 1 Processor -- start 2023-11-25T04:08:39.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.971+0000 7efdedd01640 1 -- start start 2023-11-25T04:08:39.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efdedd01640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd0005180 0x7efde80c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.978 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efdedd01640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efde8155370 0x7efde814b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efdedd01640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde80c8030 0x7efde80c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efdedd01640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde80b5550 con 0x7efde80c8030 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efdedd01640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde814b950 con 0x7efde8155370 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efdedd01640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde80cd150 con 0x7efdd0005180 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde80c8030 0x7efde80c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde80c8030 0x7efde80c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53012/0 (socket says 172.21.15.2:53012) 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde7fff640 1 -- 172.21.15.2:0/751338655 learned_addr learned my addr 172.21.15.2:0/751338655 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde77fe640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd0005180 0x7efde80c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde6ffd640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efde8155370 0x7efde814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde7fff640 1 -- 172.21.15.2:0/751338655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd0005180 msgr2=0x7efde80c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde7fff640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd0005180 0x7efde80c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde7fff640 1 -- 172.21.15.2:0/751338655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efde8155370 msgr2=0x7efde814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:39.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde7fff640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efde8155370 0x7efde814b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde7fff640 1 -- 172.21.15.2:0/751338655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde80b5740 con 0x7efde80c8030 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde6ffd640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efde8155370 0x7efde814b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.972+0000 7efde7fff640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde80c8030 0x7efde80c5210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efde002c870 tx=0x7efde0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.973+0000 7efdcffff640 1 -- 172.21.15.2:0/751338655 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0044070 con 0x7efde80c8030 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.973+0000 7efdcffff640 1 -- 172.21.15.2:0/751338655 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde0035ed0 con 0x7efde80c8030 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.973+0000 7efdcffff640 1 -- 172.21.15.2:0/751338655 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0003bd0 con 0x7efde80c8030 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.973+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde80ccb90 con 0x7efde80c8030 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.973+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde80b59e0 con 0x7efde80c8030 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.974+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde8068470 con 0x7efde80c8030 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.974+0000 7efdcffff640 1 -- 172.21.15.2:0/751338655 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efde003e420 con 0x7efde80c8030 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.975+0000 7efdcffff640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efdd406ae70 0x7efdd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:39.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.975+0000 7efdcffff640 1 -- 172.21.15.2:0/751338655 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efde00aba90 con 0x7efde80c8030 2023-11-25T04:08:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.975+0000 7efde77fe640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efdd406ae70 0x7efdd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:39.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.975+0000 7efde77fe640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efdd406ae70 0x7efdd406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdd8001050 tx=0x7efdd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:39.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:39.979+0000 7efdcffff640 1 -- 172.21.15.2:0/751338655 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efde0076b40 con 0x7efde80c8030 2023-11-25T04:08:40.085 INFO:tasks.ceph.mds.b.smithi066.stderr:2023-11-25T04:08:40.084+0000 7faff8b4f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-25T04:08:40.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.153+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 --> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efde80b1df0 con 0x7efdd406ae70 2023-11-25T04:08:40.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.160+0000 7efdcffff640 1 -- 172.21.15.2:0/751338655 <== mgr.4107 v2:172.21.15.2:6832/523998843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264673 (secure 0 0 0) 0x7efdd8001b40 con 0x7efdd406ae70 2023-11-25T04:08:40.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:40.166 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-25T04:08:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.163+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efdd406ae70 msgr2=0x7efdd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.163+0000 7efdedd01640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efdd406ae70 0x7efdd406d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efdd8001050 tx=0x7efdd8009040 comp rx=0 tx=0).stop 2023-11-25T04:08:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.163+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde80c8030 msgr2=0x7efde80c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.163+0000 7efdedd01640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde80c8030 0x7efde80c5210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efde002c870 tx=0x7efde0009750 comp rx=0 tx=0).stop 2023-11-25T04:08:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.163+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 shutdown_connections 2023-11-25T04:08:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.164+0000 7efdedd01640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efde80c8030 0x7efde80c5210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.164+0000 7efdedd01640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efdd406ae70 0x7efdd406d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.164+0000 7efdedd01640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efde8155370 0x7efde814b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.164+0000 7efdedd01640 1 --2- 172.21.15.2:0/751338655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efdd0005180 0x7efde80c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.164+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 >> 172.21.15.2:0/751338655 conn(0x7efde80d0f60 msgr2=0x7efde80d1340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.164+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 shutdown_connections 2023-11-25T04:08:40.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.164+0000 7efdedd01640 1 -- 172.21.15.2:0/751338655 wait complete. 2023-11-25T04:08:40.176 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-25T04:08:39.478010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235552,"kb_used_data":2740,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739168,"statfs":{"total":773094113280,"available":772852908032,"internally_reserved":0,"allocated":2805760,"data_stored":1708736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.335307"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165535+0000","last_change":"2023-11-25T04:08:36.163622+0000","last_active":"2023-11-25T04:08:36.165535+0000","last_peered":"2023-11-25T04:08:36.165535+0000","last_clean":"2023-11-25T04:08:36.165535+0000","last_became_active":"2023-11-25T04:08:36.163344+0000","last_became_peered":"2023-11-25T04:08:36.163344+0000","last_unstale":"2023-11-25T04:08:36.165535+0000","last_undegraded":"2023-11-25T04:08:36.165535+0000","last_fullsized":"2023-11-25T04:08:36.165535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140999+0000","last_change":"2023-11-25T04:08:36.153711+0000","last_active":"2023-11-25T04:08:37.140999+0000","last_peered":"2023-11-25T04:08:37.140999+0000","last_clean":"2023-11-25T04:08:37.140999+0000","last_became_active":"2023-11-25T04:08:36.153447+0000","last_became_peered":"2023-11-25T04:08:36.153447+0000","last_unstale":"2023-11-25T04:08:37.140999+0000","last_undegraded":"2023-11-25T04:08:37.140999+0000","last_fullsized":"2023-11-25T04:08:37.140999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.156250+0000","last_change":"2023-11-25T04:08:36.151108+0000","last_active":"2023-11-25T04:08:36.156250+0000","last_peered":"2023-11-25T04:08:36.156250+0000","last_clean":"2023-11-25T04:08:36.156250+0000","last_became_active":"2023-11-25T04:08:36.150809+0000","last_became_peered":"2023-11-25T04:08:36.150809+0000","last_unstale":"2023-11-25T04:08:36.156250+0000","last_undegraded":"2023-11-25T04:08:36.156250+0000","last_fullsized":"2023-11-25T04:08:36.156250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165710+0000","last_change":"2023-11-25T04:08:36.157420+0000","last_active":"2023-11-25T04:08:36.165710+0000","last_peered":"2023-11-25T04:08:36.165710+0000","last_clean":"2023-11-25T04:08:36.165710+0000","last_became_active":"2023-11-25T04:08:36.157122+0000","last_became_peered":"2023-11-25T04:08:36.157122+0000","last_unstale":"2023-11-25T04:08:36.165710+0000","last_undegraded":"2023-11-25T04:08:36.165710+0000","last_fullsized":"2023-11-25T04:08:36.165710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164694+0000","last_change":"2023-11-25T04:08:36.157106+0000","last_active":"2023-11-25T04:08:36.164694+0000","last_peered":"2023-11-25T04:08:36.164694+0000","last_clean":"2023-11-25T04:08:36.164694+0000","last_became_active":"2023-11-25T04:08:36.156764+0000","last_became_peered":"2023-11-25T04:08:36.156764+0000","last_unstale":"2023-11-25T04:08:36.164694+0000","last_undegraded":"2023-11-25T04:08:36.164694+0000","last_fullsized":"2023-11-25T04:08:36.164694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165000+0000","last_change":"2023-11-25T04:08:36.156211+0000","last_active":"2023-11-25T04:08:36.165000+0000","last_peered":"2023-11-25T04:08:36.165000+0000","last_clean":"2023-11-25T04:08:36.165000+0000","last_became_active":"2023-11-25T04:08:36.154680+0000","last_became_peered":"2023-11-25T04:08:36.154680+0000","last_unstale":"2023-11-25T04:08:36.165000+0000","last_undegraded":"2023-11-25T04:08:36.165000+0000","last_fullsized":"2023-11-25T04:08:36.165000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.162238+0000","last_change":"2023-11-25T04:08:36.156525+0000","last_active":"2023-11-25T04:08:36.162238+0000","last_peered":"2023-11-25T04:08:36.162238+0000","last_clean":"2023-11-25T04:08:36.162238+0000","last_became_active":"2023-11-25T04:08:36.156219+0000","last_became_peered":"2023-11-25T04:08:36.156219+0000","last_unstale":"2023-11-25T04:08:36.162238+0000","last_undegraded":"2023-11-25T04:08:36.162238+0000","last_fullsized":"2023-11-25T04:08:36.162238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139675+0000","last_change":"2023-11-25T04:08:36.155837+0000","last_active":"2023-11-25T04:08:37.139675+0000","last_peered":"2023-11-25T04:08:37.139675+0000","last_clean":"2023-11-25T04:08:37.139675+0000","last_became_active":"2023-11-25T04:08:36.155513+0000","last_became_peered":"2023-11-25T04:08:36.155513+0000","last_unstale":"2023-11-25T04:08:37.139675+0000","last_undegraded":"2023-11-25T04:08:37.139675+0000","last_fullsized":"2023-11-25T04:08:37.139675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165515+0000","last_change":"2023-11-25T04:08:36.162855+0000","last_active":"2023-11-25T04:08:36.165515+0000","last_peered":"2023-11-25T04:08:36.165515+0000","last_clean":"2023-11-25T04:08:36.165515+0000","last_became_active":"2023-11-25T04:08:36.162564+0000","last_became_peered":"2023-11-25T04:08:36.162564+0000","last_unstale":"2023-11-25T04:08:36.165515+0000","last_undegraded":"2023-11-25T04:08:36.165515+0000","last_fullsized":"2023-11-25T04:08:36.165515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165612+0000","last_change":"2023-11-25T04:08:36.163530+0000","last_active":"2023-11-25T04:08:36.165612+0000","last_peered":"2023-11-25T04:08:36.165612+0000","last_clean":"2023-11-25T04:08:36.165612+0000","last_became_active":"2023-11-25T04:08:36.163227+0000","last_became_peered":"2023-11-25T04:08:36.163227+0000","last_unstale":"2023-11-25T04:08:36.165612+0000","last_undegraded":"2023-11-25T04:08:36.165612+0000","last_fullsized":"2023-11-25T04:08:36.165612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:06.500587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165545+0000","last_change":"2023-11-25T04:08:36.163831+0000","last_active":"2023-11-25T04:08:36.165545+0000","last_peered":"2023-11-25T04:08:36.165545+0000","last_clean":"2023-11-25T04:08:36.165545+0000","last_became_active":"2023-11-25T04:08:36.163508+0000","last_became_peered":"2023-11-25T04:08:36.163508+0000","last_unstale":"2023-11-25T04:08:36.165545+0000","last_undegraded":"2023-11-25T04:08:36.165545+0000","last_fullsized":"2023-11-25T04:08:36.165545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:17.652150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141201+0000","last_change":"2023-11-25T04:08:36.158244+0000","last_active":"2023-11-25T04:08:37.141201+0000","last_peered":"2023-11-25T04:08:37.141201+0000","last_clean":"2023-11-25T04:08:37.141201+0000","last_became_active":"2023-11-25T04:08:36.157786+0000","last_became_peered":"2023-11-25T04:08:36.157786+0000","last_unstale":"2023-11-25T04:08:37.141201+0000","last_undegraded":"2023-11-25T04:08:37.141201+0000","last_fullsized":"2023-11-25T04:08:37.141201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139966+0000","last_change":"2023-11-25T04:08:36.156689+0000","last_active":"2023-11-25T04:08:37.139966+0000","last_peered":"2023-11-25T04:08:37.139966+0000","last_clean":"2023-11-25T04:08:37.139966+0000","last_became_active":"2023-11-25T04:08:36.156198+0000","last_became_peered":"2023-11-25T04:08:36.156198+0000","last_unstale":"2023-11-25T04:08:37.139966+0000","last_undegraded":"2023-11-25T04:08:37.139966+0000","last_fullsized":"2023-11-25T04:08:37.139966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.155740+0000","last_change":"2023-11-25T04:08:36.154649+0000","last_active":"2023-11-25T04:08:36.155740+0000","last_peered":"2023-11-25T04:08:36.155740+0000","last_clean":"2023-11-25T04:08:36.155740+0000","last_became_active":"2023-11-25T04:08:36.154367+0000","last_became_peered":"2023-11-25T04:08:36.154367+0000","last_unstale":"2023-11-25T04:08:36.155740+0000","last_undegraded":"2023-11-25T04:08:36.155740+0000","last_fullsized":"2023-11-25T04:08:36.155740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:26.803161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140716+0000","last_change":"2023-11-25T04:08:36.154568+0000","last_active":"2023-11-25T04:08:37.140716+0000","last_peered":"2023-11-25T04:08:37.140716+0000","last_clean":"2023-11-25T04:08:37.140716+0000","last_became_active":"2023-11-25T04:08:36.154254+0000","last_became_peered":"2023-11-25T04:08:36.154254+0000","last_unstale":"2023-11-25T04:08:37.140716+0000","last_undegraded":"2023-11-25T04:08:37.140716+0000","last_fullsized":"2023-11-25T04:08:37.140716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165315+0000","last_change":"2023-11-25T04:08:36.156505+0000","last_active":"2023-11-25T04:08:36.165315+0000","last_peered":"2023-11-25T04:08:36.165315+0000","last_clean":"2023-11-25T04:08:36.165315+0000","last_became_active":"2023-11-25T04:08:36.156200+0000","last_became_peered":"2023-11-25T04:08:36.156200+0000","last_unstale":"2023-11-25T04:08:36.165315+0000","last_undegraded":"2023-11-25T04:08:36.165315+0000","last_fullsized":"2023-11-25T04:08:36.165315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:23.464341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164920+0000","last_change":"2023-11-25T04:08:36.154932+0000","last_active":"2023-11-25T04:08:36.164920+0000","last_peered":"2023-11-25T04:08:36.164920+0000","last_clean":"2023-11-25T04:08:36.164920+0000","last_became_active":"2023-11-25T04:08:36.154561+0000","last_became_peered":"2023-11-25T04:08:36.154561+0000","last_unstale":"2023-11-25T04:08:36.164920+0000","last_undegraded":"2023-11-25T04:08:36.164920+0000","last_fullsized":"2023-11-25T04:08:36.164920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.159277+0000","last_change":"2023-11-25T04:08:36.157418+0000","last_active":"2023-11-25T04:08:36.159277+0000","last_peered":"2023-11-25T04:08:36.159277+0000","last_clean":"2023-11-25T04:08:36.159277+0000","last_became_active":"2023-11-25T04:08:36.157130+0000","last_became_peered":"2023-11-25T04:08:36.157130+0000","last_unstale":"2023-11-25T04:08:36.159277+0000","last_undegraded":"2023-11-25T04:08:36.159277+0000","last_fullsized":"2023-11-25T04:08:36.159277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:37.085846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164753+0000","last_change":"2023-11-25T04:08:36.157854+0000","last_active":"2023-11-25T04:08:36.164753+0000","last_peered":"2023-11-25T04:08:36.164753+0000","last_clean":"2023-11-25T04:08:36.164753+0000","last_became_active":"2023-11-25T04:08:36.156836+0000","last_became_peered":"2023-11-25T04:08:36.156836+0000","last_unstale":"2023-11-25T04:08:36.164753+0000","last_undegraded":"2023-11-25T04:08:36.164753+0000","last_fullsized":"2023-11-25T04:08:36.164753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:22.951831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.162328+0000","last_change":"2023-11-25T04:08:36.155924+0000","last_active":"2023-11-25T04:08:36.162328+0000","last_peered":"2023-11-25T04:08:36.162328+0000","last_clean":"2023-11-25T04:08:36.162328+0000","last_became_active":"2023-11-25T04:08:36.155624+0000","last_became_peered":"2023-11-25T04:08:36.155624+0000","last_unstale":"2023-11-25T04:08:36.162328+0000","last_undegraded":"2023-11-25T04:08:36.162328+0000","last_fullsized":"2023-11-25T04:08:36.162328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:10:28.341482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.155622+0000","last_change":"2023-11-25T04:08:36.153091+0000","last_active":"2023-11-25T04:08:36.155622+0000","last_peered":"2023-11-25T04:08:36.155622+0000","last_clean":"2023-11-25T04:08:36.155622+0000","last_became_active":"2023-11-25T04:08:36.152775+0000","last_became_peered":"2023-11-25T04:08:36.152775+0000","last_unstale":"2023-11-25T04:08:36.155622+0000","last_undegraded":"2023-11-25T04:08:36.155622+0000","last_fullsized":"2023-11-25T04:08:36.155622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:25:54.256045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165021+0000","last_change":"2023-11-25T04:08:36.156488+0000","last_active":"2023-11-25T04:08:36.165021+0000","last_peered":"2023-11-25T04:08:36.165021+0000","last_clean":"2023-11-25T04:08:36.165021+0000","last_became_active":"2023-11-25T04:08:36.156156+0000","last_became_peered":"2023-11-25T04:08:36.156156+0000","last_unstale":"2023-11-25T04:08:36.165021+0000","last_undegraded":"2023-11-25T04:08:36.165021+0000","last_fullsized":"2023-11-25T04:08:36.165021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139732+0000","last_change":"2023-11-25T04:08:36.153601+0000","last_active":"2023-11-25T04:08:37.139732+0000","last_peered":"2023-11-25T04:08:37.139732+0000","last_clean":"2023-11-25T04:08:37.139732+0000","last_became_active":"2023-11-25T04:08:36.153299+0000","last_became_peered":"2023-11-25T04:08:36.153299+0000","last_unstale":"2023-11-25T04:08:37.139732+0000","last_undegraded":"2023-11-25T04:08:37.139732+0000","last_fullsized":"2023-11-25T04:08:37.139732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.161837+0000","last_change":"2023-11-25T04:08:36.152977+0000","last_active":"2023-11-25T04:08:36.161837+0000","last_peered":"2023-11-25T04:08:36.161837+0000","last_clean":"2023-11-25T04:08:36.161837+0000","last_became_active":"2023-11-25T04:08:36.152565+0000","last_became_peered":"2023-11-25T04:08:36.152565+0000","last_unstale":"2023-11-25T04:08:36.161837+0000","last_undegraded":"2023-11-25T04:08:36.161837+0000","last_fullsized":"2023-11-25T04:08:36.161837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140274+0000","last_change":"2023-11-25T04:08:36.151764+0000","last_active":"2023-11-25T04:08:37.140274+0000","last_peered":"2023-11-25T04:08:37.140274+0000","last_clean":"2023-11-25T04:08:37.140274+0000","last_became_active":"2023-11-25T04:08:36.150463+0000","last_became_peered":"2023-11-25T04:08:36.150463+0000","last_unstale":"2023-11-25T04:08:37.140274+0000","last_undegraded":"2023-11-25T04:08:37.140274+0000","last_fullsized":"2023-11-25T04:08:37.140274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165595+0000","last_change":"2023-11-25T04:08:36.162948+0000","last_active":"2023-11-25T04:08:36.165595+0000","last_peered":"2023-11-25T04:08:36.165595+0000","last_clean":"2023-11-25T04:08:36.165595+0000","last_became_active":"2023-11-25T04:08:36.162672+0000","last_became_peered":"2023-11-25T04:08:36.162672+0000","last_unstale":"2023-11-25T04:08:36.165595+0000","last_undegraded":"2023-11-25T04:08:36.165595+0000","last_fullsized":"2023-11-25T04:08:36.165595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140927+0000","last_change":"2023-11-25T04:08:36.159466+0000","last_active":"2023-11-25T04:08:37.140927+0000","last_peered":"2023-11-25T04:08:37.140927+0000","last_clean":"2023-11-25T04:08:37.140927+0000","last_became_active":"2023-11-25T04:08:36.159177+0000","last_became_peered":"2023-11-25T04:08:36.159177+0000","last_unstale":"2023-11-25T04:08:37.140927+0000","last_undegraded":"2023-11-25T04:08:37.140927+0000","last_fullsized":"2023-11-25T04:08:37.140927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140078+0000","last_change":"2023-11-25T04:08:36.153899+0000","last_active":"2023-11-25T04:08:37.140078+0000","last_peered":"2023-11-25T04:08:37.140078+0000","last_clean":"2023-11-25T04:08:37.140078+0000","last_became_active":"2023-11-25T04:08:36.152798+0000","last_became_peered":"2023-11-25T04:08:36.152798+0000","last_unstale":"2023-11-25T04:08:37.140078+0000","last_undegraded":"2023-11-25T04:08:37.140078+0000","last_fullsized":"2023-11-25T04:08:37.140078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.149250+0000","last_change":"2023-11-25T04:08:36.145773+0000","last_active":"2023-11-25T04:08:36.149250+0000","last_peered":"2023-11-25T04:08:36.149250+0000","last_clean":"2023-11-25T04:08:36.149250+0000","last_became_active":"2023-11-25T04:08:36.144733+0000","last_became_peered":"2023-11-25T04:08:36.144733+0000","last_unstale":"2023-11-25T04:08:36.149250+0000","last_undegraded":"2023-11-25T04:08:36.149250+0000","last_fullsized":"2023-11-25T04:08:36.149250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164923+0000","last_change":"2023-11-25T04:08:36.154902+0000","last_active":"2023-11-25T04:08:36.164923+0000","last_peered":"2023-11-25T04:08:36.164923+0000","last_clean":"2023-11-25T04:08:36.164923+0000","last_became_active":"2023-11-25T04:08:36.154382+0000","last_became_peered":"2023-11-25T04:08:36.154382+0000","last_unstale":"2023-11-25T04:08:36.164923+0000","last_undegraded":"2023-11-25T04:08:36.164923+0000","last_fullsized":"2023-11-25T04:08:36.164923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:39.596607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.159573+0000","last_change":"2023-11-25T04:08:36.157895+0000","last_active":"2023-11-25T04:08:36.159573+0000","last_peered":"2023-11-25T04:08:36.159573+0000","last_clean":"2023-11-25T04:08:36.159573+0000","last_became_active":"2023-11-25T04:08:36.157530+0000","last_became_peered":"2023-11-25T04:08:36.157530+0000","last_unstale":"2023-11-25T04:08:36.159573+0000","last_undegraded":"2023-11-25T04:08:36.159573+0000","last_fullsized":"2023-11-25T04:08:36.159573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:10:28.341482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165033+0000","last_change":"2023-11-25T04:08:36.158558+0000","last_active":"2023-11-25T04:08:36.165033+0000","last_peered":"2023-11-25T04:08:36.165033+0000","last_clean":"2023-11-25T04:08:36.165033+0000","last_became_active":"2023-11-25T04:08:36.158280+0000","last_became_peered":"2023-11-25T04:08:36.158280+0000","last_unstale":"2023-11-25T04:08:36.165033+0000","last_undegraded":"2023-11-25T04:08:36.165033+0000","last_fullsized":"2023-11-25T04:08:36.165033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:57.632433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141133+0000","last_change":"2023-11-25T04:08:36.155419+0000","last_active":"2023-11-25T04:08:37.141133+0000","last_peered":"2023-11-25T04:08:37.141133+0000","last_clean":"2023-11-25T04:08:37.141133+0000","last_became_active":"2023-11-25T04:08:36.155113+0000","last_became_peered":"2023-11-25T04:08:36.155113+0000","last_unstale":"2023-11-25T04:08:37.141133+0000","last_undegraded":"2023-11-25T04:08:37.141133+0000","last_fullsized":"2023-11-25T04:08:37.141133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:06.500587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140200+0000","last_change":"2023-11-25T04:08:35.170018+0000","last_active":"2023-11-25T04:08:37.140200+0000","last_peered":"2023-11-25T04:08:37.140200+0000","last_clean":"2023-11-25T04:08:37.140200+0000","last_became_active":"2023-11-25T04:08:35.169712+0000","last_became_peered":"2023-11-25T04:08:35.169712+0000","last_unstale":"2023-11-25T04:08:37.140200+0000","last_undegraded":"2023-11-25T04:08:37.140200+0000","last_fullsized":"2023-11-25T04:08:37.140200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:21.947721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.152968+0000","last_change":"2023-11-25T04:08:36.149119+0000","last_active":"2023-11-25T04:08:36.152968+0000","last_peered":"2023-11-25T04:08:36.152968+0000","last_clean":"2023-11-25T04:08:36.152968+0000","last_became_active":"2023-11-25T04:08:36.148656+0000","last_became_peered":"2023-11-25T04:08:36.148656+0000","last_unstale":"2023-11-25T04:08:36.152968+0000","last_undegraded":"2023-11-25T04:08:36.152968+0000","last_fullsized":"2023-11-25T04:08:36.152968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:10:28.341482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.179032+0000","last_change":"2023-11-25T04:08:35.169640+0000","last_active":"2023-11-25T04:08:36.179032+0000","last_peered":"2023-11-25T04:08:36.179032+0000","last_clean":"2023-11-25T04:08:36.179032+0000","last_became_active":"2023-11-25T04:08:35.169229+0000","last_became_peered":"2023-11-25T04:08:35.169229+0000","last_unstale":"2023-11-25T04:08:36.179032+0000","last_undegraded":"2023-11-25T04:08:36.179032+0000","last_fullsized":"2023-11-25T04:08:36.179032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139797+0000","last_change":"2023-11-25T04:08:35.165325+0000","last_active":"2023-11-25T04:08:37.139797+0000","last_peered":"2023-11-25T04:08:37.139797+0000","last_clean":"2023-11-25T04:08:37.139797+0000","last_became_active":"2023-11-25T04:08:35.164962+0000","last_became_peered":"2023-11-25T04:08:35.164962+0000","last_unstale":"2023-11-25T04:08:37.139797+0000","last_undegraded":"2023-11-25T04:08:37.139797+0000","last_fullsized":"2023-11-25T04:08:37.139797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139742+0000","last_change":"2023-11-25T04:08:36.146000+0000","last_active":"2023-11-25T04:08:37.139742+0000","last_peered":"2023-11-25T04:08:37.139742+0000","last_clean":"2023-11-25T04:08:37.139742+0000","last_became_active":"2023-11-25T04:08:36.145662+0000","last_became_peered":"2023-11-25T04:08:36.145662+0000","last_unstale":"2023-11-25T04:08:37.139742+0000","last_undegraded":"2023-11-25T04:08:37.139742+0000","last_fullsized":"2023-11-25T04:08:37.139742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.146420+0000","last_change":"2023-11-25T04:08:35.164501+0000","last_active":"2023-11-25T04:08:36.146420+0000","last_peered":"2023-11-25T04:08:36.146420+0000","last_clean":"2023-11-25T04:08:36.146420+0000","last_became_active":"2023-11-25T04:08:35.164008+0000","last_became_peered":"2023-11-25T04:08:35.164008+0000","last_unstale":"2023-11-25T04:08:36.146420+0000","last_undegraded":"2023-11-25T04:08:36.146420+0000","last_fullsized":"2023-11-25T04:08:36.146420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:49.360276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140664+0000","last_change":"2023-11-25T04:08:36.157653+0000","last_active":"2023-11-25T04:08:37.140664+0000","last_peered":"2023-11-25T04:08:37.140664+0000","last_clean":"2023-11-25T04:08:37.140664+0000","last_became_active":"2023-11-25T04:08:36.157323+0000","last_became_peered":"2023-11-25T04:08:36.157323+0000","last_unstale":"2023-11-25T04:08:37.140664+0000","last_undegraded":"2023-11-25T04:08:37.140664+0000","last_fullsized":"2023-11-25T04:08:37.140664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.155471+0000","last_change":"2023-11-25T04:08:35.166516+0000","last_active":"2023-11-25T04:08:36.155471+0000","last_peered":"2023-11-25T04:08:36.155471+0000","last_clean":"2023-11-25T04:08:36.155471+0000","last_became_active":"2023-11-25T04:08:35.166204+0000","last_became_peered":"2023-11-25T04:08:35.166204+0000","last_unstale":"2023-11-25T04:08:36.155471+0000","last_undegraded":"2023-11-25T04:08:36.155471+0000","last_fullsized":"2023-11-25T04:08:36.155471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165130+0000","last_change":"2023-11-25T04:08:36.157253+0000","last_active":"2023-11-25T04:08:36.165130+0000","last_peered":"2023-11-25T04:08:36.165130+0000","last_clean":"2023-11-25T04:08:36.165130+0000","last_became_active":"2023-11-25T04:08:36.156799+0000","last_became_peered":"2023-11-25T04:08:36.156799+0000","last_unstale":"2023-11-25T04:08:36.165130+0000","last_undegraded":"2023-11-25T04:08:36.165130+0000","last_fullsized":"2023-11-25T04:08:36.165130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.146666+0000","last_change":"2023-11-25T04:08:35.165700+0000","last_active":"2023-11-25T04:08:36.146666+0000","last_peered":"2023-11-25T04:08:36.146666+0000","last_clean":"2023-11-25T04:08:36.146666+0000","last_became_active":"2023-11-25T04:08:35.165341+0000","last_became_peered":"2023-11-25T04:08:35.165341+0000","last_unstale":"2023-11-25T04:08:36.146666+0000","last_undegraded":"2023-11-25T04:08:36.146666+0000","last_fullsized":"2023-11-25T04:08:36.146666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:58.609810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.159886+0000","last_change":"2023-11-25T04:08:36.158411+0000","last_active":"2023-11-25T04:08:36.159886+0000","last_peered":"2023-11-25T04:08:36.159886+0000","last_clean":"2023-11-25T04:08:36.159886+0000","last_became_active":"2023-11-25T04:08:36.156523+0000","last_became_peered":"2023-11-25T04:08:36.156523+0000","last_unstale":"2023-11-25T04:08:36.159886+0000","last_undegraded":"2023-11-25T04:08:36.159886+0000","last_fullsized":"2023-11-25T04:08:36.159886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:37.085846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140940+0000","last_change":"2023-11-25T04:08:35.167699+0000","last_active":"2023-11-25T04:08:37.140940+0000","last_peered":"2023-11-25T04:08:37.140940+0000","last_clean":"2023-11-25T04:08:37.140940+0000","last_became_active":"2023-11-25T04:08:35.167457+0000","last_became_peered":"2023-11-25T04:08:35.167457+0000","last_unstale":"2023-11-25T04:08:37.140940+0000","last_undegraded":"2023-11-25T04:08:37.140940+0000","last_fullsized":"2023-11-25T04:08:37.140940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:22.460231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141339+0000","last_change":"2023-11-25T04:08:36.149678+0000","last_active":"2023-11-25T04:08:37.141339+0000","last_peered":"2023-11-25T04:08:37.141339+0000","last_clean":"2023-11-25T04:08:37.141339+0000","last_became_active":"2023-11-25T04:08:36.149356+0000","last_became_peered":"2023-11-25T04:08:36.149356+0000","last_unstale":"2023-11-25T04:08:37.141339+0000","last_undegraded":"2023-11-25T04:08:37.141339+0000","last_fullsized":"2023-11-25T04:08:37.141339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.183609+0000","last_change":"2023-11-25T04:08:35.164920+0000","last_active":"2023-11-25T04:08:36.183609+0000","last_peered":"2023-11-25T04:08:36.183609+0000","last_clean":"2023-11-25T04:08:36.183609+0000","last_became_active":"2023-11-25T04:08:35.164319+0000","last_became_peered":"2023-11-25T04:08:35.164319+0000","last_unstale":"2023-11-25T04:08:36.183609+0000","last_undegraded":"2023-11-25T04:08:36.183609+0000","last_fullsized":"2023-11-25T04:08:36.183609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:50.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164813+0000","last_change":"2023-11-25T04:08:36.158479+0000","last_active":"2023-11-25T04:08:36.164813+0000","last_peered":"2023-11-25T04:08:36.164813+0000","last_clean":"2023-11-25T04:08:36.164813+0000","last_became_active":"2023-11-25T04:08:36.158222+0000","last_became_peered":"2023-11-25T04:08:36.158222+0000","last_unstale":"2023-11-25T04:08:36.164813+0000","last_undegraded":"2023-11-25T04:08:36.164813+0000","last_fullsized":"2023-11-25T04:08:36.164813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.179811+0000","last_change":"2023-11-25T04:08:35.175417+0000","last_active":"2023-11-25T04:08:36.179811+0000","last_peered":"2023-11-25T04:08:36.179811+0000","last_clean":"2023-11-25T04:08:36.179811+0000","last_became_active":"2023-11-25T04:08:35.175050+0000","last_became_peered":"2023-11-25T04:08:35.175050+0000","last_unstale":"2023-11-25T04:08:36.179811+0000","last_undegraded":"2023-11-25T04:08:36.179811+0000","last_fullsized":"2023-11-25T04:08:36.179811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.157608+0000","last_change":"2023-11-25T04:08:36.155250+0000","last_active":"2023-11-25T04:08:36.157608+0000","last_peered":"2023-11-25T04:08:36.157608+0000","last_clean":"2023-11-25T04:08:36.157608+0000","last_became_active":"2023-11-25T04:08:36.154944+0000","last_became_peered":"2023-11-25T04:08:36.154944+0000","last_unstale":"2023-11-25T04:08:36.157608+0000","last_undegraded":"2023-11-25T04:08:36.157608+0000","last_fullsized":"2023-11-25T04:08:36.157608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:12:45.073515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.147402+0000","last_change":"2023-11-25T04:08:35.162897+0000","last_active":"2023-11-25T04:08:36.147402+0000","last_peered":"2023-11-25T04:08:36.147402+0000","last_clean":"2023-11-25T04:08:36.147402+0000","last_became_active":"2023-11-25T04:08:35.162684+0000","last_became_peered":"2023-11-25T04:08:35.162684+0000","last_unstale":"2023-11-25T04:08:36.147402+0000","last_undegraded":"2023-11-25T04:08:36.147402+0000","last_fullsized":"2023-11-25T04:08:36.147402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:07.785129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.157195+0000","last_change":"2023-11-25T04:08:36.153204+0000","last_active":"2023-11-25T04:08:36.157195+0000","last_peered":"2023-11-25T04:08:36.157195+0000","last_clean":"2023-11-25T04:08:36.157195+0000","last_became_active":"2023-11-25T04:08:36.152856+0000","last_became_peered":"2023-11-25T04:08:36.152856+0000","last_unstale":"2023-11-25T04:08:36.157195+0000","last_undegraded":"2023-11-25T04:08:36.157195+0000","last_fullsized":"2023-11-25T04:08:36.157195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:39.596607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.149565+0000","last_change":"2023-11-25T04:08:35.170232+0000","last_active":"2023-11-25T04:08:36.149565+0000","last_peered":"2023-11-25T04:08:36.149565+0000","last_clean":"2023-11-25T04:08:36.149565+0000","last_became_active":"2023-11-25T04:08:35.168959+0000","last_became_peered":"2023-11-25T04:08:35.168959+0000","last_unstale":"2023-11-25T04:08:36.149565+0000","last_undegraded":"2023-11-25T04:08:36.149565+0000","last_fullsized":"2023-11-25T04:08:36.149565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:25.799051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165087+0000","last_change":"2023-11-25T04:08:36.159133+0000","last_active":"2023-11-25T04:08:36.165087+0000","last_peered":"2023-11-25T04:08:36.165087+0000","last_clean":"2023-11-25T04:08:36.165087+0000","last_became_active":"2023-11-25T04:08:36.158832+0000","last_became_peered":"2023-11-25T04:08:36.158832+0000","last_unstale":"2023-11-25T04:08:36.165087+0000","last_undegraded":"2023-11-25T04:08:36.165087+0000","last_fullsized":"2023-11-25T04:08:36.165087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:37.085846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.180709+0000","last_change":"2023-11-25T04:08:35.158168+0000","last_active":"2023-11-25T04:08:36.180709+0000","last_peered":"2023-11-25T04:08:36.180709+0000","last_clean":"2023-11-25T04:08:36.180709+0000","last_became_active":"2023-11-25T04:08:35.157857+0000","last_became_peered":"2023-11-25T04:08:35.157857+0000","last_unstale":"2023-11-25T04:08:36.180709+0000","last_undegraded":"2023-11-25T04:08:36.180709+0000","last_fullsized":"2023-11-25T04:08:36.180709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:16.648041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.157076+0000","last_change":"2023-11-25T04:08:36.153946+0000","last_active":"2023-11-25T04:08:36.157076+0000","last_peered":"2023-11-25T04:08:36.157076+0000","last_clean":"2023-11-25T04:08:36.157076+0000","last_became_active":"2023-11-25T04:08:36.153643+0000","last_became_peered":"2023-11-25T04:08:36.153643+0000","last_unstale":"2023-11-25T04:08:36.157076+0000","last_undegraded":"2023-11-25T04:08:36.157076+0000","last_fullsized":"2023-11-25T04:08:36.157076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141439+0000","last_change":"2023-11-25T04:08:35.168907+0000","last_active":"2023-11-25T04:08:37.141439+0000","last_peered":"2023-11-25T04:08:37.141439+0000","last_clean":"2023-11-25T04:08:37.141439+0000","last_became_active":"2023-11-25T04:08:35.168515+0000","last_became_peered":"2023-11-25T04:08:35.168515+0000","last_unstale":"2023-11-25T04:08:37.141439+0000","last_undegraded":"2023-11-25T04:08:37.141439+0000","last_fullsized":"2023-11-25T04:08:37.141439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:16.648041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164853+0000","last_change":"2023-11-25T04:08:36.159282+0000","last_active":"2023-11-25T04:08:36.164853+0000","last_peered":"2023-11-25T04:08:36.164853+0000","last_clean":"2023-11-25T04:08:36.164853+0000","last_became_active":"2023-11-25T04:08:36.159008+0000","last_became_peered":"2023-11-25T04:08:36.159008+0000","last_unstale":"2023-11-25T04:08:36.164853+0000","last_undegraded":"2023-11-25T04:08:36.164853+0000","last_fullsized":"2023-11-25T04:08:36.164853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.180047+0000","last_change":"2023-11-25T04:08:35.161420+0000","last_active":"2023-11-25T04:08:36.180047+0000","last_peered":"2023-11-25T04:08:36.180047+0000","last_clean":"2023-11-25T04:08:36.180047+0000","last_became_active":"2023-11-25T04:08:35.161085+0000","last_became_peered":"2023-11-25T04:08:35.161085+0000","last_unstale":"2023-11-25T04:08:36.180047+0000","last_undegraded":"2023-11-25T04:08:36.180047+0000","last_fullsized":"2023-11-25T04:08:36.180047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:37.314044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164914+0000","last_change":"2023-11-25T04:08:36.160108+0000","last_active":"2023-11-25T04:08:36.164914+0000","last_peered":"2023-11-25T04:08:36.164914+0000","last_clean":"2023-11-25T04:08:36.164914+0000","last_became_active":"2023-11-25T04:08:36.159833+0000","last_became_peered":"2023-11-25T04:08:36.159833+0000","last_unstale":"2023-11-25T04:08:36.164914+0000","last_undegraded":"2023-11-25T04:08:36.164914+0000","last_fullsized":"2023-11-25T04:08:36.164914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141018+0000","last_change":"2023-11-25T04:08:35.166785+0000","last_active":"2023-11-25T04:08:37.141018+0000","last_peered":"2023-11-25T04:08:37.141018+0000","last_clean":"2023-11-25T04:08:37.141018+0000","last_became_active":"2023-11-25T04:08:35.166502+0000","last_became_peered":"2023-11-25T04:08:35.166502+0000","last_unstale":"2023-11-25T04:08:37.141018+0000","last_undegraded":"2023-11-25T04:08:37.141018+0000","last_fullsized":"2023-11-25T04:08:37.141018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:57.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.162126+0000","last_change":"2023-11-25T04:08:36.154284+0000","last_active":"2023-11-25T04:08:36.162126+0000","last_peered":"2023-11-25T04:08:36.162126+0000","last_clean":"2023-11-25T04:08:36.162126+0000","last_became_active":"2023-11-25T04:08:36.152651+0000","last_became_peered":"2023-11-25T04:08:36.152651+0000","last_unstale":"2023-11-25T04:08:36.162126+0000","last_undegraded":"2023-11-25T04:08:36.162126+0000","last_fullsized":"2023-11-25T04:08:36.162126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:06.500587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.146662+0000","last_change":"2023-11-25T04:08:35.164026+0000","last_active":"2023-11-25T04:08:36.146662+0000","last_peered":"2023-11-25T04:08:36.146662+0000","last_clean":"2023-11-25T04:08:36.146662+0000","last_became_active":"2023-11-25T04:08:35.163726+0000","last_became_peered":"2023-11-25T04:08:35.163726+0000","last_unstale":"2023-11-25T04:08:36.146662+0000","last_undegraded":"2023-11-25T04:08:36.146662+0000","last_fullsized":"2023-11-25T04:08:36.146662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:25.799051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165635+0000","last_change":"2023-11-25T04:08:36.162872+0000","last_active":"2023-11-25T04:08:36.165635+0000","last_peered":"2023-11-25T04:08:36.165635+0000","last_clean":"2023-11-25T04:08:36.165635+0000","last_became_active":"2023-11-25T04:08:36.162603+0000","last_became_peered":"2023-11-25T04:08:36.162603+0000","last_unstale":"2023-11-25T04:08:36.165635+0000","last_undegraded":"2023-11-25T04:08:36.165635+0000","last_fullsized":"2023-11-25T04:08:36.165635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-25T04:08:35.159998+0000","last_change":"2023-11-25T04:08:24.570240+0000","last_active":"2023-11-25T04:08:35.159998+0000","last_peered":"2023-11-25T04:08:35.159998+0000","last_clean":"2023-11-25T04:08:35.159998+0000","last_became_active":"2023-11-25T04:08:24.569371+0000","last_became_peered":"2023-11-25T04:08:24.569371+0000","last_unstale":"2023-11-25T04:08:35.159998+0000","last_undegraded":"2023-11-25T04:08:35.159998+0000","last_fullsized":"2023-11-25T04:08:35.159998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_clean_scrub_stamp":"2023-11-25T04:08:23.534401+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:28.293127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.142539+0000","last_change":"2023-11-25T04:08:35.151872+0000","last_active":"2023-11-25T04:08:36.142539+0000","last_peered":"2023-11-25T04:08:36.142539+0000","last_clean":"2023-11-25T04:08:36.142539+0000","last_became_active":"2023-11-25T04:08:35.151557+0000","last_became_peered":"2023-11-25T04:08:35.151557+0000","last_unstale":"2023-11-25T04:08:36.142539+0000","last_undegraded":"2023-11-25T04:08:36.142539+0000","last_fullsized":"2023-11-25T04:08:36.142539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139961+0000","last_change":"2023-11-25T04:08:36.159174+0000","last_active":"2023-11-25T04:08:37.139961+0000","last_peered":"2023-11-25T04:08:37.139961+0000","last_clean":"2023-11-25T04:08:37.139961+0000","last_became_active":"2023-11-25T04:08:36.158893+0000","last_became_peered":"2023-11-25T04:08:36.158893+0000","last_unstale":"2023-11-25T04:08:37.139961+0000","last_undegraded":"2023-11-25T04:08:37.139961+0000","last_fullsized":"2023-11-25T04:08:37.139961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.145150+0000","last_change":"2023-11-25T04:08:35.166896+0000","last_active":"2023-11-25T04:08:36.145150+0000","last_peered":"2023-11-25T04:08:36.145150+0000","last_clean":"2023-11-25T04:08:36.145150+0000","last_became_active":"2023-11-25T04:08:35.166601+0000","last_became_peered":"2023-11-25T04:08:35.166601+0000","last_unstale":"2023-11-25T04:08:36.145150+0000","last_undegraded":"2023-11-25T04:08:36.145150+0000","last_fullsized":"2023-11-25T04:08:36.145150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:05.496477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.149196+0000","last_change":"2023-11-25T04:08:36.147229+0000","last_active":"2023-11-25T04:08:36.149196+0000","last_peered":"2023-11-25T04:08:36.149196+0000","last_clean":"2023-11-25T04:08:36.149196+0000","last_became_active":"2023-11-25T04:08:36.146889+0000","last_became_peered":"2023-11-25T04:08:36.146889+0000","last_unstale":"2023-11-25T04:08:36.149196+0000","last_undegraded":"2023-11-25T04:08:36.149196+0000","last_fullsized":"2023-11-25T04:08:36.149196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:00:37.946585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.148098+0000","last_change":"2023-11-25T04:08:35.162405+0000","last_active":"2023-11-25T04:08:36.148098+0000","last_peered":"2023-11-25T04:08:36.148098+0000","last_clean":"2023-11-25T04:08:36.148098+0000","last_became_active":"2023-11-25T04:08:35.162084+0000","last_became_peered":"2023-11-25T04:08:35.162084+0000","last_unstale":"2023-11-25T04:08:36.148098+0000","last_undegraded":"2023-11-25T04:08:36.148098+0000","last_fullsized":"2023-11-25T04:08:36.148098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140649+0000","last_change":"2023-11-25T04:08:36.152006+0000","last_active":"2023-11-25T04:08:37.140649+0000","last_peered":"2023-11-25T04:08:37.140649+0000","last_clean":"2023-11-25T04:08:37.140649+0000","last_became_active":"2023-11-25T04:08:36.151655+0000","last_became_peered":"2023-11-25T04:08:36.151655+0000","last_unstale":"2023-11-25T04:08:37.140649+0000","last_undegraded":"2023-11-25T04:08:37.140649+0000","last_fullsized":"2023-11-25T04:08:37.140649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.147549+0000","last_change":"2023-11-25T04:08:35.162315+0000","last_active":"2023-11-25T04:08:36.147549+0000","last_peered":"2023-11-25T04:08:36.147549+0000","last_clean":"2023-11-25T04:08:36.147549+0000","last_became_active":"2023-11-25T04:08:35.162052+0000","last_became_peered":"2023-11-25T04:08:35.162052+0000","last_unstale":"2023-11-25T04:08:36.147549+0000","last_undegraded":"2023-11-25T04:08:36.147549+0000","last_fullsized":"2023-11-25T04:08:36.147549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:53.354503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141360+0000","last_change":"2023-11-25T04:08:36.158785+0000","last_active":"2023-11-25T04:08:37.141360+0000","last_peered":"2023-11-25T04:08:37.141360+0000","last_clean":"2023-11-25T04:08:37.141360+0000","last_became_active":"2023-11-25T04:08:36.155440+0000","last_became_peered":"2023-11-25T04:08:36.155440+0000","last_unstale":"2023-11-25T04:08:37.141360+0000","last_undegraded":"2023-11-25T04:08:37.141360+0000","last_fullsized":"2023-11-25T04:08:37.141360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:03.560567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140844+0000","last_change":"2023-11-25T04:08:35.168321+0000","last_active":"2023-11-25T04:08:37.140844+0000","last_peered":"2023-11-25T04:08:37.140844+0000","last_clean":"2023-11-25T04:08:37.140844+0000","last_became_active":"2023-11-25T04:08:35.168047+0000","last_became_peered":"2023-11-25T04:08:35.168047+0000","last_unstale":"2023-11-25T04:08:37.140844+0000","last_undegraded":"2023-11-25T04:08:37.140844+0000","last_fullsized":"2023-11-25T04:08:37.140844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:49.360276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165726+0000","last_change":"2023-11-25T04:08:36.157577+0000","last_active":"2023-11-25T04:08:36.165726+0000","last_peered":"2023-11-25T04:08:36.165726+0000","last_clean":"2023-11-25T04:08:36.165726+0000","last_became_active":"2023-11-25T04:08:36.157302+0000","last_became_peered":"2023-11-25T04:08:36.157302+0000","last_unstale":"2023-11-25T04:08:36.165726+0000","last_undegraded":"2023-11-25T04:08:36.165726+0000","last_fullsized":"2023-11-25T04:08:36.165726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.146524+0000","last_change":"2023-11-25T04:08:35.171642+0000","last_active":"2023-11-25T04:08:36.146524+0000","last_peered":"2023-11-25T04:08:36.146524+0000","last_clean":"2023-11-25T04:08:36.146524+0000","last_became_active":"2023-11-25T04:08:35.171169+0000","last_became_peered":"2023-11-25T04:08:35.171169+0000","last_unstale":"2023-11-25T04:08:36.146524+0000","last_undegraded":"2023-11-25T04:08:36.146524+0000","last_fullsized":"2023-11-25T04:08:36.146524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:57.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140868+0000","last_change":"2023-11-25T04:08:36.155558+0000","last_active":"2023-11-25T04:08:37.140868+0000","last_peered":"2023-11-25T04:08:37.140868+0000","last_clean":"2023-11-25T04:08:37.140868+0000","last_became_active":"2023-11-25T04:08:36.155280+0000","last_became_peered":"2023-11-25T04:08:36.155280+0000","last_unstale":"2023-11-25T04:08:37.140868+0000","last_undegraded":"2023-11-25T04:08:37.140868+0000","last_fullsized":"2023-11-25T04:08:37.140868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140977+0000","last_change":"2023-11-25T04:08:35.164983+0000","last_active":"2023-11-25T04:08:37.140977+0000","last_peered":"2023-11-25T04:08:37.140977+0000","last_clean":"2023-11-25T04:08:37.140977+0000","last_became_active":"2023-11-25T04:08:35.164714+0000","last_became_peered":"2023-11-25T04:08:35.164714+0000","last_unstale":"2023-11-25T04:08:37.140977+0000","last_undegraded":"2023-11-25T04:08:37.140977+0000","last_fullsized":"2023-11-25T04:08:37.140977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:58.609810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140402+0000","last_change":"2023-11-25T04:08:36.155740+0000","last_active":"2023-11-25T04:08:37.140402+0000","last_peered":"2023-11-25T04:08:37.140402+0000","last_clean":"2023-11-25T04:08:37.140402+0000","last_became_active":"2023-11-25T04:08:36.155416+0000","last_became_peered":"2023-11-25T04:08:36.155416+0000","last_unstale":"2023-11-25T04:08:37.140402+0000","last_undegraded":"2023-11-25T04:08:37.140402+0000","last_fullsized":"2023-11-25T04:08:37.140402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:34:53.382347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.181726+0000","last_change":"2023-11-25T04:08:35.164671+0000","last_active":"2023-11-25T04:08:36.181726+0000","last_peered":"2023-11-25T04:08:36.181726+0000","last_clean":"2023-11-25T04:08:36.181726+0000","last_became_active":"2023-11-25T04:08:35.164303+0000","last_became_peered":"2023-11-25T04:08:35.164303+0000","last_unstale":"2023-11-25T04:08:36.181726+0000","last_undegraded":"2023-11-25T04:08:36.181726+0000","last_fullsized":"2023-11-25T04:08:36.181726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:21.947721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.155912+0000","last_change":"2023-11-25T04:08:36.152277+0000","last_active":"2023-11-25T04:08:36.155912+0000","last_peered":"2023-11-25T04:08:36.155912+0000","last_clean":"2023-11-25T04:08:36.155912+0000","last_became_active":"2023-11-25T04:08:36.151952+0000","last_became_peered":"2023-11-25T04:08:36.151952+0000","last_unstale":"2023-11-25T04:08:36.155912+0000","last_undegraded":"2023-11-25T04:08:36.155912+0000","last_fullsized":"2023-11-25T04:08:36.155912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.145013+0000","last_change":"2023-11-25T04:08:35.169634+0000","last_active":"2023-11-25T04:08:36.145013+0000","last_peered":"2023-11-25T04:08:36.145013+0000","last_clean":"2023-11-25T04:08:36.145013+0000","last_became_active":"2023-11-25T04:08:35.169006+0000","last_became_peered":"2023-11-25T04:08:35.169006+0000","last_unstale":"2023-11-25T04:08:36.145013+0000","last_undegraded":"2023-11-25T04:08:36.145013+0000","last_fullsized":"2023-11-25T04:08:36.145013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:37.314044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141007+0000","last_change":"2023-11-25T04:08:36.152671+0000","last_active":"2023-11-25T04:08:37.141007+0000","last_peered":"2023-11-25T04:08:37.141007+0000","last_clean":"2023-11-25T04:08:37.141007+0000","last_became_active":"2023-11-25T04:08:36.152379+0000","last_became_peered":"2023-11-25T04:08:36.152379+0000","last_unstale":"2023-11-25T04:08:37.141007+0000","last_undegraded":"2023-11-25T04:08:37.141007+0000","last_fullsized":"2023-11-25T04:08:37.141007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140747+0000","last_change":"2023-11-25T04:08:35.164407+0000","last_active":"2023-11-25T04:08:37.140747+0000","last_peered":"2023-11-25T04:08:37.140747+0000","last_clean":"2023-11-25T04:08:37.140747+0000","last_became_active":"2023-11-25T04:08:35.164096+0000","last_became_peered":"2023-11-25T04:08:35.164096+0000","last_unstale":"2023-11-25T04:08:37.140747+0000","last_undegraded":"2023-11-25T04:08:37.140747+0000","last_fullsized":"2023-11-25T04:08:37.140747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140279+0000","last_change":"2023-11-25T04:08:36.155323+0000","last_active":"2023-11-25T04:08:37.140279+0000","last_peered":"2023-11-25T04:08:37.140279+0000","last_clean":"2023-11-25T04:08:37.140279+0000","last_became_active":"2023-11-25T04:08:36.154026+0000","last_became_peered":"2023-11-25T04:08:36.154026+0000","last_unstale":"2023-11-25T04:08:37.140279+0000","last_undegraded":"2023-11-25T04:08:37.140279+0000","last_fullsized":"2023-11-25T04:08:37.140279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:50.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140840+0000","last_change":"2023-11-25T04:08:35.161694+0000","last_active":"2023-11-25T04:08:37.140840+0000","last_peered":"2023-11-25T04:08:37.140840+0000","last_clean":"2023-11-25T04:08:37.140840+0000","last_became_active":"2023-11-25T04:08:35.161392+0000","last_became_peered":"2023-11-25T04:08:35.161392+0000","last_unstale":"2023-11-25T04:08:37.140840+0000","last_undegraded":"2023-11-25T04:08:37.140840+0000","last_fullsized":"2023-11-25T04:08:37.140840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140137+0000","last_change":"2023-11-25T04:08:36.147757+0000","last_active":"2023-11-25T04:08:37.140137+0000","last_peered":"2023-11-25T04:08:37.140137+0000","last_clean":"2023-11-25T04:08:37.140137+0000","last_became_active":"2023-11-25T04:08:36.147483+0000","last_became_peered":"2023-11-25T04:08:36.147483+0000","last_unstale":"2023-11-25T04:08:37.140137+0000","last_undegraded":"2023-11-25T04:08:37.140137+0000","last_fullsized":"2023-11-25T04:08:37.140137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.179309+0000","last_change":"2023-11-25T04:08:35.170314+0000","last_active":"2023-11-25T04:08:36.179309+0000","last_peered":"2023-11-25T04:08:36.179309+0000","last_clean":"2023-11-25T04:08:36.179309+0000","last_became_active":"2023-11-25T04:08:35.170029+0000","last_became_peered":"2023-11-25T04:08:35.170029+0000","last_unstale":"2023-11-25T04:08:36.179309+0000","last_undegraded":"2023-11-25T04:08:36.179309+0000","last_fullsized":"2023-11-25T04:08:36.179309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:22.460231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165204+0000","last_change":"2023-11-25T04:08:36.161075+0000","last_active":"2023-11-25T04:08:36.165204+0000","last_peered":"2023-11-25T04:08:36.165204+0000","last_clean":"2023-11-25T04:08:36.165204+0000","last_became_active":"2023-11-25T04:08:36.160734+0000","last_became_peered":"2023-11-25T04:08:36.160734+0000","last_unstale":"2023-11-25T04:08:36.165204+0000","last_undegraded":"2023-11-25T04:08:36.165204+0000","last_fullsized":"2023-11-25T04:08:36.165204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165823+0000","last_change":"2023-11-25T04:08:36.160701+0000","last_active":"2023-11-25T04:08:36.165823+0000","last_peered":"2023-11-25T04:08:36.165823+0000","last_clean":"2023-11-25T04:08:36.165823+0000","last_became_active":"2023-11-25T04:08:36.160423+0000","last_became_peered":"2023-11-25T04:08:36.160423+0000","last_unstale":"2023-11-25T04:08:36.165823+0000","last_undegraded":"2023-11-25T04:08:36.165823+0000","last_fullsized":"2023-11-25T04:08:36.165823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:22.951831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.182023+0000","last_change":"2023-11-25T04:08:35.170930+0000","last_active":"2023-11-25T04:08:36.182023+0000","last_peered":"2023-11-25T04:08:36.182023+0000","last_clean":"2023-11-25T04:08:36.182023+0000","last_became_active":"2023-11-25T04:08:35.170627+0000","last_became_peered":"2023-11-25T04:08:35.170627+0000","last_unstale":"2023-11-25T04:08:36.182023+0000","last_undegraded":"2023-11-25T04:08:36.182023+0000","last_fullsized":"2023-11-25T04:08:36.182023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:50.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.154518+0000","last_change":"2023-11-25T04:08:36.151765+0000","last_active":"2023-11-25T04:08:36.154518+0000","last_peered":"2023-11-25T04:08:36.154518+0000","last_clean":"2023-11-25T04:08:36.154518+0000","last_became_active":"2023-11-25T04:08:36.151464+0000","last_became_peered":"2023-11-25T04:08:36.151464+0000","last_unstale":"2023-11-25T04:08:36.154518+0000","last_undegraded":"2023-11-25T04:08:36.154518+0000","last_fullsized":"2023-11-25T04:08:36.154518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:03.560567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.182338+0000","last_change":"2023-11-25T04:08:35.170080+0000","last_active":"2023-11-25T04:08:36.182338+0000","last_peered":"2023-11-25T04:08:36.182338+0000","last_clean":"2023-11-25T04:08:36.182338+0000","last_became_active":"2023-11-25T04:08:35.169782+0000","last_became_peered":"2023-11-25T04:08:35.169782+0000","last_unstale":"2023-11-25T04:08:36.182338+0000","last_undegraded":"2023-11-25T04:08:36.182338+0000","last_fullsized":"2023-11-25T04:08:36.182338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.159865+0000","last_change":"2023-11-25T04:08:36.158134+0000","last_active":"2023-11-25T04:08:36.159865+0000","last_peered":"2023-11-25T04:08:36.159865+0000","last_clean":"2023-11-25T04:08:36.159865+0000","last_became_active":"2023-11-25T04:08:36.157273+0000","last_became_peered":"2023-11-25T04:08:36.157273+0000","last_unstale":"2023-11-25T04:08:36.159865+0000","last_undegraded":"2023-11-25T04:08:36.159865+0000","last_fullsized":"2023-11-25T04:08:36.159865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:17.652150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140288+0000","last_change":"2023-11-25T04:08:35.168130+0000","last_active":"2023-11-25T04:08:37.140288+0000","last_peered":"2023-11-25T04:08:37.140288+0000","last_clean":"2023-11-25T04:08:37.140288+0000","last_became_active":"2023-11-25T04:08:35.167876+0000","last_became_peered":"2023-11-25T04:08:35.167876+0000","last_unstale":"2023-11-25T04:08:37.140288+0000","last_undegraded":"2023-11-25T04:08:37.140288+0000","last_fullsized":"2023-11-25T04:08:37.140288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140071+0000","last_change":"2023-11-25T04:08:36.157577+0000","last_active":"2023-11-25T04:08:37.140071+0000","last_peered":"2023-11-25T04:08:37.140071+0000","last_clean":"2023-11-25T04:08:37.140071+0000","last_became_active":"2023-11-25T04:08:36.157233+0000","last_became_peered":"2023-11-25T04:08:36.157233+0000","last_unstale":"2023-11-25T04:08:37.140071+0000","last_undegraded":"2023-11-25T04:08:37.140071+0000","last_fullsized":"2023-11-25T04:08:37.140071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.182242+0000","last_change":"2023-11-25T04:08:35.170151+0000","last_active":"2023-11-25T04:08:36.182242+0000","last_peered":"2023-11-25T04:08:36.182242+0000","last_clean":"2023-11-25T04:08:36.182242+0000","last_became_active":"2023-11-25T04:08:35.169808+0000","last_became_peered":"2023-11-25T04:08:35.169808+0000","last_unstale":"2023-11-25T04:08:36.182242+0000","last_undegraded":"2023-11-25T04:08:36.182242+0000","last_fullsized":"2023-11-25T04:08:36.182242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:05.496477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-25T04:08:40.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-25T04:08:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.321+0000 7f9f0a53c640 1 Processor -- start 2023-11-25T04:08:40.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.321+0000 7f9f0a53c640 1 -- start start 2023-11-25T04:08:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f0a53c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f04160ab0 0x7f9f040afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f0a53c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f040b2450 0x7f9f040cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f0a53c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f040cdd30 con 0x7f9f040d0030 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f0a53c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f040ce2d0 con 0x7f9f040b2450 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f0a53c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040d0a90 con 0x7f9f04160ab0 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f037fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f040b2450 0x7f9f040cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f037fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9f040b2450 0x7f9f040cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53018/0 (socket says 172.21.15.2:53018) 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f037fe640 1 -- 172.21.15.2:0/3750994784 learned_addr learned my addr 172.21.15.2:0/3750994784 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f03fff640 1 --2- 172.21.15.2:0/3750994784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f04160ab0 0x7f9f040afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f037fe640 1 -- 172.21.15.2:0/3750994784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f04160ab0 msgr2=0x7f9f040afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f037fe640 1 --2- 172.21.15.2:0/3750994784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f04160ab0 0x7f9f040afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f037fe640 1 -- 172.21.15.2:0/3750994784 >> v1:172.21.15.66:6789/0 conn(0x7f9f040d0030 legacy=0x7f9f040d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:40.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.322+0000 7f9f037fe640 1 -- 172.21.15.2:0/3750994784 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f040b02f0 con 0x7f9f040b2450 2023-11-25T04:08:40.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.323+0000 7f9f037fe640 1 --2- 172.21.15.2:0/3750994784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f040b2450 0x7f9f040cfaf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009870 tx=0x7f9eec02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa24fadd3b2cd0d server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.323+0000 7f9f02ffd640 1 -- 172.21.15.2:0/3750994784 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0317c0 con 0x7f9f040b2450 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.323+0000 7f9f02ffd640 1 -- 172.21.15.2:0/3750994784 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec031920 con 0x7f9f040b2450 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.323+0000 7f9f02ffd640 1 -- 172.21.15.2:0/3750994784 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec031cb0 con 0x7f9f040b2450 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.324+0000 7f9f0a53c640 1 -- 172.21.15.2:0/3750994784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f040b2450 msgr2=0x7f9f040cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.324+0000 7f9f0a53c640 1 --2- 172.21.15.2:0/3750994784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f040b2450 0x7f9f040cfaf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9eec009870 tx=0x7f9eec02b860 comp rx=0 tx=0).stop 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.324+0000 7f9f0a53c640 1 -- 172.21.15.2:0/3750994784 shutdown_connections 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.324+0000 7f9f0a53c640 1 --2- 172.21.15.2:0/3750994784 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f040b2450 0x7f9f040cfaf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.324+0000 7f9f0a53c640 1 --2- 172.21.15.2:0/3750994784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f04160ab0 0x7f9f040afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.324+0000 7f9f0a53c640 1 -- 172.21.15.2:0/3750994784 >> 172.21.15.2:0/3750994784 conn(0x7f9f0409c450 msgr2=0x7f9f040d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.324+0000 7f9f0a53c640 1 -- 172.21.15.2:0/3750994784 shutdown_connections 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.324+0000 7f9f0a53c640 1 -- 172.21.15.2:0/3750994784 wait complete. 2023-11-25T04:08:40.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.325+0000 7f9f0a53c640 1 Processor -- start 2023-11-25T04:08:40.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.325+0000 7f9f0a53c640 1 -- start start 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f0a53c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f040b2450 0x7f9f040ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f0a53c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f040d0030 0x7f9f040cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f0a53c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f04160ab0 0x7f9f041f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f0a53c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040caaf0 con 0x7f9f04160ab0 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f0a53c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040cadd0 con 0x7f9f040b2450 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f0a53c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040cb0b0 con 0x7f9f040d0030 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f08ad9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f04160ab0 0x7f9f041f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f08ad9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f04160ab0 0x7f9f041f3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53020/0 (socket says 172.21.15.2:53020) 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f08ad9640 1 -- 172.21.15.2:0/2157255832 learned_addr learned my addr 172.21.15.2:0/2157255832 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f037fe640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f040d0030 0x7f9f040cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f03fff640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f040b2450 0x7f9f040ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f08ad9640 1 -- 172.21.15.2:0/2157255832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f040d0030 msgr2=0x7f9f040cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f08ad9640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f040d0030 0x7f9f040cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f08ad9640 1 -- 172.21.15.2:0/2157255832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f040b2450 msgr2=0x7f9f040ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f08ad9640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f040b2450 0x7f9f040ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f08ad9640 1 -- 172.21.15.2:0/2157255832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eec0094d0 con 0x7f9f04160ab0 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f037fe640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f040d0030 0x7f9f040cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.326+0000 7f9f08ad9640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f04160ab0 0x7f9f041f3850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c700 tx=0x7f9efc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.327+0000 7f9f00ff9640 1 -- 172.21.15.2:0/2157255832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00aa50 con 0x7f9f04160ab0 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.327+0000 7f9f00ff9640 1 -- 172.21.15.2:0/2157255832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00abb0 con 0x7f9f04160ab0 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.327+0000 7f9f00ff9640 1 -- 172.21.15.2:0/2157255832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00ce10 con 0x7f9f04160ab0 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.327+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f040cb390 con 0x7f9f04160ab0 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.327+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f040ca730 con 0x7f9f04160ab0 2023-11-25T04:08:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.328+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f040cb8b0 con 0x7f9f04160ab0 2023-11-25T04:08:40.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.328+0000 7f9f00ff9640 1 -- 172.21.15.2:0/2157255832 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9efc012420 con 0x7f9f04160ab0 2023-11-25T04:08:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.329+0000 7f9f00ff9640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9ee406ae40 0x7f9ee406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.329+0000 7f9f03fff640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9ee406ae40 0x7f9ee406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.329+0000 7f9f00ff9640 1 -- 172.21.15.2:0/2157255832 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9efc0897c0 con 0x7f9f04160ab0 2023-11-25T04:08:40.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.329+0000 7f9f03fff640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9ee406ae40 0x7f9ee406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40079a0 tx=0x7f9ef4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.333+0000 7f9f00ff9640 1 -- 172.21.15.2:0/2157255832 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9efc054870 con 0x7f9f04160ab0 2023-11-25T04:08:40.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.505+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 --> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f040cdf60 con 0x7f9ee406ae40 2023-11-25T04:08:40.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.512+0000 7f9f00ff9640 1 -- 172.21.15.2:0/2157255832 <== mgr.4107 v2:172.21.15.2:6832/523998843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264673 (secure 0 0 0) 0x7f9ef40108d0 con 0x7f9ee406ae40 2023-11-25T04:08:40.517 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:40.518 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-25T04:08:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9ee406ae40 msgr2=0x7f9ee406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9ee406ae40 0x7f9ee406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40079a0 tx=0x7f9ef4008040 comp rx=0 tx=0).stop 2023-11-25T04:08:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f04160ab0 msgr2=0x7f9f041f3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f04160ab0 0x7f9f041f3850 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c700 tx=0x7f9efc00cbc0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 shutdown_connections 2023-11-25T04:08:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9f04160ab0 0x7f9f041f3850 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.520 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f040d0030 0x7f9f040cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9ee406ae40 0x7f9ee406d300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 --2- 172.21.15.2:0/2157255832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f040b2450 0x7f9f040ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 >> 172.21.15.2:0/2157255832 conn(0x7f9f0409c450 msgr2=0x7f9f0406cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 shutdown_connections 2023-11-25T04:08:40.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.515+0000 7f9f0a53c640 1 -- 172.21.15.2:0/2157255832 wait complete. 2023-11-25T04:08:40.527 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-25T04:08:39.478010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235552,"kb_used_data":2740,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739168,"statfs":{"total":773094113280,"available":772852908032,"internally_reserved":0,"allocated":2805760,"data_stored":1708736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.335307"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165535+0000","last_change":"2023-11-25T04:08:36.163622+0000","last_active":"2023-11-25T04:08:36.165535+0000","last_peered":"2023-11-25T04:08:36.165535+0000","last_clean":"2023-11-25T04:08:36.165535+0000","last_became_active":"2023-11-25T04:08:36.163344+0000","last_became_peered":"2023-11-25T04:08:36.163344+0000","last_unstale":"2023-11-25T04:08:36.165535+0000","last_undegraded":"2023-11-25T04:08:36.165535+0000","last_fullsized":"2023-11-25T04:08:36.165535+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140999+0000","last_change":"2023-11-25T04:08:36.153711+0000","last_active":"2023-11-25T04:08:37.140999+0000","last_peered":"2023-11-25T04:08:37.140999+0000","last_clean":"2023-11-25T04:08:37.140999+0000","last_became_active":"2023-11-25T04:08:36.153447+0000","last_became_peered":"2023-11-25T04:08:36.153447+0000","last_unstale":"2023-11-25T04:08:37.140999+0000","last_undegraded":"2023-11-25T04:08:37.140999+0000","last_fullsized":"2023-11-25T04:08:37.140999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.156250+0000","last_change":"2023-11-25T04:08:36.151108+0000","last_active":"2023-11-25T04:08:36.156250+0000","last_peered":"2023-11-25T04:08:36.156250+0000","last_clean":"2023-11-25T04:08:36.156250+0000","last_became_active":"2023-11-25T04:08:36.150809+0000","last_became_peered":"2023-11-25T04:08:36.150809+0000","last_unstale":"2023-11-25T04:08:36.156250+0000","last_undegraded":"2023-11-25T04:08:36.156250+0000","last_fullsized":"2023-11-25T04:08:36.156250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165710+0000","last_change":"2023-11-25T04:08:36.157420+0000","last_active":"2023-11-25T04:08:36.165710+0000","last_peered":"2023-11-25T04:08:36.165710+0000","last_clean":"2023-11-25T04:08:36.165710+0000","last_became_active":"2023-11-25T04:08:36.157122+0000","last_became_peered":"2023-11-25T04:08:36.157122+0000","last_unstale":"2023-11-25T04:08:36.165710+0000","last_undegraded":"2023-11-25T04:08:36.165710+0000","last_fullsized":"2023-11-25T04:08:36.165710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164694+0000","last_change":"2023-11-25T04:08:36.157106+0000","last_active":"2023-11-25T04:08:36.164694+0000","last_peered":"2023-11-25T04:08:36.164694+0000","last_clean":"2023-11-25T04:08:36.164694+0000","last_became_active":"2023-11-25T04:08:36.156764+0000","last_became_peered":"2023-11-25T04:08:36.156764+0000","last_unstale":"2023-11-25T04:08:36.164694+0000","last_undegraded":"2023-11-25T04:08:36.164694+0000","last_fullsized":"2023-11-25T04:08:36.164694+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165000+0000","last_change":"2023-11-25T04:08:36.156211+0000","last_active":"2023-11-25T04:08:36.165000+0000","last_peered":"2023-11-25T04:08:36.165000+0000","last_clean":"2023-11-25T04:08:36.165000+0000","last_became_active":"2023-11-25T04:08:36.154680+0000","last_became_peered":"2023-11-25T04:08:36.154680+0000","last_unstale":"2023-11-25T04:08:36.165000+0000","last_undegraded":"2023-11-25T04:08:36.165000+0000","last_fullsized":"2023-11-25T04:08:36.165000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.162238+0000","last_change":"2023-11-25T04:08:36.156525+0000","last_active":"2023-11-25T04:08:36.162238+0000","last_peered":"2023-11-25T04:08:36.162238+0000","last_clean":"2023-11-25T04:08:36.162238+0000","last_became_active":"2023-11-25T04:08:36.156219+0000","last_became_peered":"2023-11-25T04:08:36.156219+0000","last_unstale":"2023-11-25T04:08:36.162238+0000","last_undegraded":"2023-11-25T04:08:36.162238+0000","last_fullsized":"2023-11-25T04:08:36.162238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139675+0000","last_change":"2023-11-25T04:08:36.155837+0000","last_active":"2023-11-25T04:08:37.139675+0000","last_peered":"2023-11-25T04:08:37.139675+0000","last_clean":"2023-11-25T04:08:37.139675+0000","last_became_active":"2023-11-25T04:08:36.155513+0000","last_became_peered":"2023-11-25T04:08:36.155513+0000","last_unstale":"2023-11-25T04:08:37.139675+0000","last_undegraded":"2023-11-25T04:08:37.139675+0000","last_fullsized":"2023-11-25T04:08:37.139675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165515+0000","last_change":"2023-11-25T04:08:36.162855+0000","last_active":"2023-11-25T04:08:36.165515+0000","last_peered":"2023-11-25T04:08:36.165515+0000","last_clean":"2023-11-25T04:08:36.165515+0000","last_became_active":"2023-11-25T04:08:36.162564+0000","last_became_peered":"2023-11-25T04:08:36.162564+0000","last_unstale":"2023-11-25T04:08:36.165515+0000","last_undegraded":"2023-11-25T04:08:36.165515+0000","last_fullsized":"2023-11-25T04:08:36.165515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165612+0000","last_change":"2023-11-25T04:08:36.163530+0000","last_active":"2023-11-25T04:08:36.165612+0000","last_peered":"2023-11-25T04:08:36.165612+0000","last_clean":"2023-11-25T04:08:36.165612+0000","last_became_active":"2023-11-25T04:08:36.163227+0000","last_became_peered":"2023-11-25T04:08:36.163227+0000","last_unstale":"2023-11-25T04:08:36.165612+0000","last_undegraded":"2023-11-25T04:08:36.165612+0000","last_fullsized":"2023-11-25T04:08:36.165612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:06.500587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165545+0000","last_change":"2023-11-25T04:08:36.163831+0000","last_active":"2023-11-25T04:08:36.165545+0000","last_peered":"2023-11-25T04:08:36.165545+0000","last_clean":"2023-11-25T04:08:36.165545+0000","last_became_active":"2023-11-25T04:08:36.163508+0000","last_became_peered":"2023-11-25T04:08:36.163508+0000","last_unstale":"2023-11-25T04:08:36.165545+0000","last_undegraded":"2023-11-25T04:08:36.165545+0000","last_fullsized":"2023-11-25T04:08:36.165545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:17.652150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141201+0000","last_change":"2023-11-25T04:08:36.158244+0000","last_active":"2023-11-25T04:08:37.141201+0000","last_peered":"2023-11-25T04:08:37.141201+0000","last_clean":"2023-11-25T04:08:37.141201+0000","last_became_active":"2023-11-25T04:08:36.157786+0000","last_became_peered":"2023-11-25T04:08:36.157786+0000","last_unstale":"2023-11-25T04:08:37.141201+0000","last_undegraded":"2023-11-25T04:08:37.141201+0000","last_fullsized":"2023-11-25T04:08:37.141201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139966+0000","last_change":"2023-11-25T04:08:36.156689+0000","last_active":"2023-11-25T04:08:37.139966+0000","last_peered":"2023-11-25T04:08:37.139966+0000","last_clean":"2023-11-25T04:08:37.139966+0000","last_became_active":"2023-11-25T04:08:36.156198+0000","last_became_peered":"2023-11-25T04:08:36.156198+0000","last_unstale":"2023-11-25T04:08:37.139966+0000","last_undegraded":"2023-11-25T04:08:37.139966+0000","last_fullsized":"2023-11-25T04:08:37.139966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.155740+0000","last_change":"2023-11-25T04:08:36.154649+0000","last_active":"2023-11-25T04:08:36.155740+0000","last_peered":"2023-11-25T04:08:36.155740+0000","last_clean":"2023-11-25T04:08:36.155740+0000","last_became_active":"2023-11-25T04:08:36.154367+0000","last_became_peered":"2023-11-25T04:08:36.154367+0000","last_unstale":"2023-11-25T04:08:36.155740+0000","last_undegraded":"2023-11-25T04:08:36.155740+0000","last_fullsized":"2023-11-25T04:08:36.155740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:26.803161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140716+0000","last_change":"2023-11-25T04:08:36.154568+0000","last_active":"2023-11-25T04:08:37.140716+0000","last_peered":"2023-11-25T04:08:37.140716+0000","last_clean":"2023-11-25T04:08:37.140716+0000","last_became_active":"2023-11-25T04:08:36.154254+0000","last_became_peered":"2023-11-25T04:08:36.154254+0000","last_unstale":"2023-11-25T04:08:37.140716+0000","last_undegraded":"2023-11-25T04:08:37.140716+0000","last_fullsized":"2023-11-25T04:08:37.140716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165315+0000","last_change":"2023-11-25T04:08:36.156505+0000","last_active":"2023-11-25T04:08:36.165315+0000","last_peered":"2023-11-25T04:08:36.165315+0000","last_clean":"2023-11-25T04:08:36.165315+0000","last_became_active":"2023-11-25T04:08:36.156200+0000","last_became_peered":"2023-11-25T04:08:36.156200+0000","last_unstale":"2023-11-25T04:08:36.165315+0000","last_undegraded":"2023-11-25T04:08:36.165315+0000","last_fullsized":"2023-11-25T04:08:36.165315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:23.464341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164920+0000","last_change":"2023-11-25T04:08:36.154932+0000","last_active":"2023-11-25T04:08:36.164920+0000","last_peered":"2023-11-25T04:08:36.164920+0000","last_clean":"2023-11-25T04:08:36.164920+0000","last_became_active":"2023-11-25T04:08:36.154561+0000","last_became_peered":"2023-11-25T04:08:36.154561+0000","last_unstale":"2023-11-25T04:08:36.164920+0000","last_undegraded":"2023-11-25T04:08:36.164920+0000","last_fullsized":"2023-11-25T04:08:36.164920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.159277+0000","last_change":"2023-11-25T04:08:36.157418+0000","last_active":"2023-11-25T04:08:36.159277+0000","last_peered":"2023-11-25T04:08:36.159277+0000","last_clean":"2023-11-25T04:08:36.159277+0000","last_became_active":"2023-11-25T04:08:36.157130+0000","last_became_peered":"2023-11-25T04:08:36.157130+0000","last_unstale":"2023-11-25T04:08:36.159277+0000","last_undegraded":"2023-11-25T04:08:36.159277+0000","last_fullsized":"2023-11-25T04:08:36.159277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:37.085846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164753+0000","last_change":"2023-11-25T04:08:36.157854+0000","last_active":"2023-11-25T04:08:36.164753+0000","last_peered":"2023-11-25T04:08:36.164753+0000","last_clean":"2023-11-25T04:08:36.164753+0000","last_became_active":"2023-11-25T04:08:36.156836+0000","last_became_peered":"2023-11-25T04:08:36.156836+0000","last_unstale":"2023-11-25T04:08:36.164753+0000","last_undegraded":"2023-11-25T04:08:36.164753+0000","last_fullsized":"2023-11-25T04:08:36.164753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:22.951831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.162328+0000","last_change":"2023-11-25T04:08:36.155924+0000","last_active":"2023-11-25T04:08:36.162328+0000","last_peered":"2023-11-25T04:08:36.162328+0000","last_clean":"2023-11-25T04:08:36.162328+0000","last_became_active":"2023-11-25T04:08:36.155624+0000","last_became_peered":"2023-11-25T04:08:36.155624+0000","last_unstale":"2023-11-25T04:08:36.162328+0000","last_undegraded":"2023-11-25T04:08:36.162328+0000","last_fullsized":"2023-11-25T04:08:36.162328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:10:28.341482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.155622+0000","last_change":"2023-11-25T04:08:36.153091+0000","last_active":"2023-11-25T04:08:36.155622+0000","last_peered":"2023-11-25T04:08:36.155622+0000","last_clean":"2023-11-25T04:08:36.155622+0000","last_became_active":"2023-11-25T04:08:36.152775+0000","last_became_peered":"2023-11-25T04:08:36.152775+0000","last_unstale":"2023-11-25T04:08:36.155622+0000","last_undegraded":"2023-11-25T04:08:36.155622+0000","last_fullsized":"2023-11-25T04:08:36.155622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:25:54.256045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165021+0000","last_change":"2023-11-25T04:08:36.156488+0000","last_active":"2023-11-25T04:08:36.165021+0000","last_peered":"2023-11-25T04:08:36.165021+0000","last_clean":"2023-11-25T04:08:36.165021+0000","last_became_active":"2023-11-25T04:08:36.156156+0000","last_became_peered":"2023-11-25T04:08:36.156156+0000","last_unstale":"2023-11-25T04:08:36.165021+0000","last_undegraded":"2023-11-25T04:08:36.165021+0000","last_fullsized":"2023-11-25T04:08:36.165021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139732+0000","last_change":"2023-11-25T04:08:36.153601+0000","last_active":"2023-11-25T04:08:37.139732+0000","last_peered":"2023-11-25T04:08:37.139732+0000","last_clean":"2023-11-25T04:08:37.139732+0000","last_became_active":"2023-11-25T04:08:36.153299+0000","last_became_peered":"2023-11-25T04:08:36.153299+0000","last_unstale":"2023-11-25T04:08:37.139732+0000","last_undegraded":"2023-11-25T04:08:37.139732+0000","last_fullsized":"2023-11-25T04:08:37.139732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.161837+0000","last_change":"2023-11-25T04:08:36.152977+0000","last_active":"2023-11-25T04:08:36.161837+0000","last_peered":"2023-11-25T04:08:36.161837+0000","last_clean":"2023-11-25T04:08:36.161837+0000","last_became_active":"2023-11-25T04:08:36.152565+0000","last_became_peered":"2023-11-25T04:08:36.152565+0000","last_unstale":"2023-11-25T04:08:36.161837+0000","last_undegraded":"2023-11-25T04:08:36.161837+0000","last_fullsized":"2023-11-25T04:08:36.161837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140274+0000","last_change":"2023-11-25T04:08:36.151764+0000","last_active":"2023-11-25T04:08:37.140274+0000","last_peered":"2023-11-25T04:08:37.140274+0000","last_clean":"2023-11-25T04:08:37.140274+0000","last_became_active":"2023-11-25T04:08:36.150463+0000","last_became_peered":"2023-11-25T04:08:36.150463+0000","last_unstale":"2023-11-25T04:08:37.140274+0000","last_undegraded":"2023-11-25T04:08:37.140274+0000","last_fullsized":"2023-11-25T04:08:37.140274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165595+0000","last_change":"2023-11-25T04:08:36.162948+0000","last_active":"2023-11-25T04:08:36.165595+0000","last_peered":"2023-11-25T04:08:36.165595+0000","last_clean":"2023-11-25T04:08:36.165595+0000","last_became_active":"2023-11-25T04:08:36.162672+0000","last_became_peered":"2023-11-25T04:08:36.162672+0000","last_unstale":"2023-11-25T04:08:36.165595+0000","last_undegraded":"2023-11-25T04:08:36.165595+0000","last_fullsized":"2023-11-25T04:08:36.165595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140927+0000","last_change":"2023-11-25T04:08:36.159466+0000","last_active":"2023-11-25T04:08:37.140927+0000","last_peered":"2023-11-25T04:08:37.140927+0000","last_clean":"2023-11-25T04:08:37.140927+0000","last_became_active":"2023-11-25T04:08:36.159177+0000","last_became_peered":"2023-11-25T04:08:36.159177+0000","last_unstale":"2023-11-25T04:08:37.140927+0000","last_undegraded":"2023-11-25T04:08:37.140927+0000","last_fullsized":"2023-11-25T04:08:37.140927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140078+0000","last_change":"2023-11-25T04:08:36.153899+0000","last_active":"2023-11-25T04:08:37.140078+0000","last_peered":"2023-11-25T04:08:37.140078+0000","last_clean":"2023-11-25T04:08:37.140078+0000","last_became_active":"2023-11-25T04:08:36.152798+0000","last_became_peered":"2023-11-25T04:08:36.152798+0000","last_unstale":"2023-11-25T04:08:37.140078+0000","last_undegraded":"2023-11-25T04:08:37.140078+0000","last_fullsized":"2023-11-25T04:08:37.140078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.149250+0000","last_change":"2023-11-25T04:08:36.145773+0000","last_active":"2023-11-25T04:08:36.149250+0000","last_peered":"2023-11-25T04:08:36.149250+0000","last_clean":"2023-11-25T04:08:36.149250+0000","last_became_active":"2023-11-25T04:08:36.144733+0000","last_became_peered":"2023-11-25T04:08:36.144733+0000","last_unstale":"2023-11-25T04:08:36.149250+0000","last_undegraded":"2023-11-25T04:08:36.149250+0000","last_fullsized":"2023-11-25T04:08:36.149250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164923+0000","last_change":"2023-11-25T04:08:36.154902+0000","last_active":"2023-11-25T04:08:36.164923+0000","last_peered":"2023-11-25T04:08:36.164923+0000","last_clean":"2023-11-25T04:08:36.164923+0000","last_became_active":"2023-11-25T04:08:36.154382+0000","last_became_peered":"2023-11-25T04:08:36.154382+0000","last_unstale":"2023-11-25T04:08:36.164923+0000","last_undegraded":"2023-11-25T04:08:36.164923+0000","last_fullsized":"2023-11-25T04:08:36.164923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:39.596607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.159573+0000","last_change":"2023-11-25T04:08:36.157895+0000","last_active":"2023-11-25T04:08:36.159573+0000","last_peered":"2023-11-25T04:08:36.159573+0000","last_clean":"2023-11-25T04:08:36.159573+0000","last_became_active":"2023-11-25T04:08:36.157530+0000","last_became_peered":"2023-11-25T04:08:36.157530+0000","last_unstale":"2023-11-25T04:08:36.159573+0000","last_undegraded":"2023-11-25T04:08:36.159573+0000","last_fullsized":"2023-11-25T04:08:36.159573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:10:28.341482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165033+0000","last_change":"2023-11-25T04:08:36.158558+0000","last_active":"2023-11-25T04:08:36.165033+0000","last_peered":"2023-11-25T04:08:36.165033+0000","last_clean":"2023-11-25T04:08:36.165033+0000","last_became_active":"2023-11-25T04:08:36.158280+0000","last_became_peered":"2023-11-25T04:08:36.158280+0000","last_unstale":"2023-11-25T04:08:36.165033+0000","last_undegraded":"2023-11-25T04:08:36.165033+0000","last_fullsized":"2023-11-25T04:08:36.165033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:57.632433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141133+0000","last_change":"2023-11-25T04:08:36.155419+0000","last_active":"2023-11-25T04:08:37.141133+0000","last_peered":"2023-11-25T04:08:37.141133+0000","last_clean":"2023-11-25T04:08:37.141133+0000","last_became_active":"2023-11-25T04:08:36.155113+0000","last_became_peered":"2023-11-25T04:08:36.155113+0000","last_unstale":"2023-11-25T04:08:37.141133+0000","last_undegraded":"2023-11-25T04:08:37.141133+0000","last_fullsized":"2023-11-25T04:08:37.141133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:06.500587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140200+0000","last_change":"2023-11-25T04:08:35.170018+0000","last_active":"2023-11-25T04:08:37.140200+0000","last_peered":"2023-11-25T04:08:37.140200+0000","last_clean":"2023-11-25T04:08:37.140200+0000","last_became_active":"2023-11-25T04:08:35.169712+0000","last_became_peered":"2023-11-25T04:08:35.169712+0000","last_unstale":"2023-11-25T04:08:37.140200+0000","last_undegraded":"2023-11-25T04:08:37.140200+0000","last_fullsized":"2023-11-25T04:08:37.140200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:21.947721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.152968+0000","last_change":"2023-11-25T04:08:36.149119+0000","last_active":"2023-11-25T04:08:36.152968+0000","last_peered":"2023-11-25T04:08:36.152968+0000","last_clean":"2023-11-25T04:08:36.152968+0000","last_became_active":"2023-11-25T04:08:36.148656+0000","last_became_peered":"2023-11-25T04:08:36.148656+0000","last_unstale":"2023-11-25T04:08:36.152968+0000","last_undegraded":"2023-11-25T04:08:36.152968+0000","last_fullsized":"2023-11-25T04:08:36.152968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:10:28.341482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.179032+0000","last_change":"2023-11-25T04:08:35.169640+0000","last_active":"2023-11-25T04:08:36.179032+0000","last_peered":"2023-11-25T04:08:36.179032+0000","last_clean":"2023-11-25T04:08:36.179032+0000","last_became_active":"2023-11-25T04:08:35.169229+0000","last_became_peered":"2023-11-25T04:08:35.169229+0000","last_unstale":"2023-11-25T04:08:36.179032+0000","last_undegraded":"2023-11-25T04:08:36.179032+0000","last_fullsized":"2023-11-25T04:08:36.179032+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139797+0000","last_change":"2023-11-25T04:08:35.165325+0000","last_active":"2023-11-25T04:08:37.139797+0000","last_peered":"2023-11-25T04:08:37.139797+0000","last_clean":"2023-11-25T04:08:37.139797+0000","last_became_active":"2023-11-25T04:08:35.164962+0000","last_became_peered":"2023-11-25T04:08:35.164962+0000","last_unstale":"2023-11-25T04:08:37.139797+0000","last_undegraded":"2023-11-25T04:08:37.139797+0000","last_fullsized":"2023-11-25T04:08:37.139797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139742+0000","last_change":"2023-11-25T04:08:36.146000+0000","last_active":"2023-11-25T04:08:37.139742+0000","last_peered":"2023-11-25T04:08:37.139742+0000","last_clean":"2023-11-25T04:08:37.139742+0000","last_became_active":"2023-11-25T04:08:36.145662+0000","last_became_peered":"2023-11-25T04:08:36.145662+0000","last_unstale":"2023-11-25T04:08:37.139742+0000","last_undegraded":"2023-11-25T04:08:37.139742+0000","last_fullsized":"2023-11-25T04:08:37.139742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.146420+0000","last_change":"2023-11-25T04:08:35.164501+0000","last_active":"2023-11-25T04:08:36.146420+0000","last_peered":"2023-11-25T04:08:36.146420+0000","last_clean":"2023-11-25T04:08:36.146420+0000","last_became_active":"2023-11-25T04:08:35.164008+0000","last_became_peered":"2023-11-25T04:08:35.164008+0000","last_unstale":"2023-11-25T04:08:36.146420+0000","last_undegraded":"2023-11-25T04:08:36.146420+0000","last_fullsized":"2023-11-25T04:08:36.146420+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:49.360276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140664+0000","last_change":"2023-11-25T04:08:36.157653+0000","last_active":"2023-11-25T04:08:37.140664+0000","last_peered":"2023-11-25T04:08:37.140664+0000","last_clean":"2023-11-25T04:08:37.140664+0000","last_became_active":"2023-11-25T04:08:36.157323+0000","last_became_peered":"2023-11-25T04:08:36.157323+0000","last_unstale":"2023-11-25T04:08:37.140664+0000","last_undegraded":"2023-11-25T04:08:37.140664+0000","last_fullsized":"2023-11-25T04:08:37.140664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.155471+0000","last_change":"2023-11-25T04:08:35.166516+0000","last_active":"2023-11-25T04:08:36.155471+0000","last_peered":"2023-11-25T04:08:36.155471+0000","last_clean":"2023-11-25T04:08:36.155471+0000","last_became_active":"2023-11-25T04:08:35.166204+0000","last_became_peered":"2023-11-25T04:08:35.166204+0000","last_unstale":"2023-11-25T04:08:36.155471+0000","last_undegraded":"2023-11-25T04:08:36.155471+0000","last_fullsized":"2023-11-25T04:08:36.155471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165130+0000","last_change":"2023-11-25T04:08:36.157253+0000","last_active":"2023-11-25T04:08:36.165130+0000","last_peered":"2023-11-25T04:08:36.165130+0000","last_clean":"2023-11-25T04:08:36.165130+0000","last_became_active":"2023-11-25T04:08:36.156799+0000","last_became_peered":"2023-11-25T04:08:36.156799+0000","last_unstale":"2023-11-25T04:08:36.165130+0000","last_undegraded":"2023-11-25T04:08:36.165130+0000","last_fullsized":"2023-11-25T04:08:36.165130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.146666+0000","last_change":"2023-11-25T04:08:35.165700+0000","last_active":"2023-11-25T04:08:36.146666+0000","last_peered":"2023-11-25T04:08:36.146666+0000","last_clean":"2023-11-25T04:08:36.146666+0000","last_became_active":"2023-11-25T04:08:35.165341+0000","last_became_peered":"2023-11-25T04:08:35.165341+0000","last_unstale":"2023-11-25T04:08:36.146666+0000","last_undegraded":"2023-11-25T04:08:36.146666+0000","last_fullsized":"2023-11-25T04:08:36.146666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:58.609810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.159886+0000","last_change":"2023-11-25T04:08:36.158411+0000","last_active":"2023-11-25T04:08:36.159886+0000","last_peered":"2023-11-25T04:08:36.159886+0000","last_clean":"2023-11-25T04:08:36.159886+0000","last_became_active":"2023-11-25T04:08:36.156523+0000","last_became_peered":"2023-11-25T04:08:36.156523+0000","last_unstale":"2023-11-25T04:08:36.159886+0000","last_undegraded":"2023-11-25T04:08:36.159886+0000","last_fullsized":"2023-11-25T04:08:36.159886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:37.085846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140940+0000","last_change":"2023-11-25T04:08:35.167699+0000","last_active":"2023-11-25T04:08:37.140940+0000","last_peered":"2023-11-25T04:08:37.140940+0000","last_clean":"2023-11-25T04:08:37.140940+0000","last_became_active":"2023-11-25T04:08:35.167457+0000","last_became_peered":"2023-11-25T04:08:35.167457+0000","last_unstale":"2023-11-25T04:08:37.140940+0000","last_undegraded":"2023-11-25T04:08:37.140940+0000","last_fullsized":"2023-11-25T04:08:37.140940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:22.460231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141339+0000","last_change":"2023-11-25T04:08:36.149678+0000","last_active":"2023-11-25T04:08:37.141339+0000","last_peered":"2023-11-25T04:08:37.141339+0000","last_clean":"2023-11-25T04:08:37.141339+0000","last_became_active":"2023-11-25T04:08:36.149356+0000","last_became_peered":"2023-11-25T04:08:36.149356+0000","last_unstale":"2023-11-25T04:08:37.141339+0000","last_undegraded":"2023-11-25T04:08:37.141339+0000","last_fullsized":"2023-11-25T04:08:37.141339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.183609+0000","last_change":"2023-11-25T04:08:35.164920+0000","last_active":"2023-11-25T04:08:36.183609+0000","last_peered":"2023-11-25T04:08:36.183609+0000","last_clean":"2023-11-25T04:08:36.183609+0000","last_became_active":"2023-11-25T04:08:35.164319+0000","last_became_peered":"2023-11-25T04:08:35.164319+0000","last_unstale":"2023-11-25T04:08:36.183609+0000","last_undegraded":"2023-11-25T04:08:36.183609+0000","last_fullsized":"2023-11-25T04:08:36.183609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:50.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164813+0000","last_change":"2023-11-25T04:08:36.158479+0000","last_active":"2023-11-25T04:08:36.164813+0000","last_peered":"2023-11-25T04:08:36.164813+0000","last_clean":"2023-11-25T04:08:36.164813+0000","last_became_active":"2023-11-25T04:08:36.158222+0000","last_became_peered":"2023-11-25T04:08:36.158222+0000","last_unstale":"2023-11-25T04:08:36.164813+0000","last_undegraded":"2023-11-25T04:08:36.164813+0000","last_fullsized":"2023-11-25T04:08:36.164813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.179811+0000","last_change":"2023-11-25T04:08:35.175417+0000","last_active":"2023-11-25T04:08:36.179811+0000","last_peered":"2023-11-25T04:08:36.179811+0000","last_clean":"2023-11-25T04:08:36.179811+0000","last_became_active":"2023-11-25T04:08:35.175050+0000","last_became_peered":"2023-11-25T04:08:35.175050+0000","last_unstale":"2023-11-25T04:08:36.179811+0000","last_undegraded":"2023-11-25T04:08:36.179811+0000","last_fullsized":"2023-11-25T04:08:36.179811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.157608+0000","last_change":"2023-11-25T04:08:36.155250+0000","last_active":"2023-11-25T04:08:36.157608+0000","last_peered":"2023-11-25T04:08:36.157608+0000","last_clean":"2023-11-25T04:08:36.157608+0000","last_became_active":"2023-11-25T04:08:36.154944+0000","last_became_peered":"2023-11-25T04:08:36.154944+0000","last_unstale":"2023-11-25T04:08:36.157608+0000","last_undegraded":"2023-11-25T04:08:36.157608+0000","last_fullsized":"2023-11-25T04:08:36.157608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:12:45.073515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.147402+0000","last_change":"2023-11-25T04:08:35.162897+0000","last_active":"2023-11-25T04:08:36.147402+0000","last_peered":"2023-11-25T04:08:36.147402+0000","last_clean":"2023-11-25T04:08:36.147402+0000","last_became_active":"2023-11-25T04:08:35.162684+0000","last_became_peered":"2023-11-25T04:08:35.162684+0000","last_unstale":"2023-11-25T04:08:36.147402+0000","last_undegraded":"2023-11-25T04:08:36.147402+0000","last_fullsized":"2023-11-25T04:08:36.147402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:07.785129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.157195+0000","last_change":"2023-11-25T04:08:36.153204+0000","last_active":"2023-11-25T04:08:36.157195+0000","last_peered":"2023-11-25T04:08:36.157195+0000","last_clean":"2023-11-25T04:08:36.157195+0000","last_became_active":"2023-11-25T04:08:36.152856+0000","last_became_peered":"2023-11-25T04:08:36.152856+0000","last_unstale":"2023-11-25T04:08:36.157195+0000","last_undegraded":"2023-11-25T04:08:36.157195+0000","last_fullsized":"2023-11-25T04:08:36.157195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:39.596607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.149565+0000","last_change":"2023-11-25T04:08:35.170232+0000","last_active":"2023-11-25T04:08:36.149565+0000","last_peered":"2023-11-25T04:08:36.149565+0000","last_clean":"2023-11-25T04:08:36.149565+0000","last_became_active":"2023-11-25T04:08:35.168959+0000","last_became_peered":"2023-11-25T04:08:35.168959+0000","last_unstale":"2023-11-25T04:08:36.149565+0000","last_undegraded":"2023-11-25T04:08:36.149565+0000","last_fullsized":"2023-11-25T04:08:36.149565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:25.799051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165087+0000","last_change":"2023-11-25T04:08:36.159133+0000","last_active":"2023-11-25T04:08:36.165087+0000","last_peered":"2023-11-25T04:08:36.165087+0000","last_clean":"2023-11-25T04:08:36.165087+0000","last_became_active":"2023-11-25T04:08:36.158832+0000","last_became_peered":"2023-11-25T04:08:36.158832+0000","last_unstale":"2023-11-25T04:08:36.165087+0000","last_undegraded":"2023-11-25T04:08:36.165087+0000","last_fullsized":"2023-11-25T04:08:36.165087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:37.085846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.180709+0000","last_change":"2023-11-25T04:08:35.158168+0000","last_active":"2023-11-25T04:08:36.180709+0000","last_peered":"2023-11-25T04:08:36.180709+0000","last_clean":"2023-11-25T04:08:36.180709+0000","last_became_active":"2023-11-25T04:08:35.157857+0000","last_became_peered":"2023-11-25T04:08:35.157857+0000","last_unstale":"2023-11-25T04:08:36.180709+0000","last_undegraded":"2023-11-25T04:08:36.180709+0000","last_fullsized":"2023-11-25T04:08:36.180709+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:16.648041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.157076+0000","last_change":"2023-11-25T04:08:36.153946+0000","last_active":"2023-11-25T04:08:36.157076+0000","last_peered":"2023-11-25T04:08:36.157076+0000","last_clean":"2023-11-25T04:08:36.157076+0000","last_became_active":"2023-11-25T04:08:36.153643+0000","last_became_peered":"2023-11-25T04:08:36.153643+0000","last_unstale":"2023-11-25T04:08:36.157076+0000","last_undegraded":"2023-11-25T04:08:36.157076+0000","last_fullsized":"2023-11-25T04:08:36.157076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141439+0000","last_change":"2023-11-25T04:08:35.168907+0000","last_active":"2023-11-25T04:08:37.141439+0000","last_peered":"2023-11-25T04:08:37.141439+0000","last_clean":"2023-11-25T04:08:37.141439+0000","last_became_active":"2023-11-25T04:08:35.168515+0000","last_became_peered":"2023-11-25T04:08:35.168515+0000","last_unstale":"2023-11-25T04:08:37.141439+0000","last_undegraded":"2023-11-25T04:08:37.141439+0000","last_fullsized":"2023-11-25T04:08:37.141439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:16.648041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164853+0000","last_change":"2023-11-25T04:08:36.159282+0000","last_active":"2023-11-25T04:08:36.164853+0000","last_peered":"2023-11-25T04:08:36.164853+0000","last_clean":"2023-11-25T04:08:36.164853+0000","last_became_active":"2023-11-25T04:08:36.159008+0000","last_became_peered":"2023-11-25T04:08:36.159008+0000","last_unstale":"2023-11-25T04:08:36.164853+0000","last_undegraded":"2023-11-25T04:08:36.164853+0000","last_fullsized":"2023-11-25T04:08:36.164853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.180047+0000","last_change":"2023-11-25T04:08:35.161420+0000","last_active":"2023-11-25T04:08:36.180047+0000","last_peered":"2023-11-25T04:08:36.180047+0000","last_clean":"2023-11-25T04:08:36.180047+0000","last_became_active":"2023-11-25T04:08:35.161085+0000","last_became_peered":"2023-11-25T04:08:35.161085+0000","last_unstale":"2023-11-25T04:08:36.180047+0000","last_undegraded":"2023-11-25T04:08:36.180047+0000","last_fullsized":"2023-11-25T04:08:36.180047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:37.314044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.164914+0000","last_change":"2023-11-25T04:08:36.160108+0000","last_active":"2023-11-25T04:08:36.164914+0000","last_peered":"2023-11-25T04:08:36.164914+0000","last_clean":"2023-11-25T04:08:36.164914+0000","last_became_active":"2023-11-25T04:08:36.159833+0000","last_became_peered":"2023-11-25T04:08:36.159833+0000","last_unstale":"2023-11-25T04:08:36.164914+0000","last_undegraded":"2023-11-25T04:08:36.164914+0000","last_fullsized":"2023-11-25T04:08:36.164914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141018+0000","last_change":"2023-11-25T04:08:35.166785+0000","last_active":"2023-11-25T04:08:37.141018+0000","last_peered":"2023-11-25T04:08:37.141018+0000","last_clean":"2023-11-25T04:08:37.141018+0000","last_became_active":"2023-11-25T04:08:35.166502+0000","last_became_peered":"2023-11-25T04:08:35.166502+0000","last_unstale":"2023-11-25T04:08:37.141018+0000","last_undegraded":"2023-11-25T04:08:37.141018+0000","last_fullsized":"2023-11-25T04:08:37.141018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:57.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.162126+0000","last_change":"2023-11-25T04:08:36.154284+0000","last_active":"2023-11-25T04:08:36.162126+0000","last_peered":"2023-11-25T04:08:36.162126+0000","last_clean":"2023-11-25T04:08:36.162126+0000","last_became_active":"2023-11-25T04:08:36.152651+0000","last_became_peered":"2023-11-25T04:08:36.152651+0000","last_unstale":"2023-11-25T04:08:36.162126+0000","last_undegraded":"2023-11-25T04:08:36.162126+0000","last_fullsized":"2023-11-25T04:08:36.162126+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:06.500587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.146662+0000","last_change":"2023-11-25T04:08:35.164026+0000","last_active":"2023-11-25T04:08:36.146662+0000","last_peered":"2023-11-25T04:08:36.146662+0000","last_clean":"2023-11-25T04:08:36.146662+0000","last_became_active":"2023-11-25T04:08:35.163726+0000","last_became_peered":"2023-11-25T04:08:35.163726+0000","last_unstale":"2023-11-25T04:08:36.146662+0000","last_undegraded":"2023-11-25T04:08:36.146662+0000","last_fullsized":"2023-11-25T04:08:36.146662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:25.799051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165635+0000","last_change":"2023-11-25T04:08:36.162872+0000","last_active":"2023-11-25T04:08:36.165635+0000","last_peered":"2023-11-25T04:08:36.165635+0000","last_clean":"2023-11-25T04:08:36.165635+0000","last_became_active":"2023-11-25T04:08:36.162603+0000","last_became_peered":"2023-11-25T04:08:36.162603+0000","last_unstale":"2023-11-25T04:08:36.165635+0000","last_undegraded":"2023-11-25T04:08:36.165635+0000","last_fullsized":"2023-11-25T04:08:36.165635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-25T04:08:35.159998+0000","last_change":"2023-11-25T04:08:24.570240+0000","last_active":"2023-11-25T04:08:35.159998+0000","last_peered":"2023-11-25T04:08:35.159998+0000","last_clean":"2023-11-25T04:08:35.159998+0000","last_became_active":"2023-11-25T04:08:24.569371+0000","last_became_peered":"2023-11-25T04:08:24.569371+0000","last_unstale":"2023-11-25T04:08:35.159998+0000","last_undegraded":"2023-11-25T04:08:35.159998+0000","last_fullsized":"2023-11-25T04:08:35.159998+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_clean_scrub_stamp":"2023-11-25T04:08:23.534401+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:28.293127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.142539+0000","last_change":"2023-11-25T04:08:35.151872+0000","last_active":"2023-11-25T04:08:36.142539+0000","last_peered":"2023-11-25T04:08:36.142539+0000","last_clean":"2023-11-25T04:08:36.142539+0000","last_became_active":"2023-11-25T04:08:35.151557+0000","last_became_peered":"2023-11-25T04:08:35.151557+0000","last_unstale":"2023-11-25T04:08:36.142539+0000","last_undegraded":"2023-11-25T04:08:36.142539+0000","last_fullsized":"2023-11-25T04:08:36.142539+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139961+0000","last_change":"2023-11-25T04:08:36.159174+0000","last_active":"2023-11-25T04:08:37.139961+0000","last_peered":"2023-11-25T04:08:37.139961+0000","last_clean":"2023-11-25T04:08:37.139961+0000","last_became_active":"2023-11-25T04:08:36.158893+0000","last_became_peered":"2023-11-25T04:08:36.158893+0000","last_unstale":"2023-11-25T04:08:37.139961+0000","last_undegraded":"2023-11-25T04:08:37.139961+0000","last_fullsized":"2023-11-25T04:08:37.139961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.145150+0000","last_change":"2023-11-25T04:08:35.166896+0000","last_active":"2023-11-25T04:08:36.145150+0000","last_peered":"2023-11-25T04:08:36.145150+0000","last_clean":"2023-11-25T04:08:36.145150+0000","last_became_active":"2023-11-25T04:08:35.166601+0000","last_became_peered":"2023-11-25T04:08:35.166601+0000","last_unstale":"2023-11-25T04:08:36.145150+0000","last_undegraded":"2023-11-25T04:08:36.145150+0000","last_fullsized":"2023-11-25T04:08:36.145150+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:05.496477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.149196+0000","last_change":"2023-11-25T04:08:36.147229+0000","last_active":"2023-11-25T04:08:36.149196+0000","last_peered":"2023-11-25T04:08:36.149196+0000","last_clean":"2023-11-25T04:08:36.149196+0000","last_became_active":"2023-11-25T04:08:36.146889+0000","last_became_peered":"2023-11-25T04:08:36.146889+0000","last_unstale":"2023-11-25T04:08:36.149196+0000","last_undegraded":"2023-11-25T04:08:36.149196+0000","last_fullsized":"2023-11-25T04:08:36.149196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:00:37.946585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.148098+0000","last_change":"2023-11-25T04:08:35.162405+0000","last_active":"2023-11-25T04:08:36.148098+0000","last_peered":"2023-11-25T04:08:36.148098+0000","last_clean":"2023-11-25T04:08:36.148098+0000","last_became_active":"2023-11-25T04:08:35.162084+0000","last_became_peered":"2023-11-25T04:08:35.162084+0000","last_unstale":"2023-11-25T04:08:36.148098+0000","last_undegraded":"2023-11-25T04:08:36.148098+0000","last_fullsized":"2023-11-25T04:08:36.148098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140649+0000","last_change":"2023-11-25T04:08:36.152006+0000","last_active":"2023-11-25T04:08:37.140649+0000","last_peered":"2023-11-25T04:08:37.140649+0000","last_clean":"2023-11-25T04:08:37.140649+0000","last_became_active":"2023-11-25T04:08:36.151655+0000","last_became_peered":"2023-11-25T04:08:36.151655+0000","last_unstale":"2023-11-25T04:08:37.140649+0000","last_undegraded":"2023-11-25T04:08:37.140649+0000","last_fullsized":"2023-11-25T04:08:37.140649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.147549+0000","last_change":"2023-11-25T04:08:35.162315+0000","last_active":"2023-11-25T04:08:36.147549+0000","last_peered":"2023-11-25T04:08:36.147549+0000","last_clean":"2023-11-25T04:08:36.147549+0000","last_became_active":"2023-11-25T04:08:35.162052+0000","last_became_peered":"2023-11-25T04:08:35.162052+0000","last_unstale":"2023-11-25T04:08:36.147549+0000","last_undegraded":"2023-11-25T04:08:36.147549+0000","last_fullsized":"2023-11-25T04:08:36.147549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:53.354503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141360+0000","last_change":"2023-11-25T04:08:36.158785+0000","last_active":"2023-11-25T04:08:37.141360+0000","last_peered":"2023-11-25T04:08:37.141360+0000","last_clean":"2023-11-25T04:08:37.141360+0000","last_became_active":"2023-11-25T04:08:36.155440+0000","last_became_peered":"2023-11-25T04:08:36.155440+0000","last_unstale":"2023-11-25T04:08:37.141360+0000","last_undegraded":"2023-11-25T04:08:37.141360+0000","last_fullsized":"2023-11-25T04:08:37.141360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:03.560567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140844+0000","last_change":"2023-11-25T04:08:35.168321+0000","last_active":"2023-11-25T04:08:37.140844+0000","last_peered":"2023-11-25T04:08:37.140844+0000","last_clean":"2023-11-25T04:08:37.140844+0000","last_became_active":"2023-11-25T04:08:35.168047+0000","last_became_peered":"2023-11-25T04:08:35.168047+0000","last_unstale":"2023-11-25T04:08:37.140844+0000","last_undegraded":"2023-11-25T04:08:37.140844+0000","last_fullsized":"2023-11-25T04:08:37.140844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:49.360276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165726+0000","last_change":"2023-11-25T04:08:36.157577+0000","last_active":"2023-11-25T04:08:36.165726+0000","last_peered":"2023-11-25T04:08:36.165726+0000","last_clean":"2023-11-25T04:08:36.165726+0000","last_became_active":"2023-11-25T04:08:36.157302+0000","last_became_peered":"2023-11-25T04:08:36.157302+0000","last_unstale":"2023-11-25T04:08:36.165726+0000","last_undegraded":"2023-11-25T04:08:36.165726+0000","last_fullsized":"2023-11-25T04:08:36.165726+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.146524+0000","last_change":"2023-11-25T04:08:35.171642+0000","last_active":"2023-11-25T04:08:36.146524+0000","last_peered":"2023-11-25T04:08:36.146524+0000","last_clean":"2023-11-25T04:08:36.146524+0000","last_became_active":"2023-11-25T04:08:35.171169+0000","last_became_peered":"2023-11-25T04:08:35.171169+0000","last_unstale":"2023-11-25T04:08:36.146524+0000","last_undegraded":"2023-11-25T04:08:36.146524+0000","last_fullsized":"2023-11-25T04:08:36.146524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:57.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140868+0000","last_change":"2023-11-25T04:08:36.155558+0000","last_active":"2023-11-25T04:08:37.140868+0000","last_peered":"2023-11-25T04:08:37.140868+0000","last_clean":"2023-11-25T04:08:37.140868+0000","last_became_active":"2023-11-25T04:08:36.155280+0000","last_became_peered":"2023-11-25T04:08:36.155280+0000","last_unstale":"2023-11-25T04:08:37.140868+0000","last_undegraded":"2023-11-25T04:08:37.140868+0000","last_fullsized":"2023-11-25T04:08:37.140868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140977+0000","last_change":"2023-11-25T04:08:35.164983+0000","last_active":"2023-11-25T04:08:37.140977+0000","last_peered":"2023-11-25T04:08:37.140977+0000","last_clean":"2023-11-25T04:08:37.140977+0000","last_became_active":"2023-11-25T04:08:35.164714+0000","last_became_peered":"2023-11-25T04:08:35.164714+0000","last_unstale":"2023-11-25T04:08:37.140977+0000","last_undegraded":"2023-11-25T04:08:37.140977+0000","last_fullsized":"2023-11-25T04:08:37.140977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:58.609810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140402+0000","last_change":"2023-11-25T04:08:36.155740+0000","last_active":"2023-11-25T04:08:37.140402+0000","last_peered":"2023-11-25T04:08:37.140402+0000","last_clean":"2023-11-25T04:08:37.140402+0000","last_became_active":"2023-11-25T04:08:36.155416+0000","last_became_peered":"2023-11-25T04:08:36.155416+0000","last_unstale":"2023-11-25T04:08:37.140402+0000","last_undegraded":"2023-11-25T04:08:37.140402+0000","last_fullsized":"2023-11-25T04:08:37.140402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:34:53.382347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.181726+0000","last_change":"2023-11-25T04:08:35.164671+0000","last_active":"2023-11-25T04:08:36.181726+0000","last_peered":"2023-11-25T04:08:36.181726+0000","last_clean":"2023-11-25T04:08:36.181726+0000","last_became_active":"2023-11-25T04:08:35.164303+0000","last_became_peered":"2023-11-25T04:08:35.164303+0000","last_unstale":"2023-11-25T04:08:36.181726+0000","last_undegraded":"2023-11-25T04:08:36.181726+0000","last_fullsized":"2023-11-25T04:08:36.181726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:21.947721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.155912+0000","last_change":"2023-11-25T04:08:36.152277+0000","last_active":"2023-11-25T04:08:36.155912+0000","last_peered":"2023-11-25T04:08:36.155912+0000","last_clean":"2023-11-25T04:08:36.155912+0000","last_became_active":"2023-11-25T04:08:36.151952+0000","last_became_peered":"2023-11-25T04:08:36.151952+0000","last_unstale":"2023-11-25T04:08:36.155912+0000","last_undegraded":"2023-11-25T04:08:36.155912+0000","last_fullsized":"2023-11-25T04:08:36.155912+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.145013+0000","last_change":"2023-11-25T04:08:35.169634+0000","last_active":"2023-11-25T04:08:36.145013+0000","last_peered":"2023-11-25T04:08:36.145013+0000","last_clean":"2023-11-25T04:08:36.145013+0000","last_became_active":"2023-11-25T04:08:35.169006+0000","last_became_peered":"2023-11-25T04:08:35.169006+0000","last_unstale":"2023-11-25T04:08:36.145013+0000","last_undegraded":"2023-11-25T04:08:36.145013+0000","last_fullsized":"2023-11-25T04:08:36.145013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:37.314044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141007+0000","last_change":"2023-11-25T04:08:36.152671+0000","last_active":"2023-11-25T04:08:37.141007+0000","last_peered":"2023-11-25T04:08:37.141007+0000","last_clean":"2023-11-25T04:08:37.141007+0000","last_became_active":"2023-11-25T04:08:36.152379+0000","last_became_peered":"2023-11-25T04:08:36.152379+0000","last_unstale":"2023-11-25T04:08:37.141007+0000","last_undegraded":"2023-11-25T04:08:37.141007+0000","last_fullsized":"2023-11-25T04:08:37.141007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140747+0000","last_change":"2023-11-25T04:08:35.164407+0000","last_active":"2023-11-25T04:08:37.140747+0000","last_peered":"2023-11-25T04:08:37.140747+0000","last_clean":"2023-11-25T04:08:37.140747+0000","last_became_active":"2023-11-25T04:08:35.164096+0000","last_became_peered":"2023-11-25T04:08:35.164096+0000","last_unstale":"2023-11-25T04:08:37.140747+0000","last_undegraded":"2023-11-25T04:08:37.140747+0000","last_fullsized":"2023-11-25T04:08:37.140747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140279+0000","last_change":"2023-11-25T04:08:36.155323+0000","last_active":"2023-11-25T04:08:37.140279+0000","last_peered":"2023-11-25T04:08:37.140279+0000","last_clean":"2023-11-25T04:08:37.140279+0000","last_became_active":"2023-11-25T04:08:36.154026+0000","last_became_peered":"2023-11-25T04:08:36.154026+0000","last_unstale":"2023-11-25T04:08:37.140279+0000","last_undegraded":"2023-11-25T04:08:37.140279+0000","last_fullsized":"2023-11-25T04:08:37.140279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:50.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140840+0000","last_change":"2023-11-25T04:08:35.161694+0000","last_active":"2023-11-25T04:08:37.140840+0000","last_peered":"2023-11-25T04:08:37.140840+0000","last_clean":"2023-11-25T04:08:37.140840+0000","last_became_active":"2023-11-25T04:08:35.161392+0000","last_became_peered":"2023-11-25T04:08:35.161392+0000","last_unstale":"2023-11-25T04:08:37.140840+0000","last_undegraded":"2023-11-25T04:08:37.140840+0000","last_fullsized":"2023-11-25T04:08:37.140840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140137+0000","last_change":"2023-11-25T04:08:36.147757+0000","last_active":"2023-11-25T04:08:37.140137+0000","last_peered":"2023-11-25T04:08:37.140137+0000","last_clean":"2023-11-25T04:08:37.140137+0000","last_became_active":"2023-11-25T04:08:36.147483+0000","last_became_peered":"2023-11-25T04:08:36.147483+0000","last_unstale":"2023-11-25T04:08:37.140137+0000","last_undegraded":"2023-11-25T04:08:37.140137+0000","last_fullsized":"2023-11-25T04:08:37.140137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.179309+0000","last_change":"2023-11-25T04:08:35.170314+0000","last_active":"2023-11-25T04:08:36.179309+0000","last_peered":"2023-11-25T04:08:36.179309+0000","last_clean":"2023-11-25T04:08:36.179309+0000","last_became_active":"2023-11-25T04:08:35.170029+0000","last_became_peered":"2023-11-25T04:08:35.170029+0000","last_unstale":"2023-11-25T04:08:36.179309+0000","last_undegraded":"2023-11-25T04:08:36.179309+0000","last_fullsized":"2023-11-25T04:08:36.179309+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:22.460231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165204+0000","last_change":"2023-11-25T04:08:36.161075+0000","last_active":"2023-11-25T04:08:36.165204+0000","last_peered":"2023-11-25T04:08:36.165204+0000","last_clean":"2023-11-25T04:08:36.165204+0000","last_became_active":"2023-11-25T04:08:36.160734+0000","last_became_peered":"2023-11-25T04:08:36.160734+0000","last_unstale":"2023-11-25T04:08:36.165204+0000","last_undegraded":"2023-11-25T04:08:36.165204+0000","last_fullsized":"2023-11-25T04:08:36.165204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.165823+0000","last_change":"2023-11-25T04:08:36.160701+0000","last_active":"2023-11-25T04:08:36.165823+0000","last_peered":"2023-11-25T04:08:36.165823+0000","last_clean":"2023-11-25T04:08:36.165823+0000","last_became_active":"2023-11-25T04:08:36.160423+0000","last_became_peered":"2023-11-25T04:08:36.160423+0000","last_unstale":"2023-11-25T04:08:36.165823+0000","last_undegraded":"2023-11-25T04:08:36.165823+0000","last_fullsized":"2023-11-25T04:08:36.165823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:22.951831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.182023+0000","last_change":"2023-11-25T04:08:35.170930+0000","last_active":"2023-11-25T04:08:36.182023+0000","last_peered":"2023-11-25T04:08:36.182023+0000","last_clean":"2023-11-25T04:08:36.182023+0000","last_became_active":"2023-11-25T04:08:35.170627+0000","last_became_peered":"2023-11-25T04:08:35.170627+0000","last_unstale":"2023-11-25T04:08:36.182023+0000","last_undegraded":"2023-11-25T04:08:36.182023+0000","last_fullsized":"2023-11-25T04:08:36.182023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:50.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.154518+0000","last_change":"2023-11-25T04:08:36.151765+0000","last_active":"2023-11-25T04:08:36.154518+0000","last_peered":"2023-11-25T04:08:36.154518+0000","last_clean":"2023-11-25T04:08:36.154518+0000","last_became_active":"2023-11-25T04:08:36.151464+0000","last_became_peered":"2023-11-25T04:08:36.151464+0000","last_unstale":"2023-11-25T04:08:36.154518+0000","last_undegraded":"2023-11-25T04:08:36.154518+0000","last_fullsized":"2023-11-25T04:08:36.154518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:03.560567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.182338+0000","last_change":"2023-11-25T04:08:35.170080+0000","last_active":"2023-11-25T04:08:36.182338+0000","last_peered":"2023-11-25T04:08:36.182338+0000","last_clean":"2023-11-25T04:08:36.182338+0000","last_became_active":"2023-11-25T04:08:35.169782+0000","last_became_peered":"2023-11-25T04:08:35.169782+0000","last_unstale":"2023-11-25T04:08:36.182338+0000","last_undegraded":"2023-11-25T04:08:36.182338+0000","last_fullsized":"2023-11-25T04:08:36.182338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.159865+0000","last_change":"2023-11-25T04:08:36.158134+0000","last_active":"2023-11-25T04:08:36.159865+0000","last_peered":"2023-11-25T04:08:36.159865+0000","last_clean":"2023-11-25T04:08:36.159865+0000","last_became_active":"2023-11-25T04:08:36.157273+0000","last_became_peered":"2023-11-25T04:08:36.157273+0000","last_unstale":"2023-11-25T04:08:36.159865+0000","last_undegraded":"2023-11-25T04:08:36.159865+0000","last_fullsized":"2023-11-25T04:08:36.159865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:17.652150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140288+0000","last_change":"2023-11-25T04:08:35.168130+0000","last_active":"2023-11-25T04:08:37.140288+0000","last_peered":"2023-11-25T04:08:37.140288+0000","last_clean":"2023-11-25T04:08:37.140288+0000","last_became_active":"2023-11-25T04:08:35.167876+0000","last_became_peered":"2023-11-25T04:08:35.167876+0000","last_unstale":"2023-11-25T04:08:37.140288+0000","last_undegraded":"2023-11-25T04:08:37.140288+0000","last_fullsized":"2023-11-25T04:08:37.140288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140071+0000","last_change":"2023-11-25T04:08:36.157577+0000","last_active":"2023-11-25T04:08:37.140071+0000","last_peered":"2023-11-25T04:08:37.140071+0000","last_clean":"2023-11-25T04:08:37.140071+0000","last_became_active":"2023-11-25T04:08:36.157233+0000","last_became_peered":"2023-11-25T04:08:36.157233+0000","last_unstale":"2023-11-25T04:08:37.140071+0000","last_undegraded":"2023-11-25T04:08:37.140071+0000","last_fullsized":"2023-11-25T04:08:37.140071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.182242+0000","last_change":"2023-11-25T04:08:35.170151+0000","last_active":"2023-11-25T04:08:36.182242+0000","last_peered":"2023-11-25T04:08:36.182242+0000","last_clean":"2023-11-25T04:08:36.182242+0000","last_became_active":"2023-11-25T04:08:35.169808+0000","last_became_peered":"2023-11-25T04:08:35.169808+0000","last_unstale":"2023-11-25T04:08:36.182242+0000","last_undegraded":"2023-11-25T04:08:36.182242+0000","last_fullsized":"2023-11-25T04:08:36.182242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:05.496477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":798720,"data_stored":655616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-25T04:08:40.532 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-25T04:08:40.532 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-25T04:08:40.532 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-25T04:08:40.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-25T04:08:40.533 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-25T04:08:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.673+0000 7fce0bbec640 1 Processor -- start 2023-11-25T04:08:40.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.673+0000 7fce0bbec640 1 -- start start 2023-11-25T04:08:40.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce0bbec640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce040d0ab0 0x7fce040cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce0bbec640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 0x7fce040cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce0bbec640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0406f9d0 con 0x7fce040cce70 2023-11-25T04:08:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce0bbec640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce0406bfa0 con 0x7fce040d0ab0 2023-11-25T04:08:40.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce0bbec640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0406c190 con 0x7fce040d1c50 2023-11-25T04:08:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce09187640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce040d0ab0 0x7fce040cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce09187640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fce040d0ab0 0x7fce040cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53032/0 (socket says 172.21.15.2:53032) 2023-11-25T04:08:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce09187640 1 -- 172.21.15.2:0/70800832 learned_addr learned my addr 172.21.15.2:0/70800832 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:40.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce0a189640 1 --2- 172.21.15.2:0/70800832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 0x7fce040cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce09187640 1 -- 172.21.15.2:0/70800832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 msgr2=0x7fce040cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce09187640 1 --2- 172.21.15.2:0/70800832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 0x7fce040cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce09187640 1 -- 172.21.15.2:0/70800832 >> v1:172.21.15.66:6789/0 conn(0x7fce040cce70 legacy=0x7fce04099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.674+0000 7fce09187640 1 -- 172.21.15.2:0/70800832 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0406c470 con 0x7fce040d0ab0 2023-11-25T04:08:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.675+0000 7fce09187640 1 --2- 172.21.15.2:0/70800832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 0x7fce040cf390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009870 tx=0x7fcdf402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5db94140e426539 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:40.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.675+0000 7fce08986640 1 -- 172.21.15.2:0/70800832 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4030840 con 0x7fce040d0ab0 2023-11-25T04:08:40.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.675+0000 7fce08986640 1 -- 172.21.15.2:0/70800832 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf40309a0 con 0x7fce040d0ab0 2023-11-25T04:08:40.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.675+0000 7fce08986640 1 -- 172.21.15.2:0/70800832 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4030d30 con 0x7fce040d0ab0 2023-11-25T04:08:40.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.676+0000 7fce0bbec640 1 -- 172.21.15.2:0/70800832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 msgr2=0x7fce040cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.676+0000 7fce0bbec640 1 --2- 172.21.15.2:0/70800832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 0x7fce040cf390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009870 tx=0x7fcdf402b980 comp rx=0 tx=0).stop 2023-11-25T04:08:40.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.676+0000 7fce0bbec640 1 -- 172.21.15.2:0/70800832 shutdown_connections 2023-11-25T04:08:40.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.676+0000 7fce0bbec640 1 --2- 172.21.15.2:0/70800832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 0x7fce040cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.676+0000 7fce0bbec640 1 --2- 172.21.15.2:0/70800832 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 0x7fce040cf390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.676+0000 7fce0bbec640 1 -- 172.21.15.2:0/70800832 >> 172.21.15.2:0/70800832 conn(0x7fce040d0f20 msgr2=0x7fce040d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.676+0000 7fce0bbec640 1 -- 172.21.15.2:0/70800832 shutdown_connections 2023-11-25T04:08:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.676+0000 7fce0bbec640 1 -- 172.21.15.2:0/70800832 wait complete. 2023-11-25T04:08:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.677+0000 7fce0bbec640 1 Processor -- start 2023-11-25T04:08:40.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.677+0000 7fce0bbec640 1 -- start start 2023-11-25T04:08:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce0bbec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce040cce70 0x7fce041f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce0bbec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 0x7fce040b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce0bbec640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 0x7fce0415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce0bbec640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0415ef80 con 0x7fce040d0ab0 2023-11-25T04:08:40.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce0bbec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0415e110 con 0x7fce040cce70 2023-11-25T04:08:40.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce0bbec640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce040b3b40 con 0x7fce040d1c50 2023-11-25T04:08:40.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09187640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 0x7fce040b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09187640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 0x7fce040b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53046/0 (socket says 172.21.15.2:53046) 2023-11-25T04:08:40.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09187640 1 -- 172.21.15.2:0/1544966521 learned_addr learned my addr 172.21.15.2:0/1544966521 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:40.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce0a189640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 0x7fce0415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09988640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce040cce70 0x7fce041f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09187640 1 -- 172.21.15.2:0/1544966521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 msgr2=0x7fce0415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09187640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 0x7fce0415dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09187640 1 -- 172.21.15.2:0/1544966521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce040cce70 msgr2=0x7fce041f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09187640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce040cce70 0x7fce041f6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09187640 1 -- 172.21.15.2:0/1544966521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf40094d0 con 0x7fce040d0ab0 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce0a189640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 0x7fce0415dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce09187640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 0x7fce040b6690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4000c00 tx=0x7fcdf4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fcdfa7fc640 1 -- 172.21.15.2:0/1544966521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4039c90 con 0x7fce040d0ab0 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fcdfa7fc640 1 -- 172.21.15.2:0/1544966521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf4039df0 con 0x7fce040d0ab0 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0415e370 con 0x7fce040d0ab0 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.678+0000 7fcdfa7fc640 1 -- 172.21.15.2:0/1544966521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4043640 con 0x7fce040d0ab0 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.679+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce0415e930 con 0x7fce040d0ab0 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.679+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0415f160 con 0x7fce040d0ab0 2023-11-25T04:08:40.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.680+0000 7fcdfa7fc640 1 -- 172.21.15.2:0/1544966521 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcdf40437a0 con 0x7fce040d0ab0 2023-11-25T04:08:40.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.680+0000 7fcdfa7fc640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcde806ae70 0x7fcde806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:40.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.680+0000 7fcdfa7fc640 1 -- 172.21.15.2:0/1544966521 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdf403e070 con 0x7fce040d0ab0 2023-11-25T04:08:40.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.680+0000 7fce09988640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcde806ae70 0x7fcde806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:40.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.681+0000 7fce09988640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcde806ae70 0x7fcde806d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce040c7190 tx=0x7fce00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:40.696 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.685+0000 7fcdfa7fc640 1 -- 172.21.15.2:0/1544966521 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce0415f160 con 0x7fce040d0ab0 2023-11-25T04:08:40.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.906+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fce0415f160 con 0x7fce040d0ab0 2023-11-25T04:08:40.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.909+0000 7fcdfa7fc640 1 -- 172.21.15.2:0/1544966521 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171020 (secure 0 0 0) 0x7fce0415f160 con 0x7fce040d0ab0 2023-11-25T04:08:40.913 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcde806ae70 msgr2=0x7fcde806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcde806ae70 0x7fcde806d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fce040c7190 tx=0x7fce00009040 comp rx=0 tx=0).stop 2023-11-25T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 msgr2=0x7fce040b6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 0x7fce040b6690 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4000c00 tx=0x7fcdf4004730 comp rx=0 tx=0).stop 2023-11-25T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 shutdown_connections 2023-11-25T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce040d1c50 0x7fce0415dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fce040d0ab0 0x7fce040b6690 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcde806ae70 0x7fcde806d330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 --2- 172.21.15.2:0/1544966521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce040cce70 0x7fce041f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:40.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 >> 172.21.15.2:0/1544966521 conn(0x7fce040d0f20 msgr2=0x7fce040cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:40.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 shutdown_connections 2023-11-25T04:08:40.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:40.912+0000 7fce0bbec640 1 -- 172.21.15.2:0/1544966521 wait complete. 2023-11-25T04:08:40.924 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6832","nonce":523998843},{"type":"v1","addr":"172.21.15.2:6833","nonce":523998843}]},"active_addr":"172.21.15.2:6833/523998843","active_change":"2023-11-25T04:08:15.468956+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":2806883263}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":237401955}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":3875568011}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.2:0","nonce":976750472}]}]} 2023-11-25T04:08:40.928 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-25T04:08:40.928 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-25T04:08:40.928 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.032+0000 7f7154e44640 1 Processor -- start 2023-11-25T04:08:41.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.032+0000 7f7154e44640 1 -- start start 2023-11-25T04:08:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f7154e44640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 0x7f7150099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f7154e44640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71500d03a0 con 0x7f71500d0ab0 2023-11-25T04:08:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f7154e44640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715006f390 con 0x7f71500d1c50 2023-11-25T04:08:41.037 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f7154e44640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715006bfa0 con 0x7f71500cce70 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f714dd9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f71500d0ab0 0x7f715006e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33006/0 (socket says 172.21.15.2:33006) 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f714dd9b640 1 -- 172.21.15.2:0/360262153 learned_addr learned my addr 172.21.15.2:0/360262153 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f714e59c640 1 --2- 172.21.15.2:0/360262153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 0x7f7150099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f714d59a640 1 -- 172.21.15.2:0/360262153 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760201059 0 0) 0x7f71500d03a0 con 0x7f71500d0ab0 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f714d59a640 1 -- 172.21.15.2:0/360262153 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f713c003520 con 0x7f71500d0ab0 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f714d59a640 1 -- 172.21.15.2:0/360262153 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3970965437 0 0) 0x7f715006f390 con 0x7f71500d1c50 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f714d59a640 1 -- 172.21.15.2:0/360262153 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71500d03a0 con 0x7f71500d1c50 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f714e59c640 1 -- 172.21.15.2:0/360262153 >> v1:172.21.15.66:6789/0 conn(0x7f71500d1c50 legacy=0x7f715006ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.033+0000 7f714e59c640 1 -- 172.21.15.2:0/360262153 >> v1:172.21.15.2:6789/0 conn(0x7f71500d0ab0 legacy=0x7f715006e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.034+0000 7f714d59a640 1 -- 172.21.15.2:0/360262153 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3536109033 0 0) 0x7f713c003520 con 0x7f71500d0ab0 2023-11-25T04:08:41.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.034+0000 7f714e59c640 1 -- 172.21.15.2:0/360262153 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715006f9d0 con 0x7f71500cce70 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.034+0000 7f714e59c640 1 --2- 172.21.15.2:0/360262153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 0x7f7150099970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f71480097d0 tx=0x7f714802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e4e91b47745dc6a server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f714d59a640 1 -- 172.21.15.2:0/360262153 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138001670 con 0x7f71500cce70 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f714d59a640 1 -- 172.21.15.2:0/360262153 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714802e050 con 0x7f71500cce70 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f714d59a640 1 -- 172.21.15.2:0/360262153 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148030710 con 0x7f71500cce70 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f7154e44640 1 -- 172.21.15.2:0/360262153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 msgr2=0x7f7150099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f7154e44640 1 --2- 172.21.15.2:0/360262153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 0x7f7150099970 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f71480097d0 tx=0x7f714802b800 comp rx=0 tx=0).stop 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f7154e44640 1 -- 172.21.15.2:0/360262153 shutdown_connections 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f7154e44640 1 --2- 172.21.15.2:0/360262153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 0x7f7150099970 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f7154e44640 1 -- 172.21.15.2:0/360262153 >> 172.21.15.2:0/360262153 conn(0x7f71500d0f20 msgr2=0x7f71500d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f7154e44640 1 -- 172.21.15.2:0/360262153 shutdown_connections 2023-11-25T04:08:41.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.035+0000 7f7154e44640 1 -- 172.21.15.2:0/360262153 wait complete. 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.037+0000 7f7154e44640 1 Processor -- start 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.037+0000 7f7154e44640 1 -- start start 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.037+0000 7f7154e44640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 0x7f7150156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.037+0000 7f7154e44640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71500d0ab0 0x7f71500c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.037+0000 7f7154e44640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71500d1c50 0x7f71501e6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.037+0000 7f7154e44640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71501e5d80 con 0x7f71500d1c50 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.037+0000 7f7154e44640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71500c9f90 con 0x7f71500d0ab0 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.037+0000 7f7154e44640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71501e5f60 con 0x7f71500cce70 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.037+0000 7f714ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71500d1c50 0x7f71501e6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71500d1c50 0x7f71501e6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53062/0 (socket says 172.21.15.2:53062) 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714ed9d640 1 -- 172.21.15.2:0/3085152401 learned_addr learned my addr 172.21.15.2:0/3085152401 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714dd9b640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71500d0ab0 0x7f71500c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714e59c640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 0x7f7150156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714ed9d640 1 -- 172.21.15.2:0/3085152401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 msgr2=0x7f7150156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714ed9d640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 0x7f7150156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714ed9d640 1 -- 172.21.15.2:0/3085152401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71500d0ab0 msgr2=0x7f71500c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714ed9d640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71500d0ab0 0x7f71500c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714ed9d640 1 -- 172.21.15.2:0/3085152401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148009400 con 0x7f71500d1c50 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f714ed9d640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71500d1c50 0x7f71501e6a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f714000c790 tx=0x7f714000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f7146ffd640 1 -- 172.21.15.2:0/3085152401 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000cea0 con 0x7f71500d1c50 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f7146ffd640 1 -- 172.21.15.2:0/3085152401 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7140003b70 con 0x7f71500d1c50 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71501e6240 con 0x7f71500d1c50 2023-11-25T04:08:41.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f7146ffd640 1 -- 172.21.15.2:0/3085152401 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714000a850 con 0x7f71500d1c50 2023-11-25T04:08:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.038+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7150156950 con 0x7f71500d1c50 2023-11-25T04:08:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.039+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71501e6760 con 0x7f71500d1c50 2023-11-25T04:08:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.040+0000 7f7146ffd640 1 -- 172.21.15.2:0/3085152401 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f714000a9b0 con 0x7f71500d1c50 2023-11-25T04:08:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.040+0000 7f7146ffd640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f713006ae40 0x7f713006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.040+0000 7f7146ffd640 1 -- 172.21.15.2:0/3085152401 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71400894b0 con 0x7f71500d1c50 2023-11-25T04:08:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.040+0000 7f714e59c640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f713006ae40 0x7f713006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.041+0000 7f714e59c640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f713006ae40 0x7f713006d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7148034000 tx=0x7f7148008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.044+0000 7f7146ffd640 1 -- 172.21.15.2:0/3085152401 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71501e6760 con 0x7f71500d1c50 2023-11-25T04:08:41.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.221+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71501e6760 con 0x7f71500d1c50 2023-11-25T04:08:41.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.222+0000 7f7146ffd640 1 -- 172.21.15.2:0/3085152401 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f71501e6760 con 0x7f71500d1c50 2023-11-25T04:08:41.225 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:41.225 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:41.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f713006ae40 msgr2=0x7f713006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f713006ae40 0x7f713006d300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7148034000 tx=0x7f7148008030 comp rx=0 tx=0).stop 2023-11-25T04:08:41.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71500d1c50 msgr2=0x7f71501e6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71500d1c50 0x7f71501e6a40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f714000c790 tx=0x7f714000cc50 comp rx=0 tx=0).stop 2023-11-25T04:08:41.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 shutdown_connections 2023-11-25T04:08:41.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71500d1c50 0x7f71501e6a40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f713006ae40 0x7f713006d300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71500d0ab0 0x7f71500c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 --2- 172.21.15.2:0/3085152401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71500cce70 0x7f7150156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.224+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 >> 172.21.15.2:0/3085152401 conn(0x7f71500d0f20 msgr2=0x7f71500d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.225+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 shutdown_connections 2023-11-25T04:08:41.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.225+0000 7f7154e44640 1 -- 172.21.15.2:0/3085152401 wait complete. 2023-11-25T04:08:41.238 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-25T04:08:41.238 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:41.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.343+0000 7f04a1b89640 1 Processor -- start 2023-11-25T04:08:41.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.343+0000 7f04a1b89640 1 -- start start 2023-11-25T04:08:41.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f04a1b89640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f049c15d3e0 0x7f049c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f04a1b89640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 0x7f049c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f04a1b89640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c0b5f90 con 0x7f049c0ced30 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f04a1b89640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c0cf170 con 0x7f049c15d3e0 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f04a1b89640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0b61e0 con 0x7f049c0d1e30 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f049b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f049c15d3e0 0x7f049c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f049affd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f049c0ced30 0x7f049c0d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33016/0 (socket says 172.21.15.2:33016) 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f049affd640 1 -- 172.21.15.2:0/91397870 learned_addr learned my addr 172.21.15.2:0/91397870 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f049bfff640 1 --2- 172.21.15.2:0/91397870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 0x7f049c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f049b7fe640 1 -- 172.21.15.2:0/91397870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 msgr2=0x7f049c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f049b7fe640 1 --2- 172.21.15.2:0/91397870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 0x7f049c0b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f049b7fe640 1 -- 172.21.15.2:0/91397870 >> v1:172.21.15.2:6789/0 conn(0x7f049c0ced30 legacy=0x7f049c0d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f049b7fe640 1 -- 172.21.15.2:0/91397870 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c0b64c0 con 0x7f049c15d3e0 2023-11-25T04:08:41.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.344+0000 7f049a7fc640 1 -- 172.21.15.2:0/91397870 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556598293 0 0) 0x7f049c0b5f90 con 0x7f049c0ced30 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.345+0000 7f049b7fe640 1 --2- 172.21.15.2:0/91397870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c15d3e0 0x7f049c0ce7f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097a0 tx=0x7f048c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3ee313a463393 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.345+0000 7f049a7fc640 1 -- 172.21.15.2:0/91397870 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c031830 con 0x7f049c15d3e0 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.345+0000 7f049a7fc640 1 -- 172.21.15.2:0/91397870 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c031990 con 0x7f049c15d3e0 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.345+0000 7f049a7fc640 1 -- 172.21.15.2:0/91397870 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c031d20 con 0x7f049c15d3e0 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.346+0000 7f04a1b89640 1 -- 172.21.15.2:0/91397870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c15d3e0 msgr2=0x7f049c0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.346+0000 7f04a1b89640 1 --2- 172.21.15.2:0/91397870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c15d3e0 0x7f049c0ce7f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f048c0097a0 tx=0x7f048c02b8d0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.346+0000 7f04a1b89640 1 -- 172.21.15.2:0/91397870 shutdown_connections 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.346+0000 7f04a1b89640 1 --2- 172.21.15.2:0/91397870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 0x7f049c0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.346+0000 7f04a1b89640 1 --2- 172.21.15.2:0/91397870 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c15d3e0 0x7f049c0ce7f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.346+0000 7f04a1b89640 1 -- 172.21.15.2:0/91397870 >> 172.21.15.2:0/91397870 conn(0x7f049c09c480 msgr2=0x7f049c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.346+0000 7f04a1b89640 1 -- 172.21.15.2:0/91397870 shutdown_connections 2023-11-25T04:08:41.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.346+0000 7f04a1b89640 1 -- 172.21.15.2:0/91397870 wait complete. 2023-11-25T04:08:41.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.347+0000 7f04a1b89640 1 Processor -- start 2023-11-25T04:08:41.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.347+0000 7f04a1b89640 1 -- start start 2023-11-25T04:08:41.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f04a1b89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0ced30 0x7f049c0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f04a1b89640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 0x7f049c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f04a1b89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f049c15d3e0 0x7f049c159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f04a1b89640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0c9300 con 0x7f049c0ced30 2023-11-25T04:08:41.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f04a1b89640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0ca720 con 0x7f049c15d3e0 2023-11-25T04:08:41.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f04a1b89640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c154ff0 con 0x7f049c0d1e30 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0ced30 0x7f049c0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0ced30 0x7f049c0c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53078/0 (socket says 172.21.15.2:53078) 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049b7fe640 1 -- 172.21.15.2:0/400335146 learned_addr learned my addr 172.21.15.2:0/400335146 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049bfff640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f049c15d3e0 0x7f049c159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049affd640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 0x7f049c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049b7fe640 1 -- 172.21.15.2:0/400335146 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 msgr2=0x7f049c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049b7fe640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 0x7f049c158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049b7fe640 1 -- 172.21.15.2:0/400335146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f049c15d3e0 msgr2=0x7f049c159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049b7fe640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f049c15d3e0 0x7f049c159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.348+0000 7f049b7fe640 1 -- 172.21.15.2:0/400335146 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f048c009400 con 0x7f049c0ced30 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.349+0000 7f049b7fe640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0ced30 0x7f049c0c8dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f048c034040 tx=0x7f048c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.349+0000 7f0483fff640 1 -- 172.21.15.2:0/400335146 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c004230 con 0x7f049c0ced30 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.349+0000 7f0483fff640 1 -- 172.21.15.2:0/400335146 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048c004390 con 0x7f049c0ced30 2023-11-25T04:08:41.353 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.349+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c158de0 con 0x7f049c0ced30 2023-11-25T04:08:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.349+0000 7f0483fff640 1 -- 172.21.15.2:0/400335146 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048c03a910 con 0x7f049c0ced30 2023-11-25T04:08:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.349+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c0ca3b0 con 0x7f049c0ced30 2023-11-25T04:08:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.350+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c159300 con 0x7f049c0ced30 2023-11-25T04:08:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.350+0000 7f0483fff640 1 -- 172.21.15.2:0/400335146 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f048c03aa70 con 0x7f049c0ced30 2023-11-25T04:08:41.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.351+0000 7f0483fff640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f048806ae40 0x7f048806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.351+0000 7f049affd640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f048806ae40 0x7f048806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.351+0000 7f0483fff640 1 -- 172.21.15.2:0/400335146 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f048c0ab950 con 0x7f049c0ced30 2023-11-25T04:08:41.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.351+0000 7f049affd640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f048806ae40 0x7f048806d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f049c06b900 tx=0x7f0490007b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.355+0000 7f0483fff640 1 -- 172.21.15.2:0/400335146 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f049c159300 con 0x7f049c0ced30 2023-11-25T04:08:41.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.534+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f049c159300 con 0x7f049c0ced30 2023-11-25T04:08:41.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.536+0000 7f0483fff640 1 -- 172.21.15.2:0/400335146 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f049c159300 con 0x7f049c0ced30 2023-11-25T04:08:41.538 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:41.538 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:41.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f048806ae40 msgr2=0x7f048806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f048806ae40 0x7f048806d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f049c06b900 tx=0x7f0490007b70 comp rx=0 tx=0).stop 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0ced30 msgr2=0x7f049c0c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0ced30 0x7f049c0c8dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f048c034040 tx=0x7f048c0046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 shutdown_connections 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f048806ae40 0x7f048806d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f049c15d3e0 0x7f049c159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f049c0d1e30 0x7f049c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 --2- 172.21.15.2:0/400335146 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f049c0ced30 0x7f049c0c8dc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.537+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 >> 172.21.15.2:0/400335146 conn(0x7f049c09c480 msgr2=0x7f049c0b5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.538+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 shutdown_connections 2023-11-25T04:08:41.540 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.538+0000 7f04a1b89640 1 -- 172.21.15.2:0/400335146 wait complete. 2023-11-25T04:08:41.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-25T04:08:41.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-25T04:08:41.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-25T04:08:41.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-25T04:08:41.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-25T04:08:41.553 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-25T04:08:41.553 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-25T04:08:41.553 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-25T04:08:41.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.735+0000 7f2c191dc640 1 Processor -- start 2023-11-25T04:08:41.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.735+0000 7f2c191dc640 1 -- start start 2023-11-25T04:08:41.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.736+0000 7f3c033fa640 1 Processor -- start 2023-11-25T04:08:41.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.736+0000 7f2c191dc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140b2460 0x7f2c141649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.736+0000 7f3c033fa640 1 -- start start 2023-11-25T04:08:41.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.736+0000 7f2c191dc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2c140b0e50 0x7f2c14164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.736+0000 7f2c191dc640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c140b13c0 con 0x7f2c140c4020 2023-11-25T04:08:41.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.736+0000 7f2c191dc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c140d1cc0 con 0x7f2c140b0e50 2023-11-25T04:08:41.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.736+0000 7f2c191dc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140b16a0 con 0x7f2c140b2460 2023-11-25T04:08:41.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.737+0000 7f2c12d9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2c140c4020 0x7f2c140b0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33022/0 (socket says 172.21.15.2:33022) 2023-11-25T04:08:41.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.737+0000 7f2c12d9d640 1 -- 172.21.15.2:0/4276705134 learned_addr learned my addr 172.21.15.2:0/4276705134 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:41.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.737+0000 7efd0a0a3640 1 Processor -- start 2023-11-25T04:08:41.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.736+0000 7ff56ead8640 1 Processor -- start 2023-11-25T04:08:41.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.736+0000 7ff56ead8640 1 -- start start 2023-11-25T04:08:41.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.737+0000 7ff331a59640 1 Processor -- start 2023-11-25T04:08:41.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.737+0000 7f2c1259c640 1 --2- 172.21.15.2:0/4276705134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140b2460 0x7f2c141649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.737+0000 7f2c1359e640 1 --2- 172.21.15.2:0/4276705134 >> v2:172.21.15.2:3300/0 conn(0x7f2c140b0e50 0x7f2c14164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.737+0000 7ff331a59640 1 -- start start 2023-11-25T04:08:41.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.737+0000 7efd0a0a3640 1 -- start start 2023-11-25T04:08:41.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f3c033fa640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3bf40061c0 0x7f3bf4006670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f3c033fa640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf40e36b0 con 0x7f3bf40e32d0 2023-11-25T04:08:41.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f3c033fa640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf4057b10 con 0x7f3bf4006bb0 2023-11-25T04:08:41.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f3c033fa640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf4058790 con 0x7f3bf40061c0 2023-11-25T04:08:41.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7ff56ead8640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff56814afe0 0x7ff5680b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f3c01bf7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3bf40061c0 0x7f3bf4006670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f3c01bf7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f3bf40061c0 0x7f3bf4006670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53092/0 (socket says 172.21.15.2:53092) 2023-11-25T04:08:41.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f3c01bf7640 1 -- 172.21.15.2:0/2030521179 learned_addr learned my addr 172.21.15.2:0/2030521179 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7ff56ead8640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680b2290 0x7ff568070090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7ff56ead8640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff5680705d0 0x7ff568165080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7ff56ead8640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff568070a80 con 0x7ff56814afe0 2023-11-25T04:08:41.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7ff56ead8640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5680b27d0 con 0x7ff5680705d0 2023-11-25T04:08:41.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7ff56ead8640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5680b2ab0 con 0x7ff5680b2290 2023-11-25T04:08:41.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7ff56e2d7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff5680705d0 0x7ff568165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7ff56d2d5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680b2290 0x7ff568070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f7b8a1e3640 1 Processor -- start 2023-11-25T04:08:41.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f7b8a1e3640 1 -- start start 2023-11-25T04:08:41.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff56e2d7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff5680705d0 0x7ff568165080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:54852/0 (socket says 172.21.15.2:54852) 2023-11-25T04:08:41.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7f3c01bf7640 1 -- 172.21.15.2:0/2030521179 >> v1:172.21.15.66:6789/0 conn(0x7f3bf4006bb0 legacy=0x7f3bf403c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7efd0a0a3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7efcfc0e7510 0x7efcfc034330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd0a0a3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc054130 0x7efcfc0066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd0a0a3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcfc006bf0 con 0x7efcfc006250 2023-11-25T04:08:41.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd0a0a3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcfc0e78f0 con 0x7efcfc0e7510 2023-11-25T04:08:41.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd0a0a3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0508e0 con 0x7efcfc054130 2023-11-25T04:08:41.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7f3c01bf7640 1 -- 172.21.15.2:0/2030521179 >> v1:172.21.15.2:6789/0 conn(0x7f3bf40e32d0 legacy=0x7f3bf40572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff56e2d7640 1 -- 172.21.15.2:0/1516218060 learned_addr learned my addr 172.21.15.2:0/1516218060 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7f3c01bf7640 1 -- 172.21.15.2:0/2030521179 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4057df0 con 0x7f3bf40061c0 2023-11-25T04:08:41.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.738+0000 7f2c1259c640 1 -- 172.21.15.2:0/4276705134 >> v2:172.21.15.2:3300/0 conn(0x7f2c140b0e50 msgr2=0x7f2c14164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7f2c1259c640 1 --2- 172.21.15.2:0/4276705134 >> v2:172.21.15.2:3300/0 conn(0x7f2c140b0e50 0x7f2c14164ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7f2c1259c640 1 -- 172.21.15.2:0/4276705134 >> v1:172.21.15.2:6789/0 conn(0x7f2c140c4020 legacy=0x7f2c140b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff56dad6640 1 --2- 172.21.15.2:0/1516218060 >> v2:172.21.15.2:3300/0 conn(0x7ff56814afe0 0x7ff5680b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ffa4f59e640 1 Processor -- start 2023-11-25T04:08:41.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd098a2640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc054130 0x7efcfc0066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd098a2640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc054130 0x7efcfc0066b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39592/0 (socket says 172.21.15.2:39592) 2023-11-25T04:08:41.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd098a2640 1 -- 172.21.15.2:0/400051363 learned_addr learned my addr 172.21.15.2:0/400051363 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff56d2d5640 1 -- 172.21.15.2:0/1516218060 >> v2:172.21.15.66:3300/0 conn(0x7ff5680705d0 msgr2=0x7ff568165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff56d2d5640 1 --2- 172.21.15.2:0/1516218060 >> v2:172.21.15.66:3300/0 conn(0x7ff5680705d0 0x7ff568165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff56d2d5640 1 -- 172.21.15.2:0/1516218060 >> v2:172.21.15.2:3300/0 conn(0x7ff56814afe0 msgr2=0x7ff5680b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff56d2d5640 1 --2- 172.21.15.2:0/1516218060 >> v2:172.21.15.2:3300/0 conn(0x7ff56814afe0 0x7ff5680b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff56d2d5640 1 -- 172.21.15.2:0/1516218060 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5680b2d90 con 0x7ff5680b2290 2023-11-25T04:08:41.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7f2c11d9b640 1 -- 172.21.15.2:0/4276705134 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488312334 0 0) 0x7f2c140b13c0 con 0x7f2c140c4020 2023-11-25T04:08:41.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7f2c1259c640 1 -- 172.21.15.2:0/4276705134 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c140b1980 con 0x7f2c140b2460 2023-11-25T04:08:41.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7f2c1359e640 1 --2- 172.21.15.2:0/4276705134 >> v2:172.21.15.2:3300/0 conn(0x7f2c140b0e50 0x7f2c14164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:41.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd098a2640 1 -- 172.21.15.2:0/400051363 >> v2:172.21.15.2:3300/0 conn(0x7efcfc0e7510 msgr2=0x7efcfc034330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd098a2640 1 --2- 172.21.15.2:0/400051363 >> v2:172.21.15.2:3300/0 conn(0x7efcfc0e7510 0x7efcfc034330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd098a2640 1 -- 172.21.15.2:0/400051363 >> v1:172.21.15.66:6789/0 conn(0x7efcfc006250 legacy=0x7efcfc0eaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff331a59640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff3240df7d0 0x7ff3240541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff331a59640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff324006740 0x7ff324006b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff331a59640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3240070d0 con 0x7ff324050710 2023-11-25T04:08:41.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff331a59640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff324050b90 con 0x7ff324006740 2023-11-25T04:08:41.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7efd098a2640 1 -- 172.21.15.2:0/400051363 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcfc050bc0 con 0x7efcfc054130 2023-11-25T04:08:41.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff331a59640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3240dfbb0 con 0x7ff3240df7d0 2023-11-25T04:08:41.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff330a57640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff3240df7d0 0x7ff3240541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff330a57640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff3240df7d0 0x7ff3240541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:54866/0 (socket says 172.21.15.2:54866) 2023-11-25T04:08:41.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ff330a57640 1 -- 172.21.15.2:0/710965119 learned_addr learned my addr 172.21.15.2:0/710965119 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7f7fb5383640 1 Processor -- start 2023-11-25T04:08:41.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7f7b8a1e3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7b7c050160 0x7f7b7c038040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7f7fb5383640 1 -- start start 2023-11-25T04:08:41.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7ff331258640 1 --2- 172.21.15.2:0/710965119 >> v2:172.21.15.2:3300/0 conn(0x7ff324006740 0x7ff324006b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7f3c01bf7640 1 --2- 172.21.15.2:0/2030521179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bf40061c0 0x7f3bf4006670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009870 tx=0x7f3bec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3501b7ec339de989 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7f2c1259c640 1 --2- 172.21.15.2:0/4276705134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140b2460 0x7f2c141649b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2c080097a0 tx=0x7f2c0802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c458915713fce20a server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7f7b837fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7b7c0df1e0 0x7f7b7c04fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:46136/0 (socket says 172.21.15.2:46136) 2023-11-25T04:08:41.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7f7b82ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7b7c050160 0x7f7b7c038040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.757 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7f7b837fe640 1 -- 172.21.15.2:0/1806886282 learned_addr learned my addr 172.21.15.2:0/1806886282 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:41.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7ff56d2d5640 1 --2- 172.21.15.2:0/1516218060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680b2290 0x7ff568070090 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff56806fe50 tx=0x7ff56402b7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10227f225107b9ad server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7f7b8a1e3640 1 --2- 172.21.15.2:0/1806886282 >> v2:172.21.15.2:3300/0 conn(0x7f7b7c00c060 0x7f7b7c0072b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f2c11d9b640 1 -- 172.21.15.2:0/4276705134 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08031780 con 0x7f2c140b2460 2023-11-25T04:08:41.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.739+0000 7ffa4f59e640 1 -- start start 2023-11-25T04:08:41.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/1806886282 --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c0077f0 con 0x7f7b7c0df1e0 2023-11-25T04:08:41.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ffa4f59e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffa5006ee20 0x7ffa500711c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/1806886282 --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c054480 con 0x7f7b7c00c060 2023-11-25T04:08:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/1806886282 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c0541a0 con 0x7f7b7c050160 2023-11-25T04:08:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b83fff640 1 --2- 172.21.15.2:0/1806886282 >> v2:172.21.15.2:3300/0 conn(0x7f7b7c00c060 0x7f7b7c0072b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.740+0000 7ff32b7fe640 1 -- 172.21.15.2:0/710965119 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389225748 0 0) 0x7ff320001110 con 0x7ff324050710 2023-11-25T04:08:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ff32b7fe640 1 -- 172.21.15.2:0/710965119 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff31c003520 con 0x7ff324050710 2023-11-25T04:08:41.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ffa4f59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa50071700 0x7ffa500ad980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ff331258640 1 -- 172.21.15.2:0/710965119 >> v2:172.21.15.66:3300/0 conn(0x7ff3240df7d0 msgr2=0x7ff3240541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ff331258640 1 --2- 172.21.15.2:0/710965119 >> v2:172.21.15.66:3300/0 conn(0x7ff3240df7d0 0x7ff3240541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ff331258640 1 -- 172.21.15.2:0/710965119 >> v1:172.21.15.66:6789/0 conn(0x7ff324050710 legacy=0x7ff324053110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ff331258640 1 -- 172.21.15.2:0/710965119 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324052670 con 0x7ff324006740 2023-11-25T04:08:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f2c11d9b640 1 -- 172.21.15.2:0/4276705134 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c080318e0 con 0x7f2c140b2460 2023-11-25T04:08:41.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f2c11d9b640 1 -- 172.21.15.2:0/4276705134 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08031c70 con 0x7f2c140b2460 2023-11-25T04:08:41.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ffa4f59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa50071b60 con 0x7ffa500adec0 2023-11-25T04:08:41.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315462744 0 0) 0x7f7b7c0077f0 con 0x7f7b7c0df1e0 2023-11-25T04:08:41.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b74003520 con 0x7f7b7c0df1e0 2023-11-25T04:08:41.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f3c013f6640 1 -- 172.21.15.2:0/2030521179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0317e0 con 0x7f3bf40061c0 2023-11-25T04:08:41.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ffa4f59e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa500b2fb0 con 0x7ffa5006ee20 2023-11-25T04:08:41.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ffa4f59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa500ae6f0 con 0x7ffa50071700 2023-11-25T04:08:41.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f3c013f6640 1 -- 172.21.15.2:0/2030521179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec031940 con 0x7f3bf40061c0 2023-11-25T04:08:41.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ffa4e59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffa5006ee20 0x7ffa500711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f3c013f6640 1 -- 172.21.15.2:0/2030521179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec031cd0 con 0x7f3bf40061c0 2023-11-25T04:08:41.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ffa4e59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ffa5006ee20 0x7ffa500711c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53138/0 (socket says 172.21.15.2:53138) 2023-11-25T04:08:41.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 <== mon.1 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2606681215 0 0) 0x7f7b74003520 con 0x7f7b7c0df1e0 2023-11-25T04:08:41.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 >> v2:172.21.15.66:3300/0 conn(0x7f7b7c050160 msgr2=0x7f7b7c038040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 --2- 172.21.15.2:0/1806886282 >> v2:172.21.15.66:3300/0 conn(0x7f7b7c050160 0x7f7b7c038040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 >> v2:172.21.15.2:3300/0 conn(0x7f7b7c00c060 msgr2=0x7f7b7c0072b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 --2- 172.21.15.2:0/1806886282 >> v2:172.21.15.2:3300/0 conn(0x7f7b7c00c060 0x7f7b7c0072b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c005f40 con 0x7f7b7c0df1e0 2023-11-25T04:08:41.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ffa4e59c640 1 -- 172.21.15.2:0/2012690219 learned_addr learned my addr 172.21.15.2:0/2012690219 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 <== mon.1 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f7b78001670 con 0x7f7b7c0df1e0 2023-11-25T04:08:41.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 >> v1:172.21.15.66:6789/0 conn(0x7f7b7c0df1e0 legacy=0x7f7b7c04fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7ffa4dd9b640 1 --2- 172.21.15.2:0/2012690219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa50071700 0x7ffa500ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.741+0000 7f7b827fc640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b740039c0 0x7f7b74003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7ffa4dd9b640 1 -- 172.21.15.2:0/2012690219 >> v2:172.21.15.2:3300/0 conn(0x7ffa5006ee20 msgr2=0x7ffa500711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7ffa4dd9b640 1 --2- 172.21.15.2:0/2012690219 >> v2:172.21.15.2:3300/0 conn(0x7ffa5006ee20 0x7ffa500711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7ffa4d59a640 1 -- 172.21.15.2:0/2012690219 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842527420 0 0) 0x7ffa50071b60 con 0x7ffa500adec0 2023-11-25T04:08:41.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7ffa4dd9b640 1 -- 172.21.15.2:0/2012690219 >> v1:172.21.15.66:6789/0 conn(0x7ffa500adec0 legacy=0x7ffa5015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7b827fc640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740047c0 0x7f7b74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7fb5383640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7fa80df330 0x7f7fa80075b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7ffa4dd9b640 1 -- 172.21.15.2:0/2012690219 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500ae9d0 con 0x7ffa50071700 2023-11-25T04:08:41.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7ffa4e59c640 1 --2- 172.21.15.2:0/2012690219 >> v2:172.21.15.2:3300/0 conn(0x7ffa5006ee20 0x7ffa500711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7b827fc640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b74005180 0x7f7b7400fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7b837fe640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b740039c0 0x7f7b74003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7ff331258640 1 --2- 172.21.15.2:0/710965119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324006740 0x7ff324006b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff32c064320 tx=0x7ff32c0a82f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51f6d1ccfedd64d server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c054480 con 0x7f7b740047c0 2023-11-25T04:08:41.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0541a0 con 0x7f7b740039c0 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b740104b0 con 0x7f7b74005180 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7b83fff640 1 --2- 172.21.15.2:0/1806886282 >> v2:172.21.15.2:3300/0 conn(0x7f7b7c00c060 0x7f7b7c0072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7b82ffd640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740047c0 0x7f7b74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f2c191dc640 1 -- 172.21.15.2:0/4276705134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140b2460 msgr2=0x7f2c141649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f2c191dc640 1 --2- 172.21.15.2:0/4276705134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140b2460 0x7f2c141649b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2c080097a0 tx=0x7f2c0802b820 comp rx=0 tx=0).stop 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f2c191dc640 1 -- 172.21.15.2:0/4276705134 shutdown_connections 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f2c191dc640 1 --2- 172.21.15.2:0/4276705134 >> v2:172.21.15.2:3300/0 conn(0x7f2c140b0e50 0x7f2c14164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f2c191dc640 1 --2- 172.21.15.2:0/4276705134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140b2460 0x7f2c141649b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f2c191dc640 1 -- 172.21.15.2:0/4276705134 >> 172.21.15.2:0/4276705134 conn(0x7f2c140d0de0 msgr2=0x7f2c140d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f2c191dc640 1 -- 172.21.15.2:0/4276705134 shutdown_connections 2023-11-25T04:08:41.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7efd098a2640 1 --2- 172.21.15.2:0/400051363 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc054130 0x7efcfc0066b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009870 tx=0x7efcf402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ac7029a93de3a77 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7fb5383640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7fa8006080 0x7f7fa8053dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f2c191dc640 1 -- 172.21.15.2:0/4276705134 wait complete. 2023-11-25T04:08:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7fb5383640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa8006510 con 0x7f7fa80e2d90 2023-11-25T04:08:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7fb5383640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80df710 con 0x7f7fa80df330 2023-11-25T04:08:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7faeffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7fa80df330 0x7f7fa80075b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f3c033fa640 1 -- 172.21.15.2:0/2030521179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bf40061c0 msgr2=0x7f3bf4006670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f3c033fa640 1 --2- 172.21.15.2:0/2030521179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bf40061c0 0x7f3bf4006670 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3bec009870 tx=0x7f3bec02b880 comp rx=0 tx=0).stop 2023-11-25T04:08:41.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7faeffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7fa80df330 0x7f7fa80075b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53160/0 (socket says 172.21.15.2:53160) 2023-11-25T04:08:41.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7b83fff640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b74005180 0x7f7b7400fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7efcfbfff640 1 -- 172.21.15.2:0/400051363 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf4031640 con 0x7efcfc054130 2023-11-25T04:08:41.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7efcfbfff640 1 -- 172.21.15.2:0/400051363 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf40317a0 con 0x7efcfc054130 2023-11-25T04:08:41.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7efcfbfff640 1 -- 172.21.15.2:0/400051363 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf4031b30 con 0x7efcfc054130 2023-11-25T04:08:41.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7faeffd640 1 -- 172.21.15.2:0/3006148361 learned_addr learned my addr 172.21.15.2:0/3006148361 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7ff56cad4640 1 -- 172.21.15.2:0/1516218060 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff564031740 con 0x7ff5680b2290 2023-11-25T04:08:41.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7ff56cad4640 1 -- 172.21.15.2:0/1516218060 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5640318a0 con 0x7ff5680b2290 2023-11-25T04:08:41.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff56ead8640 1 -- 172.21.15.2:0/1516218060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680b2290 msgr2=0x7ff568070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.773 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff56ead8640 1 --2- 172.21.15.2:0/1516218060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680b2290 0x7ff568070090 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff56806fe50 tx=0x7ff56402b7e0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f7b83fff640 1 -- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b740039c0 msgr2=0x7f7b74003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f7b83fff640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b740039c0 0x7f7b74003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f7b83fff640 1 -- 172.21.15.2:0/1806886282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740047c0 msgr2=0x7f7b74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff32b7fe640 1 -- 172.21.15.2:0/710965119 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0b0640 con 0x7ff324006740 2023-11-25T04:08:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff32b7fe640 1 -- 172.21.15.2:0/710965119 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32c0b07a0 con 0x7ff324006740 2023-11-25T04:08:41.774 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff32b7fe640 1 -- 172.21.15.2:0/710965119 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff32c0b0b10 con 0x7ff324006740 2023-11-25T04:08:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f7b83fff640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b740047c0 0x7f7b74004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f7b83fff640 1 -- 172.21.15.2:0/1806886282 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b74003520 con 0x7f7b74005180 2023-11-25T04:08:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.742+0000 7f7fae7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7fa8006080 0x7f7fa8053dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f3c033fa640 1 -- 172.21.15.2:0/2030521179 shutdown_connections 2023-11-25T04:08:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f3c033fa640 1 --2- 172.21.15.2:0/2030521179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bf40061c0 0x7f3bf4006670 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f3c033fa640 1 -- 172.21.15.2:0/2030521179 >> 172.21.15.2:0/2030521179 conn(0x7f3bf4058ec0 msgr2=0x7f3bf40592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f7fb5383640 1 -- 172.21.15.2:0/3006148361 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80067f0 con 0x7f7fa8006080 2023-11-25T04:08:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ffa4dd9b640 1 --2- 172.21.15.2:0/2012690219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa50071700 0x7ffa500ad980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400dbc0 tx=0x7ffa4402fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de89e22262967a3b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f3c033fa640 1 -- 172.21.15.2:0/2030521179 shutdown_connections 2023-11-25T04:08:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7f3c033fa640 1 -- 172.21.15.2:0/2030521179 wait complete. 2023-11-25T04:08:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ffa4d59a640 1 -- 172.21.15.2:0/2012690219 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44030860 con 0x7ffa50071700 2023-11-25T04:08:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff56ead8640 1 -- 172.21.15.2:0/1516218060 shutdown_connections 2023-11-25T04:08:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff56ead8640 1 --2- 172.21.15.2:0/1516218060 >> v2:172.21.15.66:3300/0 conn(0x7ff5680705d0 0x7ff568165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff56ead8640 1 --2- 172.21.15.2:0/1516218060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680b2290 0x7ff568070090 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff56ead8640 1 --2- 172.21.15.2:0/1516218060 >> v2:172.21.15.2:3300/0 conn(0x7ff56814afe0 0x7ff5680b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff56ead8640 1 -- 172.21.15.2:0/1516218060 >> 172.21.15.2:0/1516218060 conn(0x7ff56806a6b0 msgr2=0x7ff56806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ffa4d59a640 1 -- 172.21.15.2:0/2012690219 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa440309c0 con 0x7ffa50071700 2023-11-25T04:08:41.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ffa4d59a640 1 -- 172.21.15.2:0/2012690219 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44030d50 con 0x7ffa50071700 2023-11-25T04:08:41.778 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7f7b83fff640 1 -- 172.21.15.2:0/1806886282 reap_dead start 2023-11-25T04:08:41.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7efd0a0a3640 1 -- 172.21.15.2:0/400051363 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc054130 msgr2=0x7efcfc0066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243870952 0 0) 0x7f7fa8006510 con 0x7f7fa80e2d90 2023-11-25T04:08:41.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f98003520 con 0x7f7fa80e2d90 2023-11-25T04:08:41.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.743+0000 7ff56ead8640 1 -- 172.21.15.2:0/1516218060 shutdown_connections 2023-11-25T04:08:41.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ff56ead8640 1 -- 172.21.15.2:0/1516218060 wait complete. 2023-11-25T04:08:41.779 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7f7b83fff640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b74005180 0x7f7b7400fd90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b84000b60 tx=0x7f7b740057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79a77ecb604e8e5b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ff331a59640 1 -- 172.21.15.2:0/710965119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324006740 msgr2=0x7ff324006b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ff331a59640 1 --2- 172.21.15.2:0/710965119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324006740 0x7ff324006b90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff32c064320 tx=0x7ff32c0a82f0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7f2c191dc640 1 Processor -- start 2023-11-25T04:08:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7efd0a0a3640 1 --2- 172.21.15.2:0/400051363 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc054130 0x7efcfc0066b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efcf4009870 tx=0x7efcf402b8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7efd0a0a3640 1 -- 172.21.15.2:0/400051363 shutdown_connections 2023-11-25T04:08:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7efd0a0a3640 1 --2- 172.21.15.2:0/400051363 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc054130 0x7efcfc0066b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7efd0a0a3640 1 --2- 172.21.15.2:0/400051363 >> v2:172.21.15.2:3300/0 conn(0x7efcfc0e7510 0x7efcfc034330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7efd0a0a3640 1 -- 172.21.15.2:0/400051363 >> 172.21.15.2:0/400051363 conn(0x7efcfc055310 msgr2=0x7efcfc055720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7f2c191dc640 1 -- start start 2023-11-25T04:08:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ff331a59640 1 -- 172.21.15.2:0/710965119 shutdown_connections 2023-11-25T04:08:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ff331a59640 1 --2- 172.21.15.2:0/710965119 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324006740 0x7ff324006b90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ff331a59640 1 --2- 172.21.15.2:0/710965119 >> v2:172.21.15.66:3300/0 conn(0x7ff3240df7d0 0x7ff3240541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.781 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ff331a59640 1 -- 172.21.15.2:0/710965119 >> 172.21.15.2:0/710965119 conn(0x7ff324009f80 msgr2=0x7ff32400a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ffa4f59e640 1 -- 172.21.15.2:0/2012690219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa50071700 msgr2=0x7ffa500ad980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ffa4f59e640 1 --2- 172.21.15.2:0/2012690219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa50071700 0x7ffa500ad980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400dbc0 tx=0x7ffa4402fcc0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7efd0a0a3640 1 -- 172.21.15.2:0/400051363 shutdown_connections 2023-11-25T04:08:41.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 213016832 0 0) 0x7f7f98003520 con 0x7f7fa80e2d90 2023-11-25T04:08:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 >> v2:172.21.15.66:3300/0 conn(0x7f7fa8006080 msgr2=0x7f7fa8053dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ffa4f59e640 1 -- 172.21.15.2:0/2012690219 shutdown_connections 2023-11-25T04:08:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 --2- 172.21.15.2:0/3006148361 >> v2:172.21.15.66:3300/0 conn(0x7f7fa8006080 0x7f7fa8053dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 >> v2:172.21.15.2:3300/0 conn(0x7f7fa80df330 msgr2=0x7f7fa80075b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ffa4f59e640 1 --2- 172.21.15.2:0/2012690219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa50071700 0x7ffa500ad980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ffa4f59e640 1 --2- 172.21.15.2:0/2012690219 >> v2:172.21.15.2:3300/0 conn(0x7ffa5006ee20 0x7ffa500711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7ffa4f59e640 1 -- 172.21.15.2:0/2012690219 >> 172.21.15.2:0/2012690219 conn(0x7ffa500b1940 msgr2=0x7ffa500b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 --2- 172.21.15.2:0/3006148361 >> v2:172.21.15.2:3300/0 conn(0x7f7fa80df330 0x7f7fa80075b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8006ad0 con 0x7f7fa80e2d90 2023-11-25T04:08:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f7fb004ed60 con 0x7f7fa80e2d90 2023-11-25T04:08:41.784 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 >> v1:172.21.15.2:6789/0 conn(0x7f7fa80e2d90 legacy=0x7f7fa804f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ff331a59640 1 -- 172.21.15.2:0/710965119 shutdown_connections 2023-11-25T04:08:41.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7ff331a59640 1 -- 172.21.15.2:0/710965119 wait complete. 2023-11-25T04:08:41.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f98003970 0x7f7f98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f980047c0 0x7f7f98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7f9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80df710 con 0x7f7f98005180 2023-11-25T04:08:41.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80067f0 con 0x7f7f980047c0 2023-11-25T04:08:41.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9800bf10 con 0x7f7f98003970 2023-11-25T04:08:41.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840a6b60 con 0x7f7b74005180 2023-11-25T04:08:41.786 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7ff56ead8640 1 Processor -- start 2023-11-25T04:08:41.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7faffff640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7f9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b840aa070 con 0x7f7b74005180 2023-11-25T04:08:41.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7f7b827fc640 1 -- 172.21.15.2:0/1806886282 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840b0400 con 0x7f7b74005180 2023-11-25T04:08:41.787 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f3c033fa640 1 Processor -- start 2023-11-25T04:08:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f3c033fa640 1 -- start start 2023-11-25T04:08:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f7faffff640 1 -- 172.21.15.2:0/3006148361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f98003970 msgr2=0x7f7f98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f7faeffd640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f98003970 0x7f7f98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f7faffff640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f98003970 0x7f7f98003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f7faffff640 1 -- 172.21.15.2:0/3006148361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f980047c0 msgr2=0x7f7f98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f7faffff640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f980047c0 0x7f7f98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f7faffff640 1 -- 172.21.15.2:0/3006148361 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8006ad0 con 0x7f7f98005180 2023-11-25T04:08:41.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f2c191dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c140b0e50 0x7f2c140c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f7faeffd640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f98003970 0x7f7f98003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:41.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f2c191dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c140b2460 0x7f2c141520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7ff331a59640 1 Processor -- start 2023-11-25T04:08:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.744+0000 7efd0a0a3640 1 -- 172.21.15.2:0/400051363 wait complete. 2023-11-25T04:08:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7efd0a0a3640 1 Processor -- start 2023-11-25T04:08:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f2c1259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c140b2460 0x7f2c141520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f2c12d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c140b0e50 0x7f2c140c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f2c12d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c140b0e50 0x7f2c140c48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:54934/0 (socket says 172.21.15.2:54934) 2023-11-25T04:08:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f2c1259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c140b2460 0x7f2c141520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53174/0 (socket says 172.21.15.2:53174) 2023-11-25T04:08:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f2c12d9d640 1 -- 172.21.15.2:0/805613285 learned_addr learned my addr 172.21.15.2:0/805613285 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7f2c191dc640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140c4020 0x7f2c140c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b74005180 msgr2=0x7f7b7400fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f7b8a1e3640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b74005180 0x7f7b7400fd90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7b84000b60 tx=0x7f7b740057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f7faffff640 1 -- 172.21.15.2:0/3006148361 reap_dead start 2023-11-25T04:08:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7ffa4f59e640 1 -- 172.21.15.2:0/2012690219 shutdown_connections 2023-11-25T04:08:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.745+0000 7ff56ead8640 1 -- start start 2023-11-25T04:08:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/1806886282 shutdown_connections 2023-11-25T04:08:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f7b8a1e3640 1 --2- 172.21.15.2:0/1806886282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b74005180 0x7f7b7400fd90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/1806886282 >> 172.21.15.2:0/1806886282 conn(0x7f7b7c009f70 msgr2=0x7f7b7c00a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7ff56ead8640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680705d0 0x7ff5681646d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7ff56ead8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5680b2290 0x7ff56813b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7ff56ead8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56814afe0 0x7ff56815ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7ffa4f59e640 1 -- 172.21.15.2:0/2012690219 wait complete. 2023-11-25T04:08:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f2c191dc640 1 -- 172.21.15.2:0/805613285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c141f96e0 con 0x7f2c140b2460 2023-11-25T04:08:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f2c191dc640 1 -- 172.21.15.2:0/805613285 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c140cae20 con 0x7f2c140b0e50 2023-11-25T04:08:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f2c191dc640 1 -- 172.21.15.2:0/805613285 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c141f9090 con 0x7f2c140c4020 2023-11-25T04:08:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7ff56dad6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680705d0 0x7ff5681646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7ff56dad6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680705d0 0x7ff5681646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39658/0 (socket says 172.21.15.2:39658) 2023-11-25T04:08:41.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7ff56d2d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5680b2290 0x7ff56813b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f7faffff640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7f9800b980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0000b60 tx=0x7f7f980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1887ec5ba53dc169 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7efd0a0a3640 1 -- start start 2023-11-25T04:08:41.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f2c1359e640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140c4020 0x7f2c140c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f3c033fa640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bf40061c0 0x7f3bf4038590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f3c033fa640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bf4006bb0 0x7f3bf40db1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00ad600 con 0x7f7f98005180 2023-11-25T04:08:41.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f2c1259c640 1 -- 172.21.15.2:0/805613285 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140c4020 msgr2=0x7f2c140c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f3c023f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bf40061c0 0x7f3bf4038590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f3c023f8640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bf40061c0 0x7f3bf4038590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:54942/0 (socket says 172.21.15.2:54942) 2023-11-25T04:08:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/1806886282 shutdown_connections 2023-11-25T04:08:41.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/1806886282 wait complete. 2023-11-25T04:08:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f3c023f8640 1 -- 172.21.15.2:0/2370090142 learned_addr learned my addr 172.21.15.2:0/2370090142 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f3c01bf7640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bf4006bb0 0x7f3bf40db1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f2c1259c640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2c140c4020 0x7f2c140c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7f2c1259c640 1 -- 172.21.15.2:0/805613285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c140b0e50 msgr2=0x7f2c140c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f2c1259c640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2c140b0e50 0x7f2c140c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f2c1259c640 1 -- 172.21.15.2:0/805613285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04009400 con 0x7f2c140b2460 2023-11-25T04:08:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb00a9050 con 0x7f7f98005180 2023-11-25T04:08:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f7fadffb640 1 -- 172.21.15.2:0/3006148361 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb00ad9a0 con 0x7f7f98005180 2023-11-25T04:08:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f3c033fa640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3bf40e32d0 0x7f3bf4050950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7efd0a0a3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc006250 0x7efcfc0cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7efd0a0a3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcfc054130 0x7efcfc04df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.746+0000 7ff331a59640 1 -- start start 2023-11-25T04:08:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf404e700 con 0x7f3bf4006bb0 2023-11-25T04:08:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf40513b0 con 0x7f3bf40061c0 2023-11-25T04:08:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7efd0a0a3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc0e7510 0x7efcfc04e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff331a59640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff324006740 0x7ff3240d7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff331a59640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324050710 0x7ff3240d90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff331a59640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3240df7d0 0x7ff32404c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff331a59640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240d8c90 con 0x7ff324050710 2023-11-25T04:08:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff331a59640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240d8010 con 0x7ff324006740 2023-11-25T04:08:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff331a59640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240d82f0 con 0x7ff3240df7d0 2023-11-25T04:08:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff330a57640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff324006740 0x7ff3240d7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf404e040 con 0x7f3bf40e32d0 2023-11-25T04:08:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7f3c02bf9640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3bf40e32d0 0x7f3bf4050950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff32bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324050710 0x7ff3240d90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff32bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324050710 0x7ff3240d90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53202/0 (socket says 172.21.15.2:53202) 2023-11-25T04:08:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff32bfff640 1 -- 172.21.15.2:0/2744040018 learned_addr learned my addr 172.21.15.2:0/2744040018 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7efd088a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcfc054130 0x7efcfc04df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7efd088a0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcfc054130 0x7efcfc04df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:54960/0 (socket says 172.21.15.2:54960) 2023-11-25T04:08:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7efd098a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc0e7510 0x7efcfc04e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7efd098a2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc0e7510 0x7efcfc04e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53210/0 (socket says 172.21.15.2:53210) 2023-11-25T04:08:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7efd088a0640 1 -- 172.21.15.2:0/501929843 learned_addr learned my addr 172.21.15.2:0/501929843 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7efd090a1640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc006250 0x7efcfc0cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff331258640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3240df7d0 0x7ff32404c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.747+0000 7ff56e2d7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56814afe0 0x7ff56815ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff56ead8640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56813c5e0 con 0x7ff56814afe0 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff56ead8640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56813b960 con 0x7ff5680b2290 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff56ead8640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff56813bc40 con 0x7ff5680705d0 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff56dad6640 1 -- 172.21.15.2:0/2599735742 learned_addr learned my addr 172.21.15.2:0/2599735742 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff56dad6640 1 -- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5680b2290 msgr2=0x7ff56813b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff56dad6640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5680b2290 0x7ff56813b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff56dad6640 1 -- 172.21.15.2:0/2599735742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56814afe0 msgr2=0x7ff56815ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.748+0000 7ff56dad6640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff56814afe0 0x7ff56815ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7ff56dad6640 1 -- 172.21.15.2:0/2599735742 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff564009400 con 0x7ff5680705d0 2023-11-25T04:08:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0e2cc0 con 0x7efcfc0e7510 2023-11-25T04:08:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0dc8b0 con 0x7efcfc054130 2023-11-25T04:08:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcfc0e2700 con 0x7efcfc006250 2023-11-25T04:08:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7ff32bfff640 1 -- 172.21.15.2:0/2744040018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3240df7d0 msgr2=0x7ff32404c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7ff32bfff640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3240df7d0 0x7ff32404c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7ff32bfff640 1 -- 172.21.15.2:0/2744040018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff324006740 msgr2=0x7ff3240d7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7ff32bfff640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff324006740 0x7ff3240d7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7ff32bfff640 1 -- 172.21.15.2:0/2744040018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3240d85d0 con 0x7ff324050710 2023-11-25T04:08:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f2c1259c640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c140b2460 0x7f2c141520f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2c08033000 tx=0x7f2c080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f7fb5383640 1 -- 172.21.15.2:0/3006148361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 msgr2=0x7f7f9800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f7fb5383640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7f9800b980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0000b60 tx=0x7f7f980057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f7fb5383640 1 -- 172.21.15.2:0/3006148361 shutdown_connections 2023-11-25T04:08:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7ff56dad6640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680705d0 0x7ff5681646d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff55800be10 tx=0x7ff55800dbd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f7fb5383640 1 --2- 172.21.15.2:0/3006148361 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7f9800b980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f7fb5383640 1 -- 172.21.15.2:0/3006148361 >> 172.21.15.2:0/3006148361 conn(0x7f7fa8054c60 msgr2=0x7f7fa8055070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f3c023f8640 1 -- 172.21.15.2:0/2370090142 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3bf40e32d0 msgr2=0x7f3bf4050950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f2bfb7fe640 1 -- 172.21.15.2:0/805613285 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08032820 con 0x7f2c140b2460 2023-11-25T04:08:41.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7ffa4f59e640 1 Processor -- start 2023-11-25T04:08:41.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f3c023f8640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3bf40e32d0 0x7f3bf4050950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f2c191dc640 1 -- 172.21.15.2:0/805613285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c08009400 con 0x7f2c140b2460 2023-11-25T04:08:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7ffa4f59e640 1 -- start start 2023-11-25T04:08:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f3c023f8640 1 -- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bf4006bb0 msgr2=0x7f3bf40db1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f3c023f8640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3bf4006bb0 0x7f3bf40db1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f2bfb7fe640 1 -- 172.21.15.2:0/805613285 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c080329a0 con 0x7f2c140b2460 2023-11-25T04:08:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f2bfb7fe640 1 -- 172.21.15.2:0/805613285 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c08032d50 con 0x7f2c140b2460 2023-11-25T04:08:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f3c023f8640 1 -- 172.21.15.2:0/2370090142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0094d0 con 0x7f3bf40061c0 2023-11-25T04:08:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f2c191dc640 1 -- 172.21.15.2:0/805613285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c14152630 con 0x7f2c140b2460 2023-11-25T04:08:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7f7fb5383640 1 -- 172.21.15.2:0/3006148361 shutdown_connections 2023-11-25T04:08:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7f7fb5383640 1 -- 172.21.15.2:0/3006148361 wait complete. 2023-11-25T04:08:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7ff55e7fc640 1 -- 172.21.15.2:0/2599735742 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55800ddc0 con 0x7ff5680705d0 2023-11-25T04:08:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7efd090a1640 1 -- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcfc054130 msgr2=0x7efcfc04df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7efd090a1640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcfc054130 0x7efcfc04df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7efd090a1640 1 -- 172.21.15.2:0/501929843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc0e7510 msgr2=0x7efcfc04e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.749+0000 7efd090a1640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc0e7510 0x7efcfc04e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7efd090a1640 1 -- 172.21.15.2:0/501929843 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf40094d0 con 0x7efcfc006250 2023-11-25T04:08:41.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7efd098a2640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7efcfc0e7510 0x7efcfc04e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:41.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7efd090a1640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc006250 0x7efcfc0cf8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd0000b440 tx=0x7efd0000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7f7b8a1e3640 1 Processor -- start 2023-11-25T04:08:41.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7f3c023f8640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bf40061c0 0x7f3bf4038590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc066240 tx=0x7f3bfc068980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7ff56ead8640 1 -- 172.21.15.2:0/2599735742 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56813bf20 con 0x7ff5680705d0 2023-11-25T04:08:41.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7ff56ead8640 1 -- 172.21.15.2:0/2599735742 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56813b670 con 0x7ff5680705d0 2023-11-25T04:08:41.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7ff55e7fc640 1 -- 172.21.15.2:0/2599735742 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5580096a0 con 0x7ff5680705d0 2023-11-25T04:08:41.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7ff55e7fc640 1 -- 172.21.15.2:0/2599735742 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558009a30 con 0x7ff5680705d0 2023-11-25T04:08:41.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7efcf9ffb640 1 -- 172.21.15.2:0/501929843 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00011830 con 0x7efcfc006250 2023-11-25T04:08:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7f7b8a1e3640 1 -- start start 2023-11-25T04:08:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcfc0e29e0 con 0x7efcfc006250 2023-11-25T04:08:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7f3bf2ffd640 1 -- 172.21.15.2:0/2370090142 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc06bb50 con 0x7f3bf40061c0 2023-11-25T04:08:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7f3bf2ffd640 1 -- 172.21.15.2:0/2370090142 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bfc06bcb0 con 0x7f3bf40061c0 2023-11-25T04:08:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.751+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf404e320 con 0x7f3bf40061c0 2023-11-25T04:08:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.751+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf40db700 con 0x7f3bf40061c0 2023-11-25T04:08:41.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.751+0000 7f3bf2ffd640 1 -- 172.21.15.2:0/2370090142 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bfc06bea0 con 0x7f3bf40061c0 2023-11-25T04:08:41.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.751+0000 7ffa4f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5006ee20 0x7ffa501ee330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7efcf9ffb640 1 -- 172.21.15.2:0/501929843 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd00011990 con 0x7efcfc006250 2023-11-25T04:08:41.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.750+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcfc0cfe20 con 0x7efcfc006250 2023-11-25T04:08:41.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7b8a1e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74005180 0x7f7b7c0d2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7efcf9ffb640 1 -- 172.21.15.2:0/501929843 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd00011d40 con 0x7efcfc006250 2023-11-25T04:08:41.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7b8a1e3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b7c0d87f0 0x7f7b7c0d5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7b8a1e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b7c0d8c50 0x7f7b7c0e0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7b8a1e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0d3310 con 0x7f7b74005180 2023-11-25T04:08:41.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7b8a1e3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0dfa30 con 0x7f7b7c0d8c50 2023-11-25T04:08:41.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7b8a1e3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0dfd10 con 0x7f7b7c0d87f0 2023-11-25T04:08:41.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f2bf97fa640 1 -- 172.21.15.2:0/805613285 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bf4000fc0 con 0x7f2c140b2460 2023-11-25T04:08:41.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7efcef7fe640 1 -- 172.21.15.2:0/501929843 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efcfc051460 con 0x7efcfc006250 2023-11-25T04:08:41.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7fb5383640 1 Processor -- start 2023-11-25T04:08:41.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3be4000fc0 con 0x7f3bf40061c0 2023-11-25T04:08:41.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7ffa4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5006ee20 0x7ffa501ee330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7ff32bfff640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324050710 0x7ff3240d90b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c730 tx=0x7ff32000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7ffa4e59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5006ee20 0x7ffa501ee330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53224/0 (socket says 172.21.15.2:53224) 2023-11-25T04:08:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7ffa4f59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa50071700 0x7ffa50144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7ffa4f59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa500adec0 0x7ffa5006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7ffa4f59e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50141f90 con 0x7ffa5006ee20 2023-11-25T04:08:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7b837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74005180 0x7f7b7c0d2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7b837fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74005180 0x7f7b7c0d2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53226/0 (socket says 172.21.15.2:53226) 2023-11-25T04:08:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7ffa4f59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa50145230 con 0x7ffa50071700 2023-11-25T04:08:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7b837fe640 1 -- 172.21.15.2:0/3702997204 learned_addr learned my addr 172.21.15.2:0/3702997204 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7f7fb5383640 1 -- start start 2023-11-25T04:08:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7ffa4f59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa501f2d30 con 0x7ffa500adec0 2023-11-25T04:08:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.752+0000 7ffa4ed9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa500adec0 0x7ffa5006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ffa4ed9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa500adec0 0x7ffa5006d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39702/0 (socket says 172.21.15.2:39702) 2023-11-25T04:08:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ffa4ed9d640 1 -- 172.21.15.2:0/3602595781 learned_addr learned my addr 172.21.15.2:0/3602595781 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ff3297fa640 1 -- 172.21.15.2:0/2744040018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3200052d0 con 0x7ff324050710 2023-11-25T04:08:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3240d88b0 con 0x7ff324050710 2023-11-25T04:08:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32404cba0 con 0x7ff324050710 2023-11-25T04:08:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ff3297fa640 1 -- 172.21.15.2:0/2744040018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff320005430 con 0x7ff324050710 2023-11-25T04:08:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7f7b837fe640 1 -- 172.21.15.2:0/3702997204 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b7c0d87f0 msgr2=0x7f7b7c0d5c40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-25T04:08:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7f7b837fe640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b7c0d87f0 0x7f7b7c0d5c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7f7b837fe640 1 -- 172.21.15.2:0/3702997204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b7c0d8c50 msgr2=0x7f7b7c0e0ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-25T04:08:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7f7b837fe640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b7c0d8c50 0x7f7b7c0e0ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7f7b837fe640 1 -- 172.21.15.2:0/3702997204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c0dfff0 con 0x7f7b74005180 2023-11-25T04:08:41.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7f3bf2ffd640 1 -- 172.21.15.2:0/2370090142 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3bfc072400 con 0x7f3bf40061c0 2023-11-25T04:08:41.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ff3297fa640 1 -- 172.21.15.2:0/2744040018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3200052d0 con 0x7ff324050710 2023-11-25T04:08:41.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7f7b837fe640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74005180 0x7f7b7c0d2dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b78007340 tx=0x7f7b78007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ffa4e59c640 1 -- 172.21.15.2:0/3602595781 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa500adec0 msgr2=0x7ffa5006d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ffa4e59c640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa500adec0 0x7ffa5006d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ffa4e59c640 1 -- 172.21.15.2:0/3602595781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa50071700 msgr2=0x7ffa50144cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-25T04:08:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ffa4e59c640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa50071700 0x7ffa50144cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7ffa4e59c640 1 -- 172.21.15.2:0/3602595781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4000b580 con 0x7ffa5006ee20 2023-11-25T04:08:41.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.753+0000 7f3bf2ffd640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3be006af10 0x7f3be006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7f2bfb7fe640 1 -- 172.21.15.2:0/805613285 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c0804e440 con 0x7f2c140b2460 2023-11-25T04:08:41.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7efcf9ffb640 1 -- 172.21.15.2:0/501929843 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efd0001b460 con 0x7efcfc006250 2023-11-25T04:08:41.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7f7fb5383640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7fa804bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7ffa4e59c640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5006ee20 0x7ffa501ee330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa40006ca0 tx=0x7ffa4000ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7f3c01bf7640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3be006af10 0x7f3be006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff30c000fc0 con 0x7ff324050710 2023-11-25T04:08:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7f7fb5383640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7fa804ac50 0x7f7fa804b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7f7fb5383640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fa80cb970 0x7f7fa80cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7f7fb5383640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa804a7c0 con 0x7f7f98005180 2023-11-25T04:08:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7f7faeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7fa804bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7efcf9ffb640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efce806af10 0x7efce806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.754+0000 7f7faffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fa80cb970 0x7f7fa80cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7faffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fa80cb970 0x7f7fa80cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:54994/0 (socket says 172.21.15.2:54994) 2023-11-25T04:08:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7ffa3effd640 1 -- 172.21.15.2:0/3602595781 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40004030 con 0x7ffa5006ee20 2023-11-25T04:08:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7efcf9ffb640 1 -- 172.21.15.2:0/501929843 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd00089400 con 0x7efcfc006250 2023-11-25T04:08:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7faffff640 1 -- 172.21.15.2:0/1219378840 learned_addr learned my addr 172.21.15.2:0/1219378840 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7faeffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7fa804bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53242/0 (socket says 172.21.15.2:53242) 2023-11-25T04:08:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7ffa4f59e640 1 -- 172.21.15.2:0/3602595781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4400d8a0 con 0x7ffa5006ee20 2023-11-25T04:08:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7b6ffff640 1 -- 172.21.15.2:0/3702997204 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800f9c0 con 0x7f7b74005180 2023-11-25T04:08:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7efcf9ffb640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:6800/2128834759,v1:172.21.15.66:6801/2128834759] conn(0x7efce8073130 0x7efce8075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f3c01bf7640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3be006af10 0x7f3be006d3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bec036000 tx=0x7f3bec03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7ff55e7fc640 1 -- 172.21.15.2:0/2599735742 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff558009b90 con 0x7ff5680705d0 2023-11-25T04:08:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7efcf9ffb640 1 -- 172.21.15.2:0/501929843 --> [v2:172.21.15.66:6800/2128834759,v1:172.21.15.66:6801/2128834759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efce8075c00 con 0x7efce8073130 2023-11-25T04:08:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7b6ffff640 1 -- 172.21.15.2:0/3702997204 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7800fb20 con 0x7f7b74005180 2023-11-25T04:08:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7efcf9ffb640 1 -- 172.21.15.2:0/501929843 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd00089730 con 0x7efcfc006250 2023-11-25T04:08:41.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7ffa4f59e640 1 -- 172.21.15.2:0/3602595781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa501f2490 con 0x7ffa5006ee20 2023-11-25T04:08:41.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c0e02d0 con 0x7f7b74005180 2023-11-25T04:08:41.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7efd088a0640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efce806af10 0x7efce806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7fb5383640 1 -- 172.21.15.2:0/1219378840 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80cded0 con 0x7f7fa80cb970 2023-11-25T04:08:41.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c0df5c0 con 0x7f7b74005180 2023-11-25T04:08:41.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7fae7fc640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7fa804ac50 0x7f7fa804b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f3bf2ffd640 1 -- 172.21.15.2:0/2370090142 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bfc1030e0 con 0x7f3bf40061c0 2023-11-25T04:08:41.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f7fb5383640 1 -- 172.21.15.2:0/1219378840 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa804a170 con 0x7f7fa804ac50 2023-11-25T04:08:41.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7f3bf2ffd640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6816/2090563035,v1:172.21.15.2:6817/2090563035] conn(0x7f3be00730b0 0x7f3be00754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7ff56ead8640 1 -- 172.21.15.2:0/2599735742 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff550000fc0 con 0x7ff5680705d0 2023-11-25T04:08:41.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7ff55e7fc640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff54c06af10 0x7ff54c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.755+0000 7efd098a2640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:6800/2128834759,v1:172.21.15.66:6801/2128834759] conn(0x7efce8073130 0x7efce8075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7efd088a0640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efce806af10 0x7efce806d3d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd04079db0 tx=0x7efd040682d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7efd098a2640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:6800/2128834759,v1:172.21.15.66:6801/2128834759] conn(0x7efce8073130 0x7efce8075550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7f3c02bf9640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6816/2090563035,v1:172.21.15.2:6817/2090563035] conn(0x7f3be00730b0 0x7f3be00754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7f3bf2ffd640 1 -- 172.21.15.2:0/2370090142 --> [v2:172.21.15.2:6816/2090563035,v1:172.21.15.2:6817/2090563035] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3be0075b80 con 0x7f3be00730b0 2023-11-25T04:08:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7f3bf2ffd640 1 -- 172.21.15.2:0/2370090142 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bfc1056c0 con 0x7f3bf40061c0 2023-11-25T04:08:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7ff56d2d5640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff54c06af10 0x7ff54c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7f7b6ffff640 1 -- 172.21.15.2:0/3702997204 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800fe90 con 0x7f7b74005180 2023-11-25T04:08:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7f2bfb7fe640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2c0006ae40 0x7f2c0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7f2bfb7fe640 1 -- 172.21.15.2:0/805613285 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c080ab6c0 con 0x7f2c140b2460 2023-11-25T04:08:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7f2bfb7fe640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6820/2242650320,v1:172.21.15.2:6822/2242650320] conn(0x7f2c00072fe0 0x7f2c00075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7f2c12d9d640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2c0006ae40 0x7f2c0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7f2bfb7fe640 1 -- 172.21.15.2:0/805613285 --> [v2:172.21.15.2:6820/2242650320,v1:172.21.15.2:6822/2242650320] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c00075ab0 con 0x7f2c00072fe0 2023-11-25T04:08:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7ff3297fa640 1 -- 172.21.15.2:0/2744040018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff32000a640 con 0x7ff324050710 2023-11-25T04:08:41.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7f2bfb7fe640 1 -- 172.21.15.2:0/805613285 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c08076700 con 0x7f2c140b2460 2023-11-25T04:08:41.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.756+0000 7ffa3cff9640 1 -- 172.21.15.2:0/3602595781 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa500b2c40 con 0x7ffa5006ee20 2023-11-25T04:08:41.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ffa3effd640 1 -- 172.21.15.2:0/3602595781 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa40004190 con 0x7ffa5006ee20 2023-11-25T04:08:41.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff55e7fc640 1 -- 172.21.15.2:0/2599735742 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff55809a9f0 con 0x7ff5680705d0 2023-11-25T04:08:41.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff56d2d5640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff54c06af10 0x7ff54c06d3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff564035000 tx=0x7ff564008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7efcf9ffb640 1 -- 172.21.15.2:0/501929843 <== osd.5 v2:172.21.15.66:6800/2128834759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efce8075c00 con 0x7efce8073130 2023-11-25T04:08:41.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff55e7fc640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:6824/783473334,v1:172.21.15.66:6825/783473334] conn(0x7ff54c0730b0 0x7ff54c0754d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff55e7fc640 1 -- 172.21.15.2:0/2599735742 --> [v2:172.21.15.66:6824/783473334,v1:172.21.15.66:6825/783473334] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff54c075b80 con 0x7ff54c0730b0 2023-11-25T04:08:41.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff55e7fc640 1 -- 172.21.15.2:0/2599735742 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5580658b0 con 0x7ff5680705d0 2023-11-25T04:08:41.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b7c0dfe80 con 0x7f7b74005180 2023-11-25T04:08:41.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ffa3effd640 1 -- 172.21.15.2:0/3602595781 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa40004500 con 0x7ffa5006ee20 2023-11-25T04:08:41.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff56e2d7640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:6824/783473334,v1:172.21.15.66:6825/783473334] conn(0x7ff54c0730b0 0x7ff54c0754d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7f2c12d9d640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2c0006ae40 0x7f2c0006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0013e0 tx=0x7f2c0c005ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f7b6ffff640 1 -- 172.21.15.2:0/3702997204 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b7801d460 con 0x7f7b74005180 2023-11-25T04:08:41.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f3c02bf9640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6816/2090563035,v1:172.21.15.2:6817/2090563035] conn(0x7f3be00730b0 0x7f3be00754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f2c1359e640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6820/2242650320,v1:172.21.15.2:6822/2242650320] conn(0x7f2c00072fe0 0x7f2c00075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f7faeffd640 1 -- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7fa804ac50 msgr2=0x7f7fa804b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f7faeffd640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7fa804ac50 0x7f7fa804b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f7faeffd640 1 -- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fa80cb970 msgr2=0x7f7fa80cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f7faeffd640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7fa80cb970 0x7f7fa80cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f7faeffd640 1 -- 172.21.15.2:0/1219378840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa804a450 con 0x7f7f98005180 2023-11-25T04:08:41.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff3297fa640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff31006af00 0x7ff31006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff3297fa640 1 -- 172.21.15.2:0/2744040018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff320088c60 con 0x7ff324050710 2023-11-25T04:08:41.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff3297fa640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6800/1139472044,v1:172.21.15.2:6801/1139472044] conn(0x7ff3100730a0 0x7ff3100754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff3297fa640 1 -- 172.21.15.2:0/2744040018 --> [v2:172.21.15.2:6800/1139472044,v1:172.21.15.2:6801/1139472044] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff310075b70 con 0x7ff3100730a0 2023-11-25T04:08:41.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.757+0000 7ff3297fa640 1 -- 172.21.15.2:0/2744040018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3200052d0 con 0x7ff324050710 2023-11-25T04:08:41.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7ff330a57640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff31006af00 0x7ff31006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7ff330a57640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff31006af00 0x7ff31006d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff318009b80 tx=0x7ff318008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f7faeffd640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7fa804bd30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000f530 tx=0x7f7fa000f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7ff331258640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6800/1139472044,v1:172.21.15.2:6801/1139472044] conn(0x7ff3100730a0 0x7ff3100754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7b6ffff640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7b6806af40 0x7f7b6806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7b82ffd640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7b6806af40 0x7f7b6806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7b6ffff640 1 -- 172.21.15.2:0/3702997204 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b780897e0 con 0x7f7b74005180 2023-11-25T04:08:41.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f3bf2ffd640 1 -- 172.21.15.2:0/2370090142 <== osd.2 v2:172.21.15.2:6816/2090563035 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3be0075b80 con 0x7f3be00730b0 2023-11-25T04:08:41.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f2c1359e640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6820/2242650320,v1:172.21.15.2:6822/2242650320] conn(0x7f2c00072fe0 0x7f2c00075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.758+0000 7f7f977fe640 1 -- 172.21.15.2:0/1219378840 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0004440 con 0x7f7f98005180 2023-11-25T04:08:41.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7f977fe640 1 -- 172.21.15.2:0/1219378840 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa000c070 con 0x7f7f98005180 2023-11-25T04:08:41.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7f977fe640 1 -- 172.21.15.2:0/1219378840 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa0003830 con 0x7f7f98005180 2023-11-25T04:08:41.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7ffa3effd640 1 -- 172.21.15.2:0/3602595781 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa40005990 con 0x7ffa5006ee20 2023-11-25T04:08:41.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7ff56e2d7640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:6824/783473334,v1:172.21.15.66:6825/783473334] conn(0x7ff54c0730b0 0x7ff54c0754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7fb5383640 1 -- 172.21.15.2:0/1219378840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa804c270 con 0x7f7f98005180 2023-11-25T04:08:41.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7b6ffff640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6808/320707223,v1:172.21.15.2:6809/320707223] conn(0x7f7b68072ff0 0x7f7b68075410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7b6ffff640 1 -- 172.21.15.2:0/3702997204 --> [v2:172.21.15.2:6808/320707223,v1:172.21.15.2:6809/320707223] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b68075ac0 con 0x7f7b68072ff0 2023-11-25T04:08:41.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7b6ffff640 1 -- 172.21.15.2:0/3702997204 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b7808be00 con 0x7f7b74005180 2023-11-25T04:08:41.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7f7b82ffd640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7b6806af40 0x7f7b6806d400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0dc430 tx=0x7f7b70009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7f7b83fff640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6808/320707223,v1:172.21.15.2:6809/320707223] conn(0x7f7b68072ff0 0x7f7b68075410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.759+0000 7f7fb5383640 1 -- 172.21.15.2:0/1219378840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa80d1360 con 0x7f7f98005180 2023-11-25T04:08:41.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7ffa3effd640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa3006ae40 0x7ffa3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7ffa3effd640 1 -- 172.21.15.2:0/3602595781 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa4008a660 con 0x7ffa5006ee20 2023-11-25T04:08:41.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7ffa3effd640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.66:6816/3662709756,v1:172.21.15.66:6817/3662709756] conn(0x7ffa30073060 0x7ffa30075480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7ffa4dd9b640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa3006ae40 0x7ffa3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7ffa3effd640 1 -- 172.21.15.2:0/3602595781 --> [v2:172.21.15.66:6816/3662709756,v1:172.21.15.66:6817/3662709756] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa30075b30 con 0x7ffa30073060 2023-11-25T04:08:41.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7ffa3effd640 1 -- 172.21.15.2:0/3602595781 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa4008aa10 con 0x7ffa5006ee20 2023-11-25T04:08:41.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7ffa4ed9d640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.66:6816/3662709756,v1:172.21.15.66:6817/3662709756] conn(0x7ffa30073060 0x7ffa30075480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7ff331258640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6800/1139472044,v1:172.21.15.2:6801/1139472044] conn(0x7ff3100730a0 0x7ff3100754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.761+0000 7ffa4dd9b640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa3006ae40 0x7ffa3006d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa44039000 tx=0x7ffa44034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.761+0000 7ffa4ed9d640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.66:6816/3662709756,v1:172.21.15.66:6817/3662709756] conn(0x7ffa30073060 0x7ffa30075480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.761+0000 7ff55e7fc640 1 -- 172.21.15.2:0/2599735742 <== osd.4 v2:172.21.15.66:6824/783473334 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff54c075b80 con 0x7ff54c0730b0 2023-11-25T04:08:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.762+0000 7ff3297fa640 1 -- 172.21.15.2:0/2744040018 <== osd.0 v2:172.21.15.2:6800/1139472044 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff310075b70 con 0x7ff3100730a0 2023-11-25T04:08:41.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.762+0000 7ffa3effd640 1 -- 172.21.15.2:0/3602595781 <== osd.7 v2:172.21.15.66:6816/3662709756 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffa30075b30 con 0x7ffa30073060 2023-11-25T04:08:41.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.762+0000 7f7b83fff640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6808/320707223,v1:172.21.15.2:6809/320707223] conn(0x7f7b68072ff0 0x7f7b68075410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.760+0000 7f2bfb7fe640 1 -- 172.21.15.2:0/805613285 <== osd.3 v2:172.21.15.2:6820/2242650320 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2c00075ab0 con 0x7f2c00072fe0 2023-11-25T04:08:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.761+0000 7f7f957fa640 1 -- 172.21.15.2:0/1219378840 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7f88000fc0 con 0x7f7f98005180 2023-11-25T04:08:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.762+0000 7f7f977fe640 1 -- 172.21.15.2:0/1219378840 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fa0003990 con 0x7f7f98005180 2023-11-25T04:08:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.763+0000 7f7f977fe640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f9c06ae40 0x7f7f9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.763+0000 7f7f977fe640 1 -- 172.21.15.2:0/1219378840 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fa0089b20 con 0x7f7f98005180 2023-11-25T04:08:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.763+0000 7f7f977fe640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:6805/1011790605,v1:172.21.15.66:6807/1011790605] conn(0x7f7f9c072fe0 0x7f7f9c075400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.763+0000 7f7f977fe640 1 -- 172.21.15.2:0/1219378840 --> [v2:172.21.15.66:6805/1011790605,v1:172.21.15.66:6807/1011790605] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f9c079ec0 con 0x7f7f9c072fe0 2023-11-25T04:08:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.763+0000 7f7f977fe640 1 -- 172.21.15.2:0/1219378840 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fa008e2a0 con 0x7f7f98005180 2023-11-25T04:08:41.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.763+0000 7f7fae7fc640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f9c06ae40 0x7f7f9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.763+0000 7f7faffff640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:6805/1011790605,v1:172.21.15.66:6807/1011790605] conn(0x7f7f9c072fe0 0x7f7f9c075400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:41.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.764+0000 7f7b6ffff640 1 -- 172.21.15.2:0/3702997204 <== osd.1 v2:172.21.15.2:6808/320707223 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7b68075ac0 con 0x7f7b68072ff0 2023-11-25T04:08:41.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.764+0000 7f7fae7fc640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f9c06ae40 0x7f7f9c06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400d2c0 tx=0x7f7fa4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.765+0000 7f7faffff640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:6805/1011790605,v1:172.21.15.66:6807/1011790605] conn(0x7f7f9c072fe0 0x7f7f9c075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:41.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.766+0000 7f7f977fe640 1 -- 172.21.15.2:0/1219378840 <== osd.6 v2:172.21.15.66:6805/1011790605 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7f9c079ec0 con 0x7f7f9c072fe0 2023-11-25T04:08:41.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.789+0000 7efcef7fe640 1 -- 172.21.15.2:0/501929843 --> [v2:172.21.15.66:6800/2128834759,v1:172.21.15.66:6801/2128834759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efcfc051180 con 0x7efce8073130 2023-11-25T04:08:41.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.790+0000 7efcf9ffb640 1 -- 172.21.15.2:0/501929843 <== osd.5 v2:172.21.15.66:6800/2128834759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efcf40314c0 con 0x7efce8073130 2023-11-25T04:08:41.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:6800/2128834759,v1:172.21.15.66:6801/2128834759] conn(0x7efce8073130 msgr2=0x7efce8075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7efd0a0a3640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:6800/2128834759,v1:172.21.15.66:6801/2128834759] conn(0x7efce8073130 0x7efce8075550 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7ff56ead8640 1 -- 172.21.15.2:0/2599735742 --> [v2:172.21.15.66:6824/783473334,v1:172.21.15.66:6825/783473334] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff550002ca0 con 0x7ff54c0730b0 2023-11-25T04:08:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efce806af10 msgr2=0x7efce806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7efd0a0a3640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7efce806af10 0x7efce806d3d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd04079db0 tx=0x7efd040682d0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc006250 msgr2=0x7efcfc0cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7efd0a0a3640 1 --2- 172.21.15.2:0/501929843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcfc006250 0x7efcfc0cf8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efd0000b440 tx=0x7efd0000b900 comp rx=0 tx=0).stop 2023-11-25T04:08:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7efd098a2640 1 -- 172.21.15.2:0/501929843 reap_dead start 2023-11-25T04:08:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 shutdown_connections 2023-11-25T04:08:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.791+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 >> 172.21.15.2:0/501929843 conn(0x7efcfc055310 msgr2=0x7efcfc03a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.792+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 shutdown_connections 2023-11-25T04:08:41.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.792+0000 7efd0a0a3640 1 -- 172.21.15.2:0/501929843 wait complete. 2023-11-25T04:08:41.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.792+0000 7ff55e7fc640 1 -- 172.21.15.2:0/2599735742 <== osd.4 v2:172.21.15.66:6824/783473334 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff550002ca0 con 0x7ff54c0730b0 2023-11-25T04:08:41.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.793+0000 7ff54bfff640 1 -- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:6824/783473334,v1:172.21.15.66:6825/783473334] conn(0x7ff54c0730b0 msgr2=0x7ff54c0754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.793+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 --> [v2:172.21.15.2:6816/2090563035,v1:172.21.15.2:6817/2090563035] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3be4002cb0 con 0x7f3be00730b0 2023-11-25T04:08:41.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.793+0000 7ff54bfff640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:6824/783473334,v1:172.21.15.66:6825/783473334] conn(0x7ff54c0730b0 0x7ff54c0754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ffa3cff9640 1 -- 172.21.15.2:0/3602595781 --> [v2:172.21.15.66:6816/3662709756,v1:172.21.15.66:6817/3662709756] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffa5004e840 con 0x7ffa30073060 2023-11-25T04:08:41.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ff54bfff640 1 -- 172.21.15.2:0/2599735742 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff54c06af10 msgr2=0x7ff54c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ff54bfff640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff54c06af10 0x7ff54c06d3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff564035000 tx=0x7ff564008030 comp rx=0 tx=0).stop 2023-11-25T04:08:41.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ff54bfff640 1 -- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680705d0 msgr2=0x7ff5681646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ff54bfff640 1 --2- 172.21.15.2:0/2599735742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5680705d0 0x7ff5681646d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff55800be10 tx=0x7ff55800dbd0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ff56e2d7640 1 -- 172.21.15.2:0/2599735742 reap_dead start 2023-11-25T04:08:41.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ff54bfff640 1 -- 172.21.15.2:0/2599735742 shutdown_connections 2023-11-25T04:08:41.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7f3bf2ffd640 1 -- 172.21.15.2:0/2370090142 <== osd.2 v2:172.21.15.2:6816/2090563035 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3be4002cb0 con 0x7f3be00730b0 2023-11-25T04:08:41.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ff54bfff640 1 -- 172.21.15.2:0/2599735742 >> 172.21.15.2:0/2599735742 conn(0x7ff56806a6b0 msgr2=0x7ff5680afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ffa3effd640 1 -- 172.21.15.2:0/3602595781 <== osd.7 v2:172.21.15.66:6816/3662709756 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffa5004e840 con 0x7ffa30073060 2023-11-25T04:08:41.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7f2bf97fa640 1 -- 172.21.15.2:0/805613285 --> [v2:172.21.15.2:6820/2242650320,v1:172.21.15.2:6822/2242650320] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bf4002cb0 con 0x7f2c00072fe0 2023-11-25T04:08:41.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.794+0000 7ff54bfff640 1 -- 172.21.15.2:0/2599735742 shutdown_connections 2023-11-25T04:08:41.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7ff54bfff640 1 -- 172.21.15.2:0/2599735742 wait complete. 2023-11-25T04:08:41.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6816/2090563035,v1:172.21.15.2:6817/2090563035] conn(0x7f3be00730b0 msgr2=0x7f3be00754d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f3c033fa640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6816/2090563035,v1:172.21.15.2:6817/2090563035] conn(0x7f3be00730b0 0x7f3be00754d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3be006af10 msgr2=0x7f3be006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f3c033fa640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3be006af10 0x7f3be006d3d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3bec036000 tx=0x7f3bec03d040 comp rx=0 tx=0).stop 2023-11-25T04:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bf40061c0 msgr2=0x7f3bf4038590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f3c033fa640 1 --2- 172.21.15.2:0/2370090142 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3bf40061c0 0x7f3bf4038590 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc066240 tx=0x7f3bfc068980 comp rx=0 tx=0).stop 2023-11-25T04:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f3c02bf9640 1 -- 172.21.15.2:0/2370090142 reap_dead start 2023-11-25T04:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 shutdown_connections 2023-11-25T04:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 >> 172.21.15.2:0/2370090142 conn(0x7f3bf4058ec0 msgr2=0x7f3bf403b7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7f2bfb7fe640 1 -- 172.21.15.2:0/805613285 <== osd.3 v2:172.21.15.2:6820/2242650320 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2bf4002cb0 con 0x7f2c00072fe0 2023-11-25T04:08:41.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7ffa3cff9640 1 -- 172.21.15.2:0/3602595781 >> [v2:172.21.15.66:6816/3662709756,v1:172.21.15.66:6817/3662709756] conn(0x7ffa30073060 msgr2=0x7ffa30075480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7ffa3cff9640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.66:6816/3662709756,v1:172.21.15.66:6817/3662709756] conn(0x7ffa30073060 0x7ffa30075480 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7ffa3cff9640 1 -- 172.21.15.2:0/3602595781 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa3006ae40 msgr2=0x7ffa3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7ffa3cff9640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa3006ae40 0x7ffa3006d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ffa44039000 tx=0x7ffa44034000 comp rx=0 tx=0).stop 2023-11-25T04:08:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7ffa3cff9640 1 -- 172.21.15.2:0/3602595781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5006ee20 msgr2=0x7ffa501ee330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7ffa3cff9640 1 --2- 172.21.15.2:0/3602595781 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa5006ee20 0x7ffa501ee330 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ffa40006ca0 tx=0x7ffa4000ff60 comp rx=0 tx=0).stop 2023-11-25T04:08:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7ffa4ed9d640 1 -- 172.21.15.2:0/3602595781 reap_dead start 2023-11-25T04:08:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.795+0000 7ffa3cff9640 1 -- 172.21.15.2:0/3602595781 shutdown_connections 2023-11-25T04:08:41.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7ffa3cff9640 1 -- 172.21.15.2:0/3602595781 >> 172.21.15.2:0/3602595781 conn(0x7ffa500b1940 msgr2=0x7ffa50157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 shutdown_connections 2023-11-25T04:08:41.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2bf97fa640 1 -- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6820/2242650320,v1:172.21.15.2:6822/2242650320] conn(0x7f2c00072fe0 msgr2=0x7f2c00075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2bf97fa640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6820/2242650320,v1:172.21.15.2:6822/2242650320] conn(0x7f2c00072fe0 0x7f2c00075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7ffa3cff9640 1 -- 172.21.15.2:0/3602595781 shutdown_connections 2023-11-25T04:08:41.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7ffa3cff9640 1 -- 172.21.15.2:0/3602595781 wait complete. 2023-11-25T04:08:41.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f3c033fa640 1 -- 172.21.15.2:0/2370090142 wait complete. 2023-11-25T04:08:41.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2bf97fa640 1 -- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2c0006ae40 msgr2=0x7f2c0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2bf97fa640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2c0006ae40 0x7f2c0006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0013e0 tx=0x7f2c0c005ba0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2bf97fa640 1 -- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c140b2460 msgr2=0x7f2c141520f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2bf97fa640 1 --2- 172.21.15.2:0/805613285 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2c140b2460 0x7f2c141520f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2c08033000 tx=0x7f2c080046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2c1359e640 1 -- 172.21.15.2:0/805613285 reap_dead start 2023-11-25T04:08:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2bf97fa640 1 -- 172.21.15.2:0/805613285 shutdown_connections 2023-11-25T04:08:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2bf97fa640 1 -- 172.21.15.2:0/805613285 >> 172.21.15.2:0/805613285 conn(0x7f2c140d0de0 msgr2=0x7f2c140ae9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.796+0000 7f2bf97fa640 1 -- 172.21.15.2:0/805613285 shutdown_connections 2023-11-25T04:08:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.797+0000 7f2bf97fa640 1 -- 172.21.15.2:0/805613285 wait complete. 2023-11-25T04:08:41.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.797+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 --> [v2:172.21.15.2:6800/1139472044,v1:172.21.15.2:6801/1139472044] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff30c002cb0 con 0x7ff3100730a0 2023-11-25T04:08:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.797+0000 7f7f957fa640 1 -- 172.21.15.2:0/1219378840 --> [v2:172.21.15.66:6805/1011790605,v1:172.21.15.66:6807/1011790605] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7f88002cb0 con 0x7f7f9c072fe0 2023-11-25T04:08:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.797+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 --> [v2:172.21.15.2:6808/320707223,v1:172.21.15.2:6809/320707223] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b7c04e780 con 0x7f7b68072ff0 2023-11-25T04:08:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.798+0000 7ff3297fa640 1 -- 172.21.15.2:0/2744040018 <== osd.0 v2:172.21.15.2:6800/1139472044 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff30c002cb0 con 0x7ff3100730a0 2023-11-25T04:08:41.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.798+0000 7f7b6ffff640 1 -- 172.21.15.2:0/3702997204 <== osd.1 v2:172.21.15.2:6808/320707223 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7b7c04e780 con 0x7f7b68072ff0 2023-11-25T04:08:41.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.798+0000 7f7f977fe640 1 -- 172.21.15.2:0/1219378840 <== osd.6 v2:172.21.15.66:6805/1011790605 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f88002cb0 con 0x7f7f9c072fe0 2023-11-25T04:08:41.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7f7f957fa640 1 -- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:6805/1011790605,v1:172.21.15.66:6807/1011790605] conn(0x7f7f9c072fe0 msgr2=0x7f7f9c075400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7f7f957fa640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.66:6805/1011790605,v1:172.21.15.66:6807/1011790605] conn(0x7f7f9c072fe0 0x7f7f9c075400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6800/1139472044,v1:172.21.15.2:6801/1139472044] conn(0x7ff3100730a0 msgr2=0x7ff3100754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6808/320707223,v1:172.21.15.2:6809/320707223] conn(0x7f7b68072ff0 msgr2=0x7f7b68075410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7ff331a59640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6800/1139472044,v1:172.21.15.2:6801/1139472044] conn(0x7ff3100730a0 0x7ff3100754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7f7b8a1e3640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6808/320707223,v1:172.21.15.2:6809/320707223] conn(0x7f7b68072ff0 0x7f7b68075410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff31006af00 msgr2=0x7ff31006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7ff331a59640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff31006af00 0x7ff31006d3c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff318009b80 tx=0x7ff318008040 comp rx=0 tx=0).stop 2023-11-25T04:08:41.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324050710 msgr2=0x7ff3240d90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.799+0000 7ff331a59640 1 --2- 172.21.15.2:0/2744040018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff324050710 0x7ff3240d90b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff32000c730 tx=0x7ff32000cbf0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7ff331258640 1 -- 172.21.15.2:0/2744040018 reap_dead start 2023-11-25T04:08:41.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7f957fa640 1 -- 172.21.15.2:0/1219378840 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f9c06ae40 msgr2=0x7f7f9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7f957fa640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f9c06ae40 0x7f7f9c06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400d2c0 tx=0x7f7fa4008040 comp rx=0 tx=0).stop 2023-11-25T04:08:41.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7f957fa640 1 -- 172.21.15.2:0/1219378840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 msgr2=0x7f7fa804bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7f957fa640 1 --2- 172.21.15.2:0/1219378840 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f98005180 0x7f7fa804bd30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000f530 tx=0x7f7fa000f9f0 comp rx=0 tx=0).stop 2023-11-25T04:08:41.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7faffff640 1 -- 172.21.15.2:0/1219378840 reap_dead start 2023-11-25T04:08:41.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7f957fa640 1 -- 172.21.15.2:0/1219378840 shutdown_connections 2023-11-25T04:08:41.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7f957fa640 1 -- 172.21.15.2:0/1219378840 >> 172.21.15.2:0/1219378840 conn(0x7f7fa8054c60 msgr2=0x7f7fa80e0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7b6806af40 msgr2=0x7f7b6806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7b8a1e3640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7b6806af40 0x7f7b6806d400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7b7c0dc430 tx=0x7f7b70009190 comp rx=0 tx=0).stop 2023-11-25T04:08:41.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74005180 msgr2=0x7f7b7c0d2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:41.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7b8a1e3640 1 --2- 172.21.15.2:0/3702997204 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7b74005180 0x7f7b7c0d2dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b78007340 tx=0x7f7b78007740 comp rx=0 tx=0).stop 2023-11-25T04:08:41.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7b83fff640 1 -- 172.21.15.2:0/3702997204 reap_dead start 2023-11-25T04:08:41.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 shutdown_connections 2023-11-25T04:08:41.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 >> 172.21.15.2:0/3702997204 conn(0x7f7b7c009f70 msgr2=0x7f7b7c0344d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 shutdown_connections 2023-11-25T04:08:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 >> 172.21.15.2:0/2744040018 conn(0x7ff324009f80 msgr2=0x7ff324004b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.800+0000 7f7f957fa640 1 -- 172.21.15.2:0/1219378840 shutdown_connections 2023-11-25T04:08:41.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.801+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 shutdown_connections 2023-11-25T04:08:41.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.801+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 shutdown_connections 2023-11-25T04:08:41.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.801+0000 7ff331a59640 1 -- 172.21.15.2:0/2744040018 wait complete. 2023-11-25T04:08:41.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.801+0000 7f7b8a1e3640 1 -- 172.21.15.2:0/3702997204 wait complete. 2023-11-25T04:08:41.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:41.801+0000 7f7f957fa640 1 -- 172.21.15.2:0/1219378840 wait complete. 2023-11-25T04:08:41.879 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-25T04:08:41.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-25T04:08:41.880 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-25T04:08:41.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-25T04:08:41.881 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-25T04:08:41.882 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-25T04:08:41.882 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-25T04:08:41.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-25T04:08:41.883 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-25T04:08:41.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-25T04:08:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-25T04:08:41.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-25T04:08:41.885 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-25T04:08:41.886 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-25T04:08:41.886 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-25T04:08:41.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-25T04:08:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.101+0000 7fc1d0f4c640 1 Processor -- start 2023-11-25T04:08:42.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.101+0000 7fc1d0f4c640 1 -- start start 2023-11-25T04:08:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.101+0000 7f1135483640 1 Processor -- start 2023-11-25T04:08:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.101+0000 7f1135483640 1 -- start start 2023-11-25T04:08:42.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7f1135483640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f112803a860 0x7f112804fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7fc1d0f4c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1c4006250 0x7fc1c40066b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7fc1d0f4c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1c4053120 0x7fc1c4053590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7fc1d0f4c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c4006bf0 con 0x7fc1c40e7510 2023-11-25T04:08:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7fc1d0f4c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c40e78f0 con 0x7fc1c4053120 2023-11-25T04:08:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7fc1d0f4c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c4034a40 con 0x7fc1c4006250 2023-11-25T04:08:42.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7f1135483640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11280500e0 0x7f11280380e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7f1135483640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11280504c0 con 0x7f11280e26b0 2023-11-25T04:08:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7fc1c9d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1c4006250 0x7fc1c40066b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7fc1c9d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1c4006250 0x7fc1c40066b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:54996/0 (socket says 172.21.15.2:54996) 2023-11-25T04:08:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7fc1c9d9b640 1 -- 172.21.15.2:0/2608791674 learned_addr learned my addr 172.21.15.2:0/2608791674 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.101+0000 7f593f59e640 1 Processor -- start 2023-11-25T04:08:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7fc1c9d9b640 1 -- 172.21.15.2:0/2608791674 >> v2:172.21.15.2:3300/0 conn(0x7fc1c4053120 msgr2=0x7fc1c4053590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7fc1cad9d640 1 --2- 172.21.15.2:0/2608791674 >> v2:172.21.15.2:3300/0 conn(0x7fc1c4053120 0x7fc1c4053590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.101+0000 7f593f59e640 1 -- start start 2023-11-25T04:08:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7f593f59e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f594006da70 0x7f594015a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7f593f59e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594015a8a0 con 0x7f59400ce1e0 2023-11-25T04:08:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7f593f59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f594006de50 con 0x7f59400cd130 2023-11-25T04:08:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7f593f59e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59400b2f30 con 0x7f594006da70 2023-11-25T04:08:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7f593dd9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f59400ce1e0 0x7f59400cca20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33042/0 (socket says 172.21.15.2:33042) 2023-11-25T04:08:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7f593dd9b640 1 -- 172.21.15.2:0/2736276810 learned_addr learned my addr 172.21.15.2:0/2736276810 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:42.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7f593e59c640 1 --2- 172.21.15.2:0/2736276810 >> v2:172.21.15.2:3300/0 conn(0x7f594006da70 0x7f594015a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7fc1c9d9b640 1 --2- 172.21.15.2:0/2608791674 >> v2:172.21.15.2:3300/0 conn(0x7fc1c4053120 0x7fc1c4053590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7fc1c9d9b640 1 -- 172.21.15.2:0/2608791674 >> v1:172.21.15.66:6789/0 conn(0x7fc1c40e7510 legacy=0x7fc1c4034330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.103+0000 7fc1c9d9b640 1 -- 172.21.15.2:0/2608791674 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c40508e0 con 0x7fc1c4006250 2023-11-25T04:08:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7fc1cad9d640 1 --2- 172.21.15.2:0/2608791674 >> v2:172.21.15.2:3300/0 conn(0x7fc1c4053120 0x7fc1c4053590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:42.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7f1135483640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11280e2a90 con 0x7f11280500e0 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.102+0000 7f1135483640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1128006ab0 con 0x7f112803a860 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f112e7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f112803a860 0x7f112804fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f112e7fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f112803a860 0x7f112804fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55008/0 (socket says 172.21.15.2:55008) 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f112e7fc640 1 -- 172.21.15.2:0/2920942964 learned_addr learned my addr 172.21.15.2:0/2920942964 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f112f7fe640 1 --2- 172.21.15.2:0/2920942964 >> v2:172.21.15.2:3300/0 conn(0x7f11280500e0 0x7f11280380e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.105+0000 7f112e7fc640 1 -- 172.21.15.2:0/2920942964 >> v2:172.21.15.2:3300/0 conn(0x7f11280500e0 msgr2=0x7f11280380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.105+0000 7f112e7fc640 1 --2- 172.21.15.2:0/2920942964 >> v2:172.21.15.2:3300/0 conn(0x7f11280500e0 0x7f11280380e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.105+0000 7f112e7fc640 1 -- 172.21.15.2:0/2920942964 >> v1:172.21.15.66:6789/0 conn(0x7f11280e26b0 legacy=0x7f11280062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.105+0000 7f112e7fc640 1 -- 172.21.15.2:0/2920942964 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128006d90 con 0x7f112803a860 2023-11-25T04:08:42.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f593d59a640 1 -- 172.21.15.2:0/2736276810 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 66372573 0 0) 0x7f594015a8a0 con 0x7f59400ce1e0 2023-11-25T04:08:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f593d59a640 1 -- 172.21.15.2:0/2736276810 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5928003520 con 0x7f59400ce1e0 2023-11-25T04:08:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f593e59c640 1 -- 172.21.15.2:0/2736276810 >> v1:172.21.15.66:6789/0 conn(0x7f59400cd130 legacy=0x7f594006be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f593e59c640 1 -- 172.21.15.2:0/2736276810 >> v1:172.21.15.2:6789/0 conn(0x7f59400ce1e0 legacy=0x7f59400cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f88fe5ef640 1 Processor -- start 2023-11-25T04:08:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.105+0000 7f88fe5ef640 1 -- start start 2023-11-25T04:08:42.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7fc1c9d9b640 1 --2- 172.21.15.2:0/2608791674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1c4006250 0x7fc1c40066b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0620a0 tx=0x7fc1cc0a5e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a165aedfb03d1e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f7900940640 1 Processor -- start 2023-11-25T04:08:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f7900940640 1 -- start start 2023-11-25T04:08:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.104+0000 7f593e59c640 1 -- 172.21.15.2:0/2736276810 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59400b3210 con 0x7f594006da70 2023-11-25T04:08:42.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.105+0000 7f6108fb3640 1 Processor -- start 2023-11-25T04:08:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.105+0000 7f6108fb3640 1 -- start start 2023-11-25T04:08:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7fc1c959a640 1 -- 172.21.15.2:0/2608791674 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0a6ca0 con 0x7fc1c4006250 2023-11-25T04:08:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7fc1c959a640 1 -- 172.21.15.2:0/2608791674 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1cc0a6e00 con 0x7fc1c4006250 2023-11-25T04:08:42.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f7900940640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc16a1f0 0x7f78fc070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f112e7fc640 1 --2- 172.21.15.2:0/2920942964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 0x7f112804fba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1130079d00 tx=0x7f11300aa620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b5d57c20ce5fe93 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f7900940640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f78fc0ced00 0x7f78fc0cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f7900940640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78fc070b50 con 0x7f78fc167980 2023-11-25T04:08:42.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f7900940640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78fc0cf6b0 con 0x7f78fc0ced00 2023-11-25T04:08:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f112dffb640 1 -- 172.21.15.2:0/2920942964 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11300aaea0 con 0x7f112803a860 2023-11-25T04:08:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f112dffb640 1 -- 172.21.15.2:0/2920942964 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11300ad030 con 0x7f112803a860 2023-11-25T04:08:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f112dffb640 1 -- 172.21.15.2:0/2920942964 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11300b0740 con 0x7f112803a860 2023-11-25T04:08:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f88fe5ef640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88f80719d0 0x7f88f8161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f88fe5ef640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80cca20 0x7f88f80b2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.116 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f7900940640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc0b23d0 con 0x7f78fc16a1f0 2023-11-25T04:08:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f88fe5ef640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f806ea60 con 0x7f88f80b3910 2023-11-25T04:08:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f88fe5ef640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f80cceb0 con 0x7f88f80719d0 2023-11-25T04:08:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f88fe5ef640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8162220 con 0x7f88f80cca20 2023-11-25T04:08:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f88fddee640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80cca20 0x7f88f80b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f88fddee640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80cca20 0x7f88f80b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39730/0 (socket says 172.21.15.2:39730) 2023-11-25T04:08:42.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f88fddee640 1 -- 172.21.15.2:0/156184215 learned_addr learned my addr 172.21.15.2:0/156184215 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f6108fb3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f61040719d0 0x7f6104161bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f6108fb3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040b3910 0x7f61040cca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f6108fb3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610406ea60 con 0x7f6104071db0 2023-11-25T04:08:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f6108fb3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6104162220 con 0x7f61040719d0 2023-11-25T04:08:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f6108fb3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6104162500 con 0x7f61040b3910 2023-11-25T04:08:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7fc1d0f4c640 1 -- 172.21.15.2:0/2608791674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1c4006250 msgr2=0x7fc1c40066b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7fc1d0f4c640 1 --2- 172.21.15.2:0/2608791674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1c4006250 0x7fc1c40066b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc0620a0 tx=0x7fc1cc0a5e30 comp rx=0 tx=0).stop 2023-11-25T04:08:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f6102ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040b3910 0x7f61040cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f6102ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040b3910 0x7f61040cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39736/0 (socket says 172.21.15.2:39736) 2023-11-25T04:08:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f6102ffd640 1 -- 172.21.15.2:0/264671769 learned_addr learned my addr 172.21.15.2:0/264671769 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7fc1d0f4c640 1 -- 172.21.15.2:0/2608791674 shutdown_connections 2023-11-25T04:08:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7fc1d0f4c640 1 --2- 172.21.15.2:0/2608791674 >> v2:172.21.15.2:3300/0 conn(0x7fc1c4053120 0x7fc1c4053590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7fc1d0f4c640 1 --2- 172.21.15.2:0/2608791674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1c4006250 0x7fc1c40066b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7fc1d0f4c640 1 -- 172.21.15.2:0/2608791674 >> 172.21.15.2:0/2608791674 conn(0x7fc1c4055310 msgr2=0x7fc1c4055720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f593e59c640 1 --2- 172.21.15.2:0/2736276810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594006da70 0x7f594015a360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f593000be90 tx=0x7f5930030110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b607c2b916e5bc62 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f88fd5ed640 1 --2- 172.21.15.2:0/156184215 >> v2:172.21.15.2:3300/0 conn(0x7f88f80719d0 0x7f88f8161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f88fddee640 1 -- 172.21.15.2:0/156184215 >> v2:172.21.15.2:3300/0 conn(0x7f88f80719d0 msgr2=0x7f88f8161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f88fddee640 1 --2- 172.21.15.2:0/156184215 >> v2:172.21.15.2:3300/0 conn(0x7f88f80719d0 0x7f88f8161bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f88fddee640 1 -- 172.21.15.2:0/156184215 >> v1:172.21.15.2:6789/0 conn(0x7f88f80b3910 legacy=0x7f88f8071db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f88fddee640 1 -- 172.21.15.2:0/156184215 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f8162500 con 0x7f88f80cca20 2023-11-25T04:08:42.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f593d59a640 1 -- 172.21.15.2:0/2736276810 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593003a400 con 0x7f594006da70 2023-11-25T04:08:42.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f1135483640 1 -- 172.21.15.2:0/2920942964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 msgr2=0x7f112804fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f1135483640 1 --2- 172.21.15.2:0/2920942964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 0x7f112804fba0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1130079d00 tx=0x7f11300aa620 comp rx=0 tx=0).stop 2023-11-25T04:08:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7fc1d0f4c640 1 -- 172.21.15.2:0/2608791674 shutdown_connections 2023-11-25T04:08:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f1135483640 1 -- 172.21.15.2:0/2920942964 shutdown_connections 2023-11-25T04:08:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f1135483640 1 --2- 172.21.15.2:0/2920942964 >> v2:172.21.15.2:3300/0 conn(0x7f11280500e0 0x7f11280380e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f1135483640 1 --2- 172.21.15.2:0/2920942964 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 0x7f112804fba0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f1135483640 1 -- 172.21.15.2:0/2920942964 >> 172.21.15.2:0/2920942964 conn(0x7f1128054ed0 msgr2=0x7f11280552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7fc1d0f4c640 1 -- 172.21.15.2:0/2608791674 wait complete. 2023-11-25T04:08:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f78fad9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f78fc167980 0x7f78fc0b1cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33046/0 (socket says 172.21.15.2:33046) 2023-11-25T04:08:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f78fad9d640 1 -- 172.21.15.2:0/2155972351 learned_addr learned my addr 172.21.15.2:0/2155972351 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f78fb59e640 1 --2- 172.21.15.2:0/2155972351 >> v2:172.21.15.66:3300/0 conn(0x7f78fc0ced00 0x7f78fc0cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f78fa59c640 1 --2- 172.21.15.2:0/2155972351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc16a1f0 0x7f78fc070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f78fb59e640 1 -- 172.21.15.2:0/2155972351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc16a1f0 msgr2=0x7f78fc070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f61037fe640 1 --2- 172.21.15.2:0/264671769 >> v2:172.21.15.2:3300/0 conn(0x7f61040719d0 0x7f6104161bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845577089 0 0) 0x7f610406ea60 con 0x7f6104071db0 2023-11-25T04:08:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60ec003520 con 0x7f6104071db0 2023-11-25T04:08:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 <== mon.1 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 463783622 0 0) 0x7f60ec003520 con 0x7f6104071db0 2023-11-25T04:08:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040b3910 msgr2=0x7f61040cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040b3910 0x7f61040cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 >> v2:172.21.15.2:3300/0 conn(0x7f61040719d0 msgr2=0x7f6104161bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 --2- 172.21.15.2:0/264671769 >> v2:172.21.15.2:3300/0 conn(0x7f61040719d0 0x7f6104161bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61041627e0 con 0x7f6104071db0 2023-11-25T04:08:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 <== mon.1 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f60f4001670 con 0x7f6104071db0 2023-11-25T04:08:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f78fb59e640 1 --2- 172.21.15.2:0/2155972351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc16a1f0 0x7f78fc070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f78fb59e640 1 -- 172.21.15.2:0/2155972351 >> v1:172.21.15.2:6789/0 conn(0x7f78fc167980 legacy=0x7f78fc0b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.106+0000 7f78fb59e640 1 -- 172.21.15.2:0/2155972351 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78fc16a960 con 0x7f78fc0ced00 2023-11-25T04:08:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 >> v1:172.21.15.66:6789/0 conn(0x7f6104071db0 legacy=0x7f61040b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60ec003970 0x7f60ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec0047c0 0x7f60ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec005180 0x7f60ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6104162220 con 0x7f60ec003970 2023-11-25T04:08:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6104162500 con 0x7f60ec005180 2023-11-25T04:08:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec00bfa0 con 0x7f60ec0047c0 2023-11-25T04:08:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f6103fff640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec005180 0x7f60ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f78fb59e640 1 --2- 172.21.15.2:0/2155972351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc0ced00 0x7f78fc0cf170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f78f400b860 tx=0x7f78f402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=485f916d530c2157 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f593d59a640 1 -- 172.21.15.2:0/2736276810 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930034070 con 0x7f594006da70 2023-11-25T04:08:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f61037fe640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60ec003970 0x7f60ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f1135483640 1 -- 172.21.15.2:0/2920942964 shutdown_connections 2023-11-25T04:08:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f1135483640 1 -- 172.21.15.2:0/2920942964 wait complete. 2023-11-25T04:08:42.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f278b59e640 1 Processor -- start 2023-11-25T04:08:42.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f278b59e640 1 -- start start 2023-11-25T04:08:42.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f3702181640 1 Processor -- start 2023-11-25T04:08:42.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.107+0000 7f3702181640 1 -- start start 2023-11-25T04:08:42.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.108+0000 7f88fddee640 1 --2- 172.21.15.2:0/156184215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80cca20 0x7f88f80b2110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009e50 tx=0x7f88f002bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14596e4d254b9fc8 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f88effff640 1 -- 172.21.15.2:0/156184215 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f002cb20 con 0x7f88f80cca20 2023-11-25T04:08:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f88effff640 1 -- 172.21.15.2:0/156184215 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f002cc80 con 0x7f88f80cca20 2023-11-25T04:08:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f88effff640 1 -- 172.21.15.2:0/156184215 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0034610 con 0x7f88f80cca20 2023-11-25T04:08:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f61037fe640 1 -- 172.21.15.2:0/264671769 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec0047c0 msgr2=0x7f60ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f61037fe640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec0047c0 0x7f60ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f61037fe640 1 -- 172.21.15.2:0/264671769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec005180 msgr2=0x7f60ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f61037fe640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec005180 0x7f60ec00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f61037fe640 1 -- 172.21.15.2:0/264671769 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61041627e0 con 0x7f60ec003970 2023-11-25T04:08:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f3702181640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc06a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f3702181640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f36fc15bd90 0x7f36fc162450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f3702181640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f36fc0b4de0 0x7f36fc1650a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f3702181640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc165fd0 con 0x7f36fc0b4de0 2023-11-25T04:08:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f3702181640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc06adf0 con 0x7f36fc15bd90 2023-11-25T04:08:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f3702181640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc165a10 con 0x7f36fc06a4d0 2023-11-25T04:08:42.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7fc1d0f4c640 1 Processor -- start 2023-11-25T04:08:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f370117f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc06a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f370117f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc06a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39746/0 (socket says 172.21.15.2:39746) 2023-11-25T04:08:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f370117f640 1 -- 172.21.15.2:0/2996691273 learned_addr learned my addr 172.21.15.2:0/2996691273 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f370097e640 1 --2- 172.21.15.2:0/2996691273 >> v2:172.21.15.66:3300/0 conn(0x7f36fc15bd90 0x7f36fc162450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f370117f640 1 -- 172.21.15.2:0/2996691273 >> v2:172.21.15.66:3300/0 conn(0x7f36fc15bd90 msgr2=0x7f36fc162450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f370117f640 1 --2- 172.21.15.2:0/2996691273 >> v2:172.21.15.66:3300/0 conn(0x7f36fc15bd90 0x7f36fc162450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f370117f640 1 -- 172.21.15.2:0/2996691273 >> v2:172.21.15.2:3300/0 conn(0x7f36fc0b4de0 msgr2=0x7f36fc1650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f370117f640 1 --2- 172.21.15.2:0/2996691273 >> v2:172.21.15.2:3300/0 conn(0x7f36fc0b4de0 0x7f36fc1650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f370117f640 1 -- 172.21.15.2:0/2996691273 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc165cf0 con 0x7f36fc06a4d0 2023-11-25T04:08:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f278b59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f278c15f260 0x7f278c1626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f88fe5ef640 1 -- 172.21.15.2:0/156184215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80cca20 msgr2=0x7f88f80b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.132 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f88fe5ef640 1 --2- 172.21.15.2:0/156184215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80cca20 0x7f88f80b2110 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009e50 tx=0x7f88f002bf80 comp rx=0 tx=0).stop 2023-11-25T04:08:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f88fe5ef640 1 -- 172.21.15.2:0/156184215 shutdown_connections 2023-11-25T04:08:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f278b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0cedd0 0x7f278c0cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f278b59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c06e0f0 con 0x7f278c0b3f20 2023-11-25T04:08:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f278b59e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278c0cf7a0 con 0x7f278c15f260 2023-11-25T04:08:42.133 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f278b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c06e630 con 0x7f278c0cedd0 2023-11-25T04:08:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f88fe5ef640 1 --2- 172.21.15.2:0/156184215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80cca20 0x7f88f80b2110 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f88fe5ef640 1 --2- 172.21.15.2:0/156184215 >> v2:172.21.15.2:3300/0 conn(0x7f88f80719d0 0x7f88f8161bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f88fe5ef640 1 -- 172.21.15.2:0/156184215 >> 172.21.15.2:0/156184215 conn(0x7f88f80ceb20 msgr2=0x7f88f80cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f78f9d9b640 1 -- 172.21.15.2:0/2155972351 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f4006c80 con 0x7f78fc0ced00 2023-11-25T04:08:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f78f9d9b640 1 -- 172.21.15.2:0/2155972351 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f4030070 con 0x7f78fc0ced00 2023-11-25T04:08:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7f78f9d9b640 1 -- 172.21.15.2:0/2155972351 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f402cc70 con 0x7f78fc0ced00 2023-11-25T04:08:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f7900940640 1 -- 172.21.15.2:0/2155972351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc0ced00 msgr2=0x7f78fc0cf170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f7900940640 1 --2- 172.21.15.2:0/2155972351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc0ced00 0x7f78fc0cf170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f78f400b860 tx=0x7f78f402bea0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f61037fe640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60ec003970 0x7f60ec003d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f60f800ba10 tx=0x7f60ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460823dd68b604f6 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f7900940640 1 -- 172.21.15.2:0/2155972351 shutdown_connections 2023-11-25T04:08:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f7900940640 1 --2- 172.21.15.2:0/2155972351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc16a1f0 0x7f78fc070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f7900940640 1 --2- 172.21.15.2:0/2155972351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc0ced00 0x7f78fc0cf170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f7900940640 1 -- 172.21.15.2:0/2155972351 >> 172.21.15.2:0/2155972351 conn(0x7f78fc06a6b0 msgr2=0x7f78fc06aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.109+0000 7fc1d0f4c640 1 -- start start 2023-11-25T04:08:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f593d59a640 1 -- 172.21.15.2:0/2736276810 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593003a760 con 0x7f594006da70 2023-11-25T04:08:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f88fe5ef640 1 -- 172.21.15.2:0/156184215 shutdown_connections 2023-11-25T04:08:42.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f88fe5ef640 1 -- 172.21.15.2:0/156184215 wait complete. 2023-11-25T04:08:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f593f59e640 1 -- 172.21.15.2:0/2736276810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594006da70 msgr2=0x7f594015a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f593f59e640 1 --2- 172.21.15.2:0/2736276810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594006da70 0x7f594015a360 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f593000be90 tx=0x7f5930030110 comp rx=0 tx=0).stop 2023-11-25T04:08:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8033680 con 0x7f60ec003970 2023-11-25T04:08:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f278ad9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0cedd0 0x7f278c0cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f278ad9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0cedd0 0x7f278c0cf260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39754/0 (socket says 172.21.15.2:39754) 2023-11-25T04:08:42.137 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f278ad9d640 1 -- 172.21.15.2:0/4107581942 learned_addr learned my addr 172.21.15.2:0/4107581942 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f80337e0 con 0x7f60ec003970 2023-11-25T04:08:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f1135483640 1 Processor -- start 2023-11-25T04:08:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7f1135483640 1 -- start start 2023-11-25T04:08:42.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f7900940640 1 -- 172.21.15.2:0/2155972351 shutdown_connections 2023-11-25T04:08:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f61027fc640 1 -- 172.21.15.2:0/264671769 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8033680 con 0x7f60ec003970 2023-11-25T04:08:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f593f59e640 1 -- 172.21.15.2:0/2736276810 shutdown_connections 2023-11-25T04:08:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f593f59e640 1 --2- 172.21.15.2:0/2736276810 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f594006da70 0x7f594015a360 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f593f59e640 1 -- 172.21.15.2:0/2736276810 >> 172.21.15.2:0/2736276810 conn(0x7f594006a4d0 msgr2=0x7f594006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.110+0000 7fc1d0f4c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1c4006250 0x7fc1c40d6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1d0f4c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1c4053120 0x7fc1c4034c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1d0f4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1c40e7510 0x7fc1c404efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1d0f4c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40d6bd0 con 0x7fc1c40e7510 2023-11-25T04:08:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1d0f4c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c40355b0 con 0x7fc1c4053120 2023-11-25T04:08:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1d0f4c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c4035890 con 0x7fc1c4006250 2023-11-25T04:08:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1c9d9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1c4053120 0x7fc1c4034c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.140 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f370117f640 1 --2- 172.21.15.2:0/2996691273 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc06a8b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f36fc06cca0 tx=0x7f36f802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e04d5b0f6bf8b78c server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1cad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1c40e7510 0x7fc1c404efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1ca59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1c4006250 0x7fc1c40d6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1ca59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1c4006250 0x7fc1c40d6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39762/0 (socket says 172.21.15.2:39762) 2023-11-25T04:08:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7fc1ca59c640 1 -- 172.21.15.2:0/1801434174 learned_addr learned my addr 172.21.15.2:0/1801434174 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f593f59e640 1 -- 172.21.15.2:0/2736276810 shutdown_connections 2023-11-25T04:08:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f278a59c640 1 --2- 172.21.15.2:0/4107581942 >> v2:172.21.15.66:3300/0 conn(0x7f278c15f260 0x7f278c1626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f278a59c640 1 -- 172.21.15.2:0/4107581942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0cedd0 msgr2=0x7f278c0cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f36f3fff640 1 -- 172.21.15.2:0/2996691273 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8030610 con 0x7f36fc06a4d0 2023-11-25T04:08:42.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f7900940640 1 -- 172.21.15.2:0/2155972351 wait complete. 2023-11-25T04:08:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f88fe5ef640 1 Processor -- start 2023-11-25T04:08:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f88fe5ef640 1 -- start start 2023-11-25T04:08:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f6108fb3640 1 -- 172.21.15.2:0/264671769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60ec003970 msgr2=0x7f60ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f6108fb3640 1 --2- 172.21.15.2:0/264671769 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f60ec003970 0x7f60ec003d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f60f800ba10 tx=0x7f60ec0057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f6103fff640 1 -- 172.21.15.2:0/264671769 reap_dead start 2023-11-25T04:08:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f6108fb3640 1 -- 172.21.15.2:0/264671769 shutdown_connections 2023-11-25T04:08:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f6108fb3640 1 -- 172.21.15.2:0/264671769 >> 172.21.15.2:0/264671769 conn(0x7f61040ceb20 msgr2=0x7f61040cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.143 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f6108fb3640 1 -- 172.21.15.2:0/264671769 shutdown_connections 2023-11-25T04:08:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.111+0000 7f278a59c640 1 --2- 172.21.15.2:0/4107581942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0cedd0 0x7f278c0cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f278a59c640 1 -- 172.21.15.2:0/4107581942 >> v1:172.21.15.66:6789/0 conn(0x7f278c0b3f20 legacy=0x7f278c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f278a59c640 1 -- 172.21.15.2:0/4107581942 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c06e350 con 0x7f278c15f260 2023-11-25T04:08:42.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f278ad9d640 1 --2- 172.21.15.2:0/4107581942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0cedd0 0x7f278c0cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f36f3fff640 1 -- 172.21.15.2:0/2996691273 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8030770 con 0x7f36fc06a4d0 2023-11-25T04:08:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f3702181640 1 -- 172.21.15.2:0/2996691273 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 msgr2=0x7f36fc06a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f36f3fff640 1 -- 172.21.15.2:0/2996691273 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8030610 con 0x7f36fc06a4d0 2023-11-25T04:08:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f3702181640 1 --2- 172.21.15.2:0/2996691273 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc06a8b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f36fc06cca0 tx=0x7f36f802b960 comp rx=0 tx=0).stop 2023-11-25T04:08:42.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f1135483640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 0x7f1128049cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f3702181640 1 -- 172.21.15.2:0/2996691273 shutdown_connections 2023-11-25T04:08:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f3702181640 1 --2- 172.21.15.2:0/2996691273 >> v2:172.21.15.2:3300/0 conn(0x7f36fc0b4de0 0x7f36fc1650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f3702181640 1 --2- 172.21.15.2:0/2996691273 >> v2:172.21.15.66:3300/0 conn(0x7f36fc15bd90 0x7f36fc162450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f3702181640 1 --2- 172.21.15.2:0/2996691273 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc06a8b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f3702181640 1 -- 172.21.15.2:0/2996691273 >> 172.21.15.2:0/2996691273 conn(0x7f36fc0b1a40 msgr2=0x7f36fc0b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.146 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f593f59e640 1 -- 172.21.15.2:0/2736276810 wait complete. 2023-11-25T04:08:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f7900940640 1 Processor -- start 2023-11-25T04:08:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f6108fb3640 1 -- 172.21.15.2:0/264671769 wait complete. 2023-11-25T04:08:42.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f7900940640 1 -- start start 2023-11-25T04:08:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f1135483640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11280500e0 0x7f112817dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f88fe5ef640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f80719d0 0x7f88f80cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f1135483640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11280e26b0 0x7f11280d42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f1135483640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11280d84d0 con 0x7f11280e26b0 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f1135483640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11280d9d50 con 0x7f112803a860 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f1135483640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f112817e140 con 0x7f11280500e0 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f112effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 0x7f1128049cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f112effd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 0x7f1128049cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55074/0 (socket says 172.21.15.2:55074) 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f112effd640 1 -- 172.21.15.2:0/1917495468 learned_addr learned my addr 172.21.15.2:0/1917495468 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.112+0000 7f112f7fe640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11280e26b0 0x7f11280d42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f112f7fe640 1 -- 172.21.15.2:0/1917495468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11280500e0 msgr2=0x7f112817dc00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f112f7fe640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11280500e0 0x7f112817dc00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f112f7fe640 1 -- 172.21.15.2:0/1917495468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 msgr2=0x7f1128049cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f112f7fe640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 0x7f1128049cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.149 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f112f7fe640 1 -- 172.21.15.2:0/1917495468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113004ed60 con 0x7f11280e26b0 2023-11-25T04:08:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f593f59e640 1 Processor -- start 2023-11-25T04:08:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f593f59e640 1 -- start start 2023-11-25T04:08:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f593f59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f594006da70 0x7f5940158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f593f59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59400cd130 0x7f5940158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f88fe5ef640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b3910 0x7f88f81616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.150 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f88fe5ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f80cca20 0x7f88f8158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f88fe5ef640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80ac080 con 0x7f88f80cca20 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f88fe5ef640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80ac360 con 0x7f88f80719d0 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f88fe5ef640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80ac640 con 0x7f88f80b3910 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fcdec640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b3910 0x7f88f81616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fddee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f80cca20 0x7f88f8158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fcdec640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b3910 0x7f88f81616c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39768/0 (socket says 172.21.15.2:39768) 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fcdec640 1 -- 172.21.15.2:0/2880308200 learned_addr learned my addr 172.21.15.2:0/2880308200 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fd5ed640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f80719d0 0x7f88f80cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fddee640 1 -- 172.21.15.2:0/2880308200 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b3910 msgr2=0x7f88f81616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fddee640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b3910 0x7f88f81616c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fddee640 1 -- 172.21.15.2:0/2880308200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f80719d0 msgr2=0x7f88f80cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fddee640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f80719d0 0x7f88f80cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f88fddee640 1 -- 172.21.15.2:0/2880308200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f0009b30 con 0x7f88f80cca20 2023-11-25T04:08:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f88fddee640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f80cca20 0x7f88f8158a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88f0032000 tx=0x7f88f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7fc1ca59c640 1 -- 172.21.15.2:0/1801434174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1c4053120 msgr2=0x7fc1c4034c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7fc1ca59c640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1c4053120 0x7fc1c4034c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7fc1ca59c640 1 -- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1c40e7510 msgr2=0x7fc1c404efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7fc1ca59c640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1c40e7510 0x7fc1c404efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7fc1ca59c640 1 -- 172.21.15.2:0/1801434174 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1cc04f730 con 0x7fc1c4006250 2023-11-25T04:08:42.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7fc1cad9d640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1c40e7510 0x7fc1c404efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f7900940640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc0ced00 0x7f78fc0899d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f7900940640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc167980 0x7f78fc1f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f7900940640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78fc16a1f0 0x7f78fc1f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f6108fb3640 1 Processor -- start 2023-11-25T04:08:42.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f278a59c640 1 --2- 172.21.15.2:0/4107581942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f278c15f260 0x7f278c1626c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27800097a0 tx=0x7f278002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38d0d17b478f7dc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f278959a640 1 -- 172.21.15.2:0/4107581942 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780031640 con 0x7f278c15f260 2023-11-25T04:08:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f278959a640 1 -- 172.21.15.2:0/4107581942 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27800317a0 con 0x7f278c15f260 2023-11-25T04:08:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f278959a640 1 -- 172.21.15.2:0/4107581942 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2780031b70 con 0x7f278c15f260 2023-11-25T04:08:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f278b59e640 1 -- 172.21.15.2:0/4107581942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f278c15f260 msgr2=0x7f278c1626c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f278b59e640 1 --2- 172.21.15.2:0/4107581942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f278c15f260 0x7f278c1626c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f27800097a0 tx=0x7f278002b8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f278b59e640 1 -- 172.21.15.2:0/4107581942 shutdown_connections 2023-11-25T04:08:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f278b59e640 1 --2- 172.21.15.2:0/4107581942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0cedd0 0x7f278c0cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f278b59e640 1 --2- 172.21.15.2:0/4107581942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f278c15f260 0x7f278c1626c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f278b59e640 1 -- 172.21.15.2:0/4107581942 >> 172.21.15.2:0/4107581942 conn(0x7f278c070ad0 msgr2=0x7f278c0b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f3702181640 1 -- 172.21.15.2:0/2996691273 shutdown_connections 2023-11-25T04:08:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7f3702181640 1 -- 172.21.15.2:0/2996691273 wait complete. 2023-11-25T04:08:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f88edffb640 1 -- 172.21.15.2:0/2880308200 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0040670 con 0x7f88f80cca20 2023-11-25T04:08:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f88edffb640 1 -- 172.21.15.2:0/2880308200 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f00407f0 con 0x7f88f80cca20 2023-11-25T04:08:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f88edffb640 1 -- 172.21.15.2:0/2880308200 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0040ba0 con 0x7f88f80cca20 2023-11-25T04:08:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f7900940640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc15f040 con 0x7f78fc16a1f0 2023-11-25T04:08:42.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f7900940640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc089f10 con 0x7f78fc167980 2023-11-25T04:08:42.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f7900940640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78fc200d80 con 0x7f78fc0ced00 2023-11-25T04:08:42.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f593e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f594006da70 0x7f5940158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f593e59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f594006da70 0x7f5940158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55108/0 (socket says 172.21.15.2:55108) 2023-11-25T04:08:42.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f593e59c640 1 -- 172.21.15.2:0/620535042 learned_addr learned my addr 172.21.15.2:0/620535042 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f88fe5ef640 1 -- 172.21.15.2:0/2880308200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f80ac920 con 0x7f88f80cca20 2023-11-25T04:08:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f593f59e640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59400ce1e0 0x7f594015ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7f6108fb3640 1 -- start start 2023-11-25T04:08:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5940148f10 con 0x7f59400cd130 2023-11-25T04:08:42.157 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59401eea50 con 0x7f594006da70 2023-11-25T04:08:42.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f78fad9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc0ced00 0x7f78fc0899d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5940070f90 con 0x7f59400ce1e0 2023-11-25T04:08:42.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.115+0000 7f88fe5ef640 1 -- 172.21.15.2:0/2880308200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f80abca0 con 0x7f88f80cca20 2023-11-25T04:08:42.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6108fb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61041f6830 0x7f61041f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f593ed9d640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59400ce1e0 0x7f594015ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6108fb3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040c3ac0 0x7f610406ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6108fb3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f610406d3d0 0x7f61041fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6108fb3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610406d880 con 0x7f61041f6830 2023-11-25T04:08:42.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6108fb3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6104159710 con 0x7f610406d3d0 2023-11-25T04:08:42.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6108fb3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61040c3f50 con 0x7f61040c3ac0 2023-11-25T04:08:42.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.113+0000 7fc1ca59c640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1c4006250 0x7fc1c40d6690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c400 tx=0x7fc1bc00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f112f7fe640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11280e26b0 0x7f11280d42d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f112400c7f0 tx=0x7f112400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7fc1baffd640 1 -- 172.21.15.2:0/1801434174 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc0052d0 con 0x7fc1c4006250 2023-11-25T04:08:42.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7fc1baffd640 1 -- 172.21.15.2:0/1801434174 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1bc005430 con 0x7fc1c4006250 2023-11-25T04:08:42.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7fc1baffd640 1 -- 172.21.15.2:0/1801434174 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc003830 con 0x7fc1c4006250 2023-11-25T04:08:42.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc167980 0x7f78fc1f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f78fa59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc167980 0x7f78fc1f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55096/0 (socket says 172.21.15.2:55096) 2023-11-25T04:08:42.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f78fa59c640 1 -- 172.21.15.2:0/3552200593 learned_addr learned my addr 172.21.15.2:0/3552200593 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f3702181640 1 Processor -- start 2023-11-25T04:08:42.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7fc1d0f4c640 1 -- 172.21.15.2:0/1801434174 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c4035b70 con 0x7fc1c4006250 2023-11-25T04:08:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.114+0000 7fc1d0f4c640 1 -- 172.21.15.2:0/1801434174 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c4036130 con 0x7fc1c4006250 2023-11-25T04:08:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7fc1b8ff9640 1 -- 172.21.15.2:0/1801434174 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a4005250 con 0x7fc1c4006250 2023-11-25T04:08:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f3702181640 1 -- start start 2023-11-25T04:08:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6102ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040c3ac0 0x7f610406ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6102ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040c3ac0 0x7f610406ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39790/0 (socket says 172.21.15.2:39790) 2023-11-25T04:08:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6102ffd640 1 -- 172.21.15.2:0/1150125853 learned_addr learned my addr 172.21.15.2:0/1150125853 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f593e59c640 1 -- 172.21.15.2:0/620535042 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59400ce1e0 msgr2=0x7f594015ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f593e59c640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59400ce1e0 0x7f594015ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f593e59c640 1 -- 172.21.15.2:0/620535042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59400cd130 msgr2=0x7f5940158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f593e59c640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59400cd130 0x7f5940158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f593e59c640 1 -- 172.21.15.2:0/620535042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593000bb70 con 0x7f594006da70 2023-11-25T04:08:42.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f278b59e640 1 -- 172.21.15.2:0/4107581942 shutdown_connections 2023-11-25T04:08:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f11177fe640 1 -- 172.21.15.2:0/1917495468 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124004220 con 0x7f11280e26b0 2023-11-25T04:08:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f278b59e640 1 -- 172.21.15.2:0/4107581942 wait complete. 2023-11-25T04:08:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11280d7950 con 0x7f11280e26b0 2023-11-25T04:08:42.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11280d7f10 con 0x7f11280e26b0 2023-11-25T04:08:42.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f11177fe640 1 -- 172.21.15.2:0/1917495468 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1124004380 con 0x7f11280e26b0 2023-11-25T04:08:42.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f11177fe640 1 -- 172.21.15.2:0/1917495468 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1124003830 con 0x7f11280e26b0 2023-11-25T04:08:42.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f6103fff640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f610406d3d0 0x7f61041fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f593e59c640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f594006da70 0x7f5940158140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5930030150 tx=0x7f5930004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f78fa59c640 1 -- 172.21.15.2:0/3552200593 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc0ced00 msgr2=0x7f78fc0899d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f78fa59c640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc0ced00 0x7f78fc0899d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f78fa59c640 1 -- 172.21.15.2:0/3552200593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78fc16a1f0 msgr2=0x7f78fc1f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.116+0000 7f78fa59c640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78fc16a1f0 0x7f78fc1f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f78fa59c640 1 -- 172.21.15.2:0/3552200593 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f400b4c0 con 0x7f78fc167980 2023-11-25T04:08:42.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f592effd640 1 -- 172.21.15.2:0/620535042 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593000b550 con 0x7f594006da70 2023-11-25T04:08:42.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f592effd640 1 -- 172.21.15.2:0/620535042 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930045470 con 0x7f594006da70 2023-11-25T04:08:42.166 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f592effd640 1 -- 172.21.15.2:0/620535042 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930045800 con 0x7f594006da70 2023-11-25T04:08:42.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f6102ffd640 1 -- 172.21.15.2:0/1150125853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f610406d3d0 msgr2=0x7f61041fa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f6102ffd640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f610406d3d0 0x7f61041fa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f6102ffd640 1 -- 172.21.15.2:0/1150125853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61041f6830 msgr2=0x7f61041f6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f6102ffd640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61041f6830 0x7f61041f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f6102ffd640 1 -- 172.21.15.2:0/1150125853 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61040c4230 con 0x7f61040c3ac0 2023-11-25T04:08:42.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5940071230 con 0x7f594006da70 2023-11-25T04:08:42.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f78fa59c640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc167980 0x7f78fc1f2410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009910 tx=0x7f78ec009dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59400717f0 con 0x7f594006da70 2023-11-25T04:08:42.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1110005250 con 0x7f11280e26b0 2023-11-25T04:08:42.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f88db7fe640 1 -- 172.21.15.2:0/2880308200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d4005250 con 0x7f88f80cca20 2023-11-25T04:08:42.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f78f37fe640 1 -- 172.21.15.2:0/3552200593 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec00d4e0 con 0x7f78fc167980 2023-11-25T04:08:42.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.117+0000 7f78f37fe640 1 -- 172.21.15.2:0/3552200593 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ec008840 con 0x7f78fc167980 2023-11-25T04:08:42.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f6102ffd640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040c3ac0 0x7f610406ce90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00efb0 tx=0x7f60fc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f278b59e640 1 Processor -- start 2023-11-25T04:08:42.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f3702181640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc14ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f3702181640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36fc0b4de0 0x7f36fc150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f3702181640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36fc15bd90 0x7f36fc1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f3702181640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc1512b0 con 0x7f36fc0b4de0 2023-11-25T04:08:42.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f3702181640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc151550 con 0x7f36fc15bd90 2023-11-25T04:08:42.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f3702181640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc151830 con 0x7f36fc06a4d0 2023-11-25T04:08:42.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78fc1f2f80 con 0x7f78fc167980 2023-11-25T04:08:42.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78fc15f220 con 0x7f78fc167980 2023-11-25T04:08:42.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f11177fe640 1 -- 172.21.15.2:0/1917495468 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1124003990 con 0x7f11280e26b0 2023-11-25T04:08:42.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f78f37fe640 1 -- 172.21.15.2:0/3552200593 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ec008bd0 con 0x7f78fc167980 2023-11-25T04:08:42.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f278b59e640 1 -- start start 2023-11-25T04:08:42.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f370117f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc14ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.118+0000 7f3701980640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36fc15bd90 0x7f36fc1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f370117f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc14ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39802/0 (socket says 172.21.15.2:39802) 2023-11-25T04:08:42.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f3701980640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36fc15bd90 0x7f36fc1525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55138/0 (socket says 172.21.15.2:55138) 2023-11-25T04:08:42.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f370117f640 1 -- 172.21.15.2:0/1165118826 learned_addr learned my addr 172.21.15.2:0/1165118826 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f11177fe640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f111c06ae40 0x7f111c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f11177fe640 1 -- 172.21.15.2:0/1917495468 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11240892d0 con 0x7f11280e26b0 2023-11-25T04:08:42.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f370097e640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36fc0b4de0 0x7f36fc150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7fc1baffd640 1 -- 172.21.15.2:0/1801434174 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1bc003990 con 0x7fc1c4006250 2023-11-25T04:08:42.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f370097e640 1 -- 172.21.15.2:0/1165118826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 msgr2=0x7f36fc14ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f370097e640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc14ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f112effd640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f111c06ae40 0x7f111c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f370097e640 1 -- 172.21.15.2:0/1165118826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36fc15bd90 msgr2=0x7f36fc1525f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f370097e640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36fc15bd90 0x7f36fc1525f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f370097e640 1 -- 172.21.15.2:0/1165118826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f80094d0 con 0x7f36fc0b4de0 2023-11-25T04:08:42.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.119+0000 7f370097e640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36fc0b4de0 0x7f36fc150d70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e8a0 tx=0x7f36ec00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7fc1baffd640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1ac06af10 0x7fc1ac06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7fc1baffd640 1 -- 172.21.15.2:0/1801434174 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1bc089030 con 0x7fc1c4006250 2023-11-25T04:08:42.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f88edffb640 1 -- 172.21.15.2:0/2880308200 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88f0040d00 con 0x7f88f80cca20 2023-11-25T04:08:42.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78fc1f34a0 con 0x7f78fc167980 2023-11-25T04:08:42.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f112effd640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f111c06ae40 0x7f111c06d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1128049c50 tx=0x7f1120009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f278b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0b3f20 0x7f278c150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f278b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f278c0cedd0 0x7f278c0cc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f278b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f278c15bf60 0x7f278c15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f278b59e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0b1ff0 con 0x7f278c0cedd0 2023-11-25T04:08:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f278b59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c15c950 con 0x7f278c15bf60 2023-11-25T04:08:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f278b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c150a70 con 0x7f278c0b3f20 2023-11-25T04:08:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7f88edffb640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f88dc06af10 0x7f88dc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.120+0000 7fc1c9d9b640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1ac06af10 0x7fc1ac06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f2789d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f278c0cedd0 0x7f278c0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f2789d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f278c0cedd0 0x7f278c0cc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53382/0 (socket says 172.21.15.2:53382) 2023-11-25T04:08:42.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f2789d9b640 1 -- 172.21.15.2:0/844670718 learned_addr learned my addr 172.21.15.2:0/844670718 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:42.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f88fd5ed640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f88dc06af10 0x7f88dc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f88edffb640 1 -- 172.21.15.2:0/2880308200 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88f00ac540 con 0x7f88f80cca20 2023-11-25T04:08:42.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f78f37fe640 1 -- 172.21.15.2:0/3552200593 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78ec008d30 con 0x7f78fc167980 2023-11-25T04:08:42.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f2789d9b640 1 -- 172.21.15.2:0/844670718 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0b3f20 msgr2=0x7f278c150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5924005250 con 0x7f594006da70 2023-11-25T04:08:42.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f278a59c640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0b3f20 0x7f278c150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f2789d9b640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0b3f20 0x7f278c150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f2789d9b640 1 -- 172.21.15.2:0/844670718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f278c15bf60 msgr2=0x7f278c15c410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-25T04:08:42.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f2789d9b640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f278c15bf60 0x7f278c15c410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f2789d9b640 1 -- 172.21.15.2:0/844670718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c0094d0 con 0x7f278c0cedd0 2023-11-25T04:08:42.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f88fd5ed640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f88dc06af10 0x7f88dc06d3d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f88e8006fd0 tx=0x7f88e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7fc1c9d9b640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1ac06af10 0x7fc1ac06d3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4034b80 tx=0x7fc1cc0aa000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.121+0000 7f278a59c640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0b3f20 0x7f278c150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:42.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7f2789d9b640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f278c0cedd0 0x7f278c0cc090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f278400c8a0 tx=0x7f278400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7f78f37fe640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f78dc06af10 0x7f78dc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7f78f37fe640 1 -- 172.21.15.2:0/3552200593 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78ec092710 con 0x7f78fc167980 2023-11-25T04:08:42.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7f60ebfff640 1 -- 172.21.15.2:0/1150125853 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc00cd20 con 0x7f61040c3ac0 2023-11-25T04:08:42.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7f60ebfff640 1 -- 172.21.15.2:0/1150125853 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc00f040 con 0x7f61040c3ac0 2023-11-25T04:08:42.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61040c4510 con 0x7f61040c3ac0 2023-11-25T04:08:42.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7f78fad9d640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f78dc06af10 0x7f78dc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7f592effd640 1 -- 172.21.15.2:0/620535042 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5930045960 con 0x7f594006da70 2023-11-25T04:08:42.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7f60ebfff640 1 -- 172.21.15.2:0/1150125853 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc0146c0 con 0x7f61040c3ac0 2023-11-25T04:08:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.122+0000 7fc1baffd640 1 -- 172.21.15.2:0/1801434174 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1bc054170 con 0x7fc1c4006250 2023-11-25T04:08:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.123+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61040c4ad0 con 0x7f61040c3ac0 2023-11-25T04:08:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.123+0000 7f592effd640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f592006aec0 0x7f592006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.184 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.123+0000 7f78fad9d640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f78dc06af10 0x7f78dc06d3d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f78fc15eff0 tx=0x7f78e4006060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.123+0000 7f592effd640 1 -- 172.21.15.2:0/620535042 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59300b0420 con 0x7f594006da70 2023-11-25T04:08:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.123+0000 7f593dd9b640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f592006aec0 0x7f592006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.124+0000 7f593dd9b640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f592006aec0 0x7f592006d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f594014ffc0 tx=0x7f5938005c40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.124+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61041f8140 con 0x7f61040c3ac0 2023-11-25T04:08:42.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.124+0000 7f60ebfff640 1 -- 172.21.15.2:0/1150125853 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60fc014820 con 0x7f61040c3ac0 2023-11-25T04:08:42.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.125+0000 7f60ebfff640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f60f006ae40 0x7f60f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.125+0000 7f60ebfff640 1 -- 172.21.15.2:0/1150125853 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60fc089e10 con 0x7f61040c3ac0 2023-11-25T04:08:42.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.125+0000 7f61037fe640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f60f006ae40 0x7f60f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.125+0000 7f61037fe640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f60f006ae40 0x7f60f006d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f60f800b9e0 tx=0x7f60f8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.125+0000 7f277affd640 1 -- 172.21.15.2:0/844670718 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784003b70 con 0x7f278c0cedd0 2023-11-25T04:08:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.126+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2780009400 con 0x7f278c0cedd0 2023-11-25T04:08:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.126+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c0b1650 con 0x7f278c0cedd0 2023-11-25T04:08:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.125+0000 7f36f1ffb640 1 -- 172.21.15.2:0/1165118826 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec009e60 con 0x7f36fc0b4de0 2023-11-25T04:08:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.126+0000 7f11177fe640 1 -- 172.21.15.2:0/1917495468 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f11240542e0 con 0x7f11280e26b0 2023-11-25T04:08:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.126+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc151b10 con 0x7f36fc0b4de0 2023-11-25T04:08:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.126+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc1520d0 con 0x7f36fc0b4de0 2023-11-25T04:08:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.127+0000 7f78f37fe640 1 -- 172.21.15.2:0/3552200593 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78ec05d830 con 0x7f78fc167980 2023-11-25T04:08:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.127+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc1522f0 con 0x7f36fc0b4de0 2023-11-25T04:08:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.127+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c0b2130 con 0x7f278c0cedd0 2023-11-25T04:08:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.130+0000 7f60ebfff640 1 -- 172.21.15.2:0/1150125853 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61041f8140 con 0x7f61040c3ac0 2023-11-25T04:08:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.131+0000 7f88edffb640 1 -- 172.21.15.2:0/2880308200 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88f00776f0 con 0x7f88f80cca20 2023-11-25T04:08:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.131+0000 7f592effd640 1 -- 172.21.15.2:0/620535042 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f593007b520 con 0x7f594006da70 2023-11-25T04:08:42.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.130+0000 7f277affd640 1 -- 172.21.15.2:0/844670718 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27840018b0 con 0x7f278c0cedd0 2023-11-25T04:08:42.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.130+0000 7f277affd640 1 -- 172.21.15.2:0/844670718 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278400a850 con 0x7f278c0cedd0 2023-11-25T04:08:42.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.133+0000 7f36f1ffb640 1 -- 172.21.15.2:0/1165118826 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec005990 con 0x7f36fc0b4de0 2023-11-25T04:08:42.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.134+0000 7f36f1ffb640 1 -- 172.21.15.2:0/1165118826 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec005d00 con 0x7f36fc0b4de0 2023-11-25T04:08:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.134+0000 7f36f1ffb640 1 -- 172.21.15.2:0/1165118826 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f36ec00c940 con 0x7f36fc0b4de0 2023-11-25T04:08:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.135+0000 7f36f1ffb640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f36e006aec0 0x7f36e006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.135+0000 7f36f1ffb640 1 -- 172.21.15.2:0/1165118826 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36ec089d30 con 0x7f36fc0b4de0 2023-11-25T04:08:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.135+0000 7f370117f640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f36e006aec0 0x7f36e006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.136+0000 7f370117f640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f36e006aec0 0x7f36e006d380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f36fc09dbe0 tx=0x7f36f803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.137+0000 7f277affd640 1 -- 172.21.15.2:0/844670718 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f278400a9b0 con 0x7f278c0cedd0 2023-11-25T04:08:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.137+0000 7f277affd640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f276c06ae70 0x7f276c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.138+0000 7f278a59c640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f276c06ae70 0x7f276c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.139+0000 7f278a59c640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f276c06ae70 0x7f276c06d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2780036000 tx=0x7f2780008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.139+0000 7f277affd640 1 -- 172.21.15.2:0/844670718 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2784019300 con 0x7f278c0cedd0 2023-11-25T04:08:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.144+0000 7f36f1ffb640 1 -- 172.21.15.2:0/1165118826 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f36ec054f00 con 0x7f36fc0b4de0 2023-11-25T04:08:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.152+0000 7f277affd640 1 -- 172.21.15.2:0/844670718 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2784054e90 con 0x7f278c0cedd0 2023-11-25T04:08:42.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.541+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f59240057d0 con 0x7f594006da70 2023-11-25T04:08:42.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.542+0000 7f592effd640 1 -- 172.21.15.2:0/620535042 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f593007eb40 con 0x7f594006da70 2023-11-25T04:08:42.544 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-25T04:08:42.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.544+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f61041f8140 con 0x7f61040c3ac0 2023-11-25T04:08:42.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.544+0000 7f88db7fe640 1 -- 172.21.15.2:0/2880308200 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f88d4005500 con 0x7f88f80cca20 2023-11-25T04:08:42.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.544+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1110005500 con 0x7f11280e26b0 2023-11-25T04:08:42.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.544+0000 7f60ebfff640 1 -- 172.21.15.2:0/1150125853 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f61041f8140 con 0x7f61040c3ac0 2023-11-25T04:08:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-25T04:08:42.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f11177fe640 1 -- 172.21.15.2:0/1917495468 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1124057900 con 0x7f11280e26b0 2023-11-25T04:08:42.547 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2023-11-25T04:08:42.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7fc1b8ff9640 1 -- 172.21.15.2:0/1801434174 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc1a40057d0 con 0x7fc1c4006250 2023-11-25T04:08:42.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f592006aec0 msgr2=0x7f592006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f592006aec0 0x7f592006d380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f594014ffc0 tx=0x7f5938005c40 comp rx=0 tx=0).stop 2023-11-25T04:08:42.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f594006da70 msgr2=0x7f5940158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f594006da70 0x7f5940158140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5930030150 tx=0x7f5930004a40 comp rx=0 tx=0).stop 2023-11-25T04:08:42.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7fc1baffd640 1 -- 172.21.15.2:0/1801434174 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1bc017020 con 0x7fc1c4006250 2023-11-25T04:08:42.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 shutdown_connections 2023-11-25T04:08:42.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59400ce1e0 0x7f594015ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f59400cd130 0x7f5940158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f592006aec0 0x7f592006d380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 --2- 172.21.15.2:0/620535042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f594006da70 0x7f5940158140 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5930030150 tx=0x7f5930004a40 comp rx=0 tx=0).stop 2023-11-25T04:08:42.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.545+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 >> 172.21.15.2:0/620535042 conn(0x7f594006a4d0 msgr2=0x7f5940152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.546+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 shutdown_connections 2023-11-25T04:08:42.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.546+0000 7f593f59e640 1 -- 172.21.15.2:0/620535042 wait complete. 2023-11-25T04:08:42.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.546+0000 7f88edffb640 1 -- 172.21.15.2:0/2880308200 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88f007ad10 con 0x7f88f80cca20 2023-11-25T04:08:42.550 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-25T04:08:42.551 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2023-11-25T04:08:42.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.548+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f111c06ae40 msgr2=0x7f111c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.548+0000 7f1135483640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f111c06ae40 0x7f111c06d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1128049c50 tx=0x7f1120009040 comp rx=0 tx=0).stop 2023-11-25T04:08:42.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11280e26b0 msgr2=0x7f11280d42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11280e26b0 0x7f11280d42d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f112400c7f0 tx=0x7f112400ccb0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.548+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f60f006ae40 msgr2=0x7f60f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.548+0000 7f6108fb3640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f60f006ae40 0x7f60f006d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f60f800b9e0 tx=0x7f60f8032000 comp rx=0 tx=0).stop 2023-11-25T04:08:42.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.548+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040c3ac0 msgr2=0x7f610406ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f6108fb3640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040c3ac0 0x7f610406ce90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60fc00efb0 tx=0x7f60fc00c490 comp rx=0 tx=0).stop 2023-11-25T04:08:42.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 shutdown_connections 2023-11-25T04:08:42.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f6108fb3640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f60f006ae40 0x7f60f006d300 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f60f800b9e0 tx=0x7f60f8032000 comp rx=0 tx=0).stop 2023-11-25T04:08:42.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f6108fb3640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f610406d3d0 0x7f61041fa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f6108fb3640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61040c3ac0 0x7f610406ce90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f6108fb3640 1 --2- 172.21.15.2:0/1150125853 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f61041f6830 0x7f61041f6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 shutdown_connections 2023-11-25T04:08:42.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 >> 172.21.15.2:0/1150125853 conn(0x7f61040ceb20 msgr2=0x7f6104162dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11280e26b0 0x7f11280d42d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11280500e0 0x7f112817dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f111c06ae40 0x7f111c06d300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 --2- 172.21.15.2:0/1917495468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f112803a860 0x7f1128049cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 >> 172.21.15.2:0/1917495468 conn(0x7f1128054ed0 msgr2=0x7f11280d5060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 shutdown_connections 2023-11-25T04:08:42.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.549+0000 7f1135483640 1 -- 172.21.15.2:0/1917495468 wait complete. 2023-11-25T04:08:42.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 shutdown_connections 2023-11-25T04:08:42.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7f88db7fe640 1 -- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f88dc06af10 msgr2=0x7f88dc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7f6108fb3640 1 -- 172.21.15.2:0/1150125853 wait complete. 2023-11-25T04:08:42.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7f88db7fe640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f88dc06af10 0x7f88dc06d3d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f88e8006fd0 tx=0x7f88e8008040 comp rx=0 tx=0).stop 2023-11-25T04:08:42.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7f88db7fe640 1 -- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f80cca20 msgr2=0x7f88f8158a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7fc1b8ff9640 1 -- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1ac06af10 msgr2=0x7fc1ac06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7fc1b8ff9640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1ac06af10 0x7fc1ac06d3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4034b80 tx=0x7fc1cc0aa000 comp rx=0 tx=0).stop 2023-11-25T04:08:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7f88db7fe640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f80cca20 0x7f88f8158a10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88f0032000 tx=0x7f88f0004a40 comp rx=0 tx=0).stop 2023-11-25T04:08:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7fc1b8ff9640 1 -- 172.21.15.2:0/1801434174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1c4006250 msgr2=0x7fc1c40d6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f78fc04e840 con 0x7f78fc167980 2023-11-25T04:08:42.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7fc1b8ff9640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1c4006250 0x7fc1c40d6690 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00c400 tx=0x7fc1bc00c8c0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.550+0000 7fc1b8ff9640 1 -- 172.21.15.2:0/1801434174 shutdown_connections 2023-11-25T04:08:42.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7fc1b8ff9640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1c40e7510 0x7fc1c404efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7fc1b8ff9640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1ac06af10 0x7fc1ac06d3d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7fc1b8ff9640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1c4053120 0x7fc1c4034c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7fc1b8ff9640 1 --2- 172.21.15.2:0/1801434174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1c4006250 0x7fc1c40d6690 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7fc1b8ff9640 1 -- 172.21.15.2:0/1801434174 >> 172.21.15.2:0/1801434174 conn(0x7fc1c4055310 msgr2=0x7fc1c404d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7f88db7fe640 1 -- 172.21.15.2:0/2880308200 shutdown_connections 2023-11-25T04:08:42.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7f88db7fe640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88f80cca20 0x7f88f8158a10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7fc1b8ff9640 1 -- 172.21.15.2:0/1801434174 shutdown_connections 2023-11-25T04:08:42.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7fc1b8ff9640 1 -- 172.21.15.2:0/1801434174 wait complete. 2023-11-25T04:08:42.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7f78f37fe640 1 -- 172.21.15.2:0/3552200593 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78ec060e50 con 0x7f78fc167980 2023-11-25T04:08:42.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7f88db7fe640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b3910 0x7f88f81616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7f88db7fe640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f88dc06af10 0x7f88dc06d3d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.561 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-25T04:08:42.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7f88db7fe640 1 --2- 172.21.15.2:0/2880308200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f80719d0 0x7f88f80cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.551+0000 7f88db7fe640 1 -- 172.21.15.2:0/2880308200 >> 172.21.15.2:0/2880308200 conn(0x7f88f80ceb20 msgr2=0x7f88f815ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.552+0000 7f88db7fe640 1 -- 172.21.15.2:0/2880308200 shutdown_connections 2023-11-25T04:08:42.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.552+0000 7f88db7fe640 1 -- 172.21.15.2:0/2880308200 wait complete. 2023-11-25T04:08:42.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.555+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f78dc06af10 msgr2=0x7f78dc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.555+0000 7f7900940640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f78dc06af10 0x7f78dc06d3d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f78fc15eff0 tx=0x7f78e4006060 comp rx=0 tx=0).stop 2023-11-25T04:08:42.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.555+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc167980 msgr2=0x7f78fc1f2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.555+0000 7f7900940640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc167980 0x7f78fc1f2410 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78ec009910 tx=0x7f78ec009dd0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.556+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 shutdown_connections 2023-11-25T04:08:42.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.556+0000 7f7900940640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f78fc16a1f0 0x7f78fc1f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.556+0000 7f7900940640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f78dc06af10 0x7f78dc06d3d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.556+0000 7f7900940640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f78fc167980 0x7f78fc1f2410 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.556+0000 7f7900940640 1 --2- 172.21.15.2:0/3552200593 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f78fc0ced00 0x7f78fc0899d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.556+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 >> 172.21.15.2:0/3552200593 conn(0x7f78fc06a6b0 msgr2=0x7f78fc08a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.556+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 shutdown_connections 2023-11-25T04:08:42.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.556+0000 7f7900940640 1 -- 172.21.15.2:0/3552200593 wait complete. 2023-11-25T04:08:42.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.561+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36fc04e840 con 0x7f36fc0b4de0 2023-11-25T04:08:42.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.562+0000 7f36f1ffb640 1 -- 172.21.15.2:0/1165118826 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36ec021090 con 0x7f36fc0b4de0 2023-11-25T04:08:42.564 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-25T04:08:42.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.566+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f36e006aec0 msgr2=0x7f36e006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.566+0000 7f3702181640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f36e006aec0 0x7f36e006d380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f36fc09dbe0 tx=0x7f36f803b040 comp rx=0 tx=0).stop 2023-11-25T04:08:42.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.566+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36fc0b4de0 msgr2=0x7f36fc150d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.566+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f278c0b2130 con 0x7f278c0cedd0 2023-11-25T04:08:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.566+0000 7f3702181640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36fc0b4de0 0x7f36fc150d70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36ec00e8a0 tx=0x7f36ec00ed60 comp rx=0 tx=0).stop 2023-11-25T04:08:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.567+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 shutdown_connections 2023-11-25T04:08:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.567+0000 7f3702181640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f36e006aec0 0x7f36e006d380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.567+0000 7f3702181640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36fc15bd90 0x7f36fc1525f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.567+0000 7f3702181640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f36fc0b4de0 0x7f36fc150d70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.567+0000 7f3702181640 1 --2- 172.21.15.2:0/1165118826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36fc06a4d0 0x7f36fc14ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.567+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 >> 172.21.15.2:0/1165118826 conn(0x7f36fc0b1a40 msgr2=0x7f36fc0adf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-25T04:08:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.568+0000 7f277affd640 1 -- 172.21.15.2:0/844670718 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f278c0b2130 con 0x7f278c0cedd0 2023-11-25T04:08:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:55834574852 2023-11-25T04:08:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.568+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 shutdown_connections 2023-11-25T04:08:42.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.568+0000 7f3702181640 1 -- 172.21.15.2:0/1165118826 wait complete. 2023-11-25T04:08:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f276c06ae70 msgr2=0x7f276c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f276c06ae70 0x7f276c06d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2780036000 tx=0x7f2780008030 comp rx=0 tx=0).stop 2023-11-25T04:08:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f278c0cedd0 msgr2=0x7f278c0cc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f278c0cedd0 0x7f278c0cc090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f278400c8a0 tx=0x7f278400cd60 comp rx=0 tx=0).stop 2023-11-25T04:08:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 shutdown_connections 2023-11-25T04:08:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f276c06ae70 0x7f276c06d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f278c15bf60 0x7f278c15c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f278c0cedd0 0x7f278c0cc090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 --2- 172.21.15.2:0/844670718 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f278c0b3f20 0x7f278c150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.571+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 >> 172.21.15.2:0/844670718 conn(0x7f278c070ad0 msgr2=0x7f278c15f660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.572+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 shutdown_connections 2023-11-25T04:08:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:42.572+0000 7f278b59e640 1 -- 172.21.15.2:0/844670718 wait complete. 2023-11-25T04:08:42.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-11-25T04:08:42.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-11-25T04:08:42.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-11-25T04:08:42.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-11-25T04:08:42.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-11-25T04:08:42.585 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-11-25T04:08:42.586 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2023-11-25T04:08:43.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-25T04:08:43.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-25T04:08:43.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-25T04:08:43.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-25T04:08:43.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-25T04:08:43.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-25T04:08:43.586 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-25T04:08:43.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-25T04:08:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.749+0000 7f3eb0809640 1 Processor -- start 2023-11-25T04:08:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.749+0000 7f3eb0809640 1 -- start start 2023-11-25T04:08:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.750+0000 7f3eb0809640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ea4036130 0x7f3ea40390d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.751+0000 7f3eb0809640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4054200 0x7f3ea4055150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.751+0000 7f3eb0809640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea40517a0 con 0x7f3ea4035d50 2023-11-25T04:08:43.754 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.751+0000 7f3eb0809640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea404a270 con 0x7f3ea4036130 2023-11-25T04:08:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.751+0000 7f3eb0809640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4051a40 con 0x7f3ea4054200 2023-11-25T04:08:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.752+0000 7f3eabfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4054200 0x7f3ea4055150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.752+0000 7f3eabfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4054200 0x7f3ea4055150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39812/0 (socket says 172.21.15.2:39812) 2023-11-25T04:08:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.752+0000 7f3eabfff640 1 -- 172.21.15.2:0/2969873576 learned_addr learned my addr 172.21.15.2:0/2969873576 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.752+0000 7f3eaaffd640 1 --2- 172.21.15.2:0/2969873576 >> v2:172.21.15.66:3300/0 conn(0x7f3ea4036130 0x7f3ea40390d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.752+0000 7f3eabfff640 1 -- 172.21.15.2:0/2969873576 >> v2:172.21.15.66:3300/0 conn(0x7f3ea4036130 msgr2=0x7f3ea40390d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.752+0000 7f3eabfff640 1 --2- 172.21.15.2:0/2969873576 >> v2:172.21.15.66:3300/0 conn(0x7f3ea4036130 0x7f3ea40390d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.752+0000 7f3eabfff640 1 -- 172.21.15.2:0/2969873576 >> v1:172.21.15.66:6789/0 conn(0x7f3ea4035d50 legacy=0x7f3ea4007bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.752+0000 7f3eabfff640 1 -- 172.21.15.2:0/2969873576 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4051d20 con 0x7f3ea4054200 2023-11-25T04:08:43.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.754+0000 7f3eabfff640 1 --2- 172.21.15.2:0/2969873576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4054200 0x7f3ea4055150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0620a0 tx=0x7f3eac0a5cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=441d7e92c84cda50 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.754+0000 7f3eaa7fc640 1 -- 172.21.15.2:0/2969873576 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac0a6b40 con 0x7f3ea4054200 2023-11-25T04:08:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.754+0000 7f3eaa7fc640 1 -- 172.21.15.2:0/2969873576 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac0a6ca0 con 0x7f3ea4054200 2023-11-25T04:08:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.755+0000 7f3eb0809640 1 -- 172.21.15.2:0/2969873576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4054200 msgr2=0x7f3ea4055150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.755+0000 7f3eb0809640 1 --2- 172.21.15.2:0/2969873576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4054200 0x7f3ea4055150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3eac0620a0 tx=0x7f3eac0a5cd0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.755+0000 7f3eb0809640 1 -- 172.21.15.2:0/2969873576 shutdown_connections 2023-11-25T04:08:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.755+0000 7f3eb0809640 1 --2- 172.21.15.2:0/2969873576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4054200 0x7f3ea4055150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.755+0000 7f3eb0809640 1 --2- 172.21.15.2:0/2969873576 >> v2:172.21.15.66:3300/0 conn(0x7f3ea4036130 0x7f3ea40390d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.755+0000 7f3eb0809640 1 -- 172.21.15.2:0/2969873576 >> 172.21.15.2:0/2969873576 conn(0x7f3ea4053710 msgr2=0x7f3ea4053af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.755+0000 7f3eb0809640 1 -- 172.21.15.2:0/2969873576 shutdown_connections 2023-11-25T04:08:43.764 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.755+0000 7f3eb0809640 1 -- 172.21.15.2:0/2969873576 wait complete. 2023-11-25T04:08:43.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.757+0000 7f3eb0809640 1 Processor -- start 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.758+0000 7f3eb0809640 1 -- start start 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eb0809640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ea4035d50 0x7f3ea40506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eb0809640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4036130 0x7f3ea40d4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eb0809640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4057770 0x7f3ea40d51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eaaffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4036130 0x7f3ea40d4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eaaffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4036130 0x7f3ea40d4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39822/0 (socket says 172.21.15.2:39822) 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eaaffd640 1 -- 172.21.15.2:0/3781256690 learned_addr learned my addr 172.21.15.2:0/3781256690 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eab7fe640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ea4035d50 0x7f3ea40506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eabfff640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4057770 0x7f3ea40d51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eb0809640 1 -- 172.21.15.2:0/3781256690 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea403b5e0 con 0x7f3ea4057770 2023-11-25T04:08:43.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eb0809640 1 -- 172.21.15.2:0/3781256690 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea404f0e0 con 0x7f3ea4035d50 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.759+0000 7f3eb0809640 1 -- 172.21.15.2:0/3781256690 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea404f3c0 con 0x7f3ea4036130 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.760+0000 7f3eab7fe640 1 -- 172.21.15.2:0/3781256690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4036130 msgr2=0x7f3ea40d4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.760+0000 7f3eab7fe640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4036130 0x7f3ea40d4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.760+0000 7f3eab7fe640 1 -- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4057770 msgr2=0x7f3ea40d51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.760+0000 7f3eab7fe640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4057770 0x7f3ea40d51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.760+0000 7f3eab7fe640 1 -- 172.21.15.2:0/3781256690 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac04f730 con 0x7f3ea4035d50 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.760+0000 7f3eabfff640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4057770 0x7f3ea40d51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.761+0000 7f3eab7fe640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ea4035d50 0x7f3ea40506d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800c360 tx=0x7f3e9800c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.761+0000 7f3e97fff640 1 -- 172.21.15.2:0/3781256690 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e98007230 con 0x7f3ea4035d50 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.761+0000 7f3eb0809640 1 -- 172.21.15.2:0/3781256690 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea404f6a0 con 0x7f3ea4035d50 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.761+0000 7f3eb0809640 1 -- 172.21.15.2:0/3781256690 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea404fc60 con 0x7f3ea4035d50 2023-11-25T04:08:43.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.762+0000 7f3e97fff640 1 -- 172.21.15.2:0/3781256690 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e98007390 con 0x7f3ea4035d50 2023-11-25T04:08:43.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.762+0000 7f3e97fff640 1 -- 172.21.15.2:0/3781256690 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980067d0 con 0x7f3ea4035d50 2023-11-25T04:08:43.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.764+0000 7f3e97fff640 1 -- 172.21.15.2:0/3781256690 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3e98006930 con 0x7f3ea4035d50 2023-11-25T04:08:43.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.764+0000 7f3e97fff640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3e9006af10 0x7f3e9006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.767+0000 7f3eaaffd640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3e9006af10 0x7f3e9006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.768+0000 7f3e97fff640 1 -- 172.21.15.2:0/3781256690 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e98088a60 con 0x7f3ea4035d50 2023-11-25T04:08:43.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.769+0000 7f3eaaffd640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3e9006af10 0x7f3e9006d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400dbf0 tx=0x7f3ea0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.769+0000 7f3eb0809640 1 -- 172.21.15.2:0/3781256690 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c005250 con 0x7f3ea4035d50 2023-11-25T04:08:43.777 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.775+0000 7f3e97fff640 1 -- 172.21.15.2:0/3781256690 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3e98017080 con 0x7f3ea4035d50 2023-11-25T04:08:43.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.804+0000 7f1082e36640 1 Processor -- start 2023-11-25T04:08:43.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.804+0000 7f1082e36640 1 -- start start 2023-11-25T04:08:43.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.806+0000 7f1082e36640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f107c159010 0x7f107c0ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.806+0000 7f1082e36640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f107c06c9f0 0x7f107c06ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.806+0000 7f1082e36640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f107c06d380 con 0x7f107c1593f0 2023-11-25T04:08:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.806+0000 7f1082e36640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107c15d070 con 0x7f107c06c9f0 2023-11-25T04:08:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.806+0000 7f1082e36640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c15d350 con 0x7f107c159010 2023-11-25T04:08:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.806+0000 7f10813d3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f107c06c9f0 0x7f107c06ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.806+0000 7f10813d3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f107c06c9f0 0x7f107c06ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55182/0 (socket says 172.21.15.2:55182) 2023-11-25T04:08:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.806+0000 7f10813d3640 1 -- 172.21.15.2:0/1896102102 learned_addr learned my addr 172.21.15.2:0/1896102102 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.806+0000 7ff504aca640 1 Processor -- start 2023-11-25T04:08:43.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.807+0000 7ff504aca640 1 -- start start 2023-11-25T04:08:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.807+0000 7f10813d3640 1 -- 172.21.15.2:0/1896102102 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f107c159010 msgr2=0x7f107c0ccb30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-25T04:08:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.807+0000 7f10813d3640 1 --2- 172.21.15.2:0/1896102102 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f107c159010 0x7f107c0ccb30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.807+0000 7f10813d3640 1 -- 172.21.15.2:0/1896102102 >> v1:172.21.15.66:6789/0 conn(0x7f107c1593f0 legacy=0x7f107c070cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-25T04:08:43.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.807+0000 7f10813d3640 1 -- 172.21.15.2:0/1896102102 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107c15d630 con 0x7f107c06c9f0 2023-11-25T04:08:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.807+0000 7f203119e640 1 Processor -- start 2023-11-25T04:08:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.807+0000 7f46b4e1a640 1 Processor -- start 2023-11-25T04:08:43.811 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.807+0000 7f46b4e1a640 1 -- start start 2023-11-25T04:08:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.808+0000 7ff504aca640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 0x7ff4f80e6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.808+0000 7ff504aca640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff4f80e7430 0x7ff4f80370c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.808+0000 7f5e6aead640 1 Processor -- start 2023-11-25T04:08:43.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.808+0000 7f5e6aead640 1 -- start start 2023-11-25T04:08:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7ff4ff7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff4f80e3300 0x7ff4f8055b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33066/0 (socket says 172.21.15.2:33066) 2023-11-25T04:08:43.813 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7fd8ac851640 1 Processor -- start 2023-11-25T04:08:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.807+0000 7f203119e640 1 -- start start 2023-11-25T04:08:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f203119e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7ff504aca640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80e7880 con 0x7ff4f80e3300 2023-11-25T04:08:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7ff4fffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff4f80e7430 0x7ff4f80370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7ff4fffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff4f80e7430 0x7ff4f80370c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55192/0 (socket says 172.21.15.2:55192) 2023-11-25T04:08:43.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7ff4fffff640 1 -- 172.21.15.2:0/3044140980 learned_addr learned my addr 172.21.15.2:0/3044140980 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7fd8ac851640 1 -- start start 2023-11-25T04:08:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7ff504aca640 1 -- 172.21.15.2:0/3044140980 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f8056280 con 0x7ff4f80e7430 2023-11-25T04:08:43.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f46b4e1a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f46b0153b10 0x7f46b00b2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f46b4e1a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f46b00ae430 0x7f46b00ae8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f46b4e1a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b00b2f90 con 0x7f46b0159b40 2023-11-25T04:08:43.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f46b4e1a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b006e7c0 con 0x7f46b00ae430 2023-11-25T04:08:43.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f46b4e1a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b00b31e0 con 0x7f46b0153b10 2023-11-25T04:08:43.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f203119e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f202c0cd540 0x7f202c09a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f202ad9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f202ad9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39848/0 (socket says 172.21.15.2:39848) 2023-11-25T04:08:43.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f10813d3640 1 --2- 172.21.15.2:0/1896102102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 0x7f107c06ce40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f107000b1e0 tx=0x7f107002c1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a731a87ebda9647 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f202a59c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f202c15ebf0 0x7f202c099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33072/0 (socket says 172.21.15.2:33072) 2023-11-25T04:08:43.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f719c223640 1 Processor -- start 2023-11-25T04:08:43.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f46affff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f46b0159b40 0x7f46b0159fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:46238/0 (socket says 172.21.15.2:46238) 2023-11-25T04:08:43.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f46affff640 1 -- 172.21.15.2:0/4274000346 learned_addr learned my addr 172.21.15.2:0/4274000346 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:43.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f46af7fe640 1 --2- 172.21.15.2:0/4274000346 >> v2:172.21.15.66:3300/0 conn(0x7f46b0153b10 0x7f46b00b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7f202ad9d640 1 -- 172.21.15.2:0/622747197 learned_addr learned my addr 172.21.15.2:0/622747197 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f107b7fe640 1 -- 172.21.15.2:0/1896102102 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1070034440 con 0x7f107c06c9f0 2023-11-25T04:08:43.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f107b7fe640 1 -- 172.21.15.2:0/1896102102 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10700345a0 con 0x7f107c06c9f0 2023-11-25T04:08:43.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f202b59e640 1 --2- 172.21.15.2:0/622747197 >> v2:172.21.15.66:3300/0 conn(0x7f202c0cd540 0x7f202c09a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f203119e640 1 -- 172.21.15.2:0/622747197 --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0cd170 con 0x7f202c15ebf0 2023-11-25T04:08:43.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f203119e640 1 -- 172.21.15.2:0/622747197 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0b2260 con 0x7f202c0cd540 2023-11-25T04:08:43.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f5e6aead640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5e6415e830 0x7f5e640b1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f5e6aead640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5e64099970 0x7f5e64099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f5e6aead640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6409a310 con 0x7f5e640b0830 2023-11-25T04:08:43.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f5e6aead640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e640b3890 con 0x7f5e64099970 2023-11-25T04:08:43.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f5e6aead640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6409a540 con 0x7f5e6415e830 2023-11-25T04:08:43.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f46aeffd640 1 --2- 172.21.15.2:0/4274000346 >> v2:172.21.15.2:3300/0 conn(0x7f46b00ae430 0x7f46b00ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f203119e640 1 -- 172.21.15.2:0/622747197 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0b37b0 con 0x7f202c15e810 2023-11-25T04:08:43.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f5e6944a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5e640b0830 0x7f5e640b0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33080/0 (socket says 172.21.15.2:33080) 2023-11-25T04:08:43.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f5e6944a640 1 -- 172.21.15.2:0/1520497863 learned_addr learned my addr 172.21.15.2:0/1520497863 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:43.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7ff4feffd640 1 --2- 172.21.15.2:0/3044140980 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 0x7ff4f80e6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.809+0000 7ff504aca640 1 -- 172.21.15.2:0/3044140980 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80564e0 con 0x7ff4f80579d0 2023-11-25T04:08:43.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f5e68c49640 1 --2- 172.21.15.2:0/1520497863 >> v2:172.21.15.66:3300/0 conn(0x7f5e6415e830 0x7f5e640b1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f5e63fff640 1 --2- 172.21.15.2:0/1520497863 >> v2:172.21.15.2:3300/0 conn(0x7f5e64099970 0x7f5e64099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f46aeffd640 1 -- 172.21.15.2:0/4274000346 >> v2:172.21.15.66:3300/0 conn(0x7f46b0153b10 msgr2=0x7f46b00b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7fd8ac851640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a815a010 0x7fd8a806f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f1082e36640 1 -- 172.21.15.2:0/1896102102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 msgr2=0x7f107c06ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f1082e36640 1 --2- 172.21.15.2:0/1896102102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 0x7f107c06ce40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f107000b1e0 tx=0x7f107002c1a0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7fd8ac851640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8a8071a40 0x7fd8a80adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7fd8ac851640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a80ae400 con 0x7fd8a815a3f0 2023-11-25T04:08:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7fd8ac851640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a80ae1f0 con 0x7fd8a8071a40 2023-11-25T04:08:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7fd8ac851640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80ae6e0 con 0x7fd8a815a010 2023-11-25T04:08:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7fd8a5d9b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd8a815a3f0 0x7fd8a8071330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33096/0 (socket says 172.21.15.2:33096) 2023-11-25T04:08:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7fd8a5d9b640 1 -- 172.21.15.2:0/988815184 learned_addr learned my addr 172.21.15.2:0/988815184 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7fd8a659c640 1 --2- 172.21.15.2:0/988815184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a815a010 0x7fd8a806f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7fd8a6d9d640 1 --2- 172.21.15.2:0/988815184 >> v2:172.21.15.66:3300/0 conn(0x7fd8a8071a40 0x7fd8a80adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f719c223640 1 -- start start 2023-11-25T04:08:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f1082e36640 1 -- 172.21.15.2:0/1896102102 shutdown_connections 2023-11-25T04:08:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f1082e36640 1 --2- 172.21.15.2:0/1896102102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 0x7f107c06ce40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f1082e36640 1 --2- 172.21.15.2:0/1896102102 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f107c159010 0x7f107c0ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f1082e36640 1 -- 172.21.15.2:0/1896102102 >> 172.21.15.2:0/1896102102 conn(0x7f107c06a4d0 msgr2=0x7f107c06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:43.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f46aeffd640 1 --2- 172.21.15.2:0/4274000346 >> v2:172.21.15.66:3300/0 conn(0x7f46b0153b10 0x7f46b00b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f719c223640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7194160ad0 0x7f71940b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f46aeffd640 1 -- 172.21.15.2:0/4274000346 >> v1:172.21.15.66:6789/0 conn(0x7f46b0159b40 legacy=0x7f46b0159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7ff4fffff640 1 -- 172.21.15.2:0/3044140980 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 msgr2=0x7ff4f80e6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7ff4fffff640 1 --2- 172.21.15.2:0/3044140980 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 0x7ff4f80e6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7ff4fffff640 1 -- 172.21.15.2:0/3044140980 >> v1:172.21.15.2:6789/0 conn(0x7ff4f80e3300 legacy=0x7ff4f8055b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7ff4fffff640 1 -- 172.21.15.2:0/3044140980 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80365e0 con 0x7ff4f80e7430 2023-11-25T04:08:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f5e637fe640 1 -- 172.21.15.2:0/1520497863 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 111616489 0 0) 0x7f5e6409a310 con 0x7f5e640b0830 2023-11-25T04:08:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f5e637fe640 1 -- 172.21.15.2:0/1520497863 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e4c003520 con 0x7f5e640b0830 2023-11-25T04:08:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f5e63fff640 1 -- 172.21.15.2:0/1520497863 >> v2:172.21.15.66:3300/0 conn(0x7f5e6415e830 msgr2=0x7f5e640b1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f5e63fff640 1 --2- 172.21.15.2:0/1520497863 >> v2:172.21.15.66:3300/0 conn(0x7f5e6415e830 0x7f5e640b1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f5e63fff640 1 -- 172.21.15.2:0/1520497863 >> v1:172.21.15.2:6789/0 conn(0x7f5e640b0830 legacy=0x7f5e640b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f5e63fff640 1 -- 172.21.15.2:0/1520497863 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e640cc5d0 con 0x7f5e64099970 2023-11-25T04:08:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f46aeffd640 1 -- 172.21.15.2:0/4274000346 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00b34c0 con 0x7f46b00ae430 2023-11-25T04:08:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7fd8a6d9d640 1 -- 172.21.15.2:0/988815184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a815a010 msgr2=0x7fd8a806f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7fd8a6d9d640 1 --2- 172.21.15.2:0/988815184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a815a010 0x7fd8a806f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7fd8a6d9d640 1 -- 172.21.15.2:0/988815184 >> v1:172.21.15.2:6789/0 conn(0x7fd8a815a3f0 legacy=0x7fd8a8071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7fd8a6d9d640 1 -- 172.21.15.2:0/988815184 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80ae9c0 con 0x7fd8a8071a40 2023-11-25T04:08:43.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f202b59e640 1 -- 172.21.15.2:0/622747197 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 msgr2=0x7f202c0ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f202b59e640 1 --2- 172.21.15.2:0/622747197 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.810+0000 7f202b59e640 1 -- 172.21.15.2:0/622747197 >> v1:172.21.15.2:6789/0 conn(0x7f202c15ebf0 legacy=0x7f202c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f202b59e640 1 -- 172.21.15.2:0/622747197 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0cc720 con 0x7f202c0cd540 2023-11-25T04:08:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f46aeffd640 1 --2- 172.21.15.2:0/4274000346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00ae430 0x7f46b00ae8e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46b00d0270 tx=0x7f46a402d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2985c557f4a7c154 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f1082e36640 1 -- 172.21.15.2:0/1896102102 shutdown_connections 2023-11-25T04:08:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f719c223640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71940d0240 0x7f71940ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f719c223640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71940d16a0 con 0x7f71940b2110 2023-11-25T04:08:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f719c223640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71940d1980 con 0x7f7194160ad0 2023-11-25T04:08:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.811+0000 7f719c223640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71940d1c60 con 0x7f71940d0240 2023-11-25T04:08:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f719a7c0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71940d0240 0x7f71940ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f719a7c0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71940d0240 0x7f71940ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39876/0 (socket says 172.21.15.2:39876) 2023-11-25T04:08:43.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f719a7c0640 1 -- 172.21.15.2:0/4084364377 learned_addr learned my addr 172.21.15.2:0/4084364377 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f202b59e640 1 --2- 172.21.15.2:0/622747197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 0x7f202c09a080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2024009d90 tx=0x7f20240302d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c5d45abadb6459 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f7199fbf640 1 --2- 172.21.15.2:0/4084364377 >> v2:172.21.15.2:3300/0 conn(0x7f7194160ad0 0x7f71940b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f46ae7fc640 1 -- 172.21.15.2:0/4274000346 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4032890 con 0x7f46b00ae430 2023-11-25T04:08:43.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f719a7c0640 1 -- 172.21.15.2:0/4084364377 >> v2:172.21.15.2:3300/0 conn(0x7f7194160ad0 msgr2=0x7f71940b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7f719a7c0640 1 --2- 172.21.15.2:0/4084364377 >> v2:172.21.15.2:3300/0 conn(0x7f7194160ad0 0x7f71940b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f1082e36640 1 -- 172.21.15.2:0/1896102102 wait complete. 2023-11-25T04:08:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7f719a7c0640 1 -- 172.21.15.2:0/4084364377 >> v1:172.21.15.66:6789/0 conn(0x7f71940b2110 legacy=0x7f71940cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.833 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7f719a7c0640 1 -- 172.21.15.2:0/4084364377 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940d1f40 con 0x7f71940d0240 2023-11-25T04:08:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7ff4fffff640 1 --2- 172.21.15.2:0/3044140980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e7430 0x7ff4f80370c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5000620a0 tx=0x7ff5000a5e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed18bc5c318d4bee server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7fd8a6d9d640 1 --2- 172.21.15.2:0/988815184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a8071a40 0x7fd8a80adcb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80ce9e0 tx=0x7fd8a002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44553d345ef699b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7ff4fe7fc640 1 -- 172.21.15.2:0/3044140980 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000a6cc0 con 0x7ff4f80e7430 2023-11-25T04:08:43.834 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7ff4fe7fc640 1 -- 172.21.15.2:0/3044140980 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5000a6e20 con 0x7ff4f80e7430 2023-11-25T04:08:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7f46ae7fc640 1 -- 172.21.15.2:0/4274000346 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a40329f0 con 0x7f46b00ae430 2023-11-25T04:08:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7f46ae7fc640 1 -- 172.21.15.2:0/4274000346 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4032d80 con 0x7f46b00ae430 2023-11-25T04:08:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7ff4fe7fc640 1 -- 172.21.15.2:0/3044140980 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000ae640 con 0x7ff4f80e7430 2023-11-25T04:08:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7f5e63fff640 1 --2- 172.21.15.2:0/1520497863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64099970 0x7f5e64099dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e640b3b20 tx=0x7f5e5c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a470399575eadb94 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.812+0000 7f2029d9b640 1 -- 172.21.15.2:0/622747197 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024038640 con 0x7f202c0cd540 2023-11-25T04:08:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7f2029d9b640 1 -- 172.21.15.2:0/622747197 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20240387a0 con 0x7f202c0cd540 2023-11-25T04:08:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.813+0000 7f2029d9b640 1 -- 172.21.15.2:0/622747197 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2024038b70 con 0x7f202c0cd540 2023-11-25T04:08:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f46b4e1a640 1 -- 172.21.15.2:0/4274000346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00ae430 msgr2=0x7f46b00ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f46b4e1a640 1 --2- 172.21.15.2:0/4274000346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00ae430 0x7f46b00ae8e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46b00d0270 tx=0x7f46a402d9d0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f203119e640 1 -- 172.21.15.2:0/622747197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 msgr2=0x7f202c09a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f203119e640 1 --2- 172.21.15.2:0/622747197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 0x7f202c09a080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2024009d90 tx=0x7f20240302d0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7fd8a559a640 1 -- 172.21.15.2:0/988815184 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a002cbd0 con 0x7fd8a8071a40 2023-11-25T04:08:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7fd8a559a640 1 -- 172.21.15.2:0/988815184 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a002cd30 con 0x7fd8a8071a40 2023-11-25T04:08:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f5e637fe640 1 -- 172.21.15.2:0/1520497863 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c02cc90 con 0x7f5e64099970 2023-11-25T04:08:43.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f5e637fe640 1 -- 172.21.15.2:0/1520497863 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c02cdf0 con 0x7f5e64099970 2023-11-25T04:08:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f1082e36640 1 Processor -- start 2023-11-25T04:08:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f1082e36640 1 -- start start 2023-11-25T04:08:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f46b4e1a640 1 -- 172.21.15.2:0/4274000346 shutdown_connections 2023-11-25T04:08:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f46b4e1a640 1 --2- 172.21.15.2:0/4274000346 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00ae430 0x7f46b00ae8e0 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f46b00d0270 tx=0x7f46a402d9d0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f46b4e1a640 1 --2- 172.21.15.2:0/4274000346 >> v2:172.21.15.66:3300/0 conn(0x7f46b0153b10 0x7f46b00b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f46b4e1a640 1 -- 172.21.15.2:0/4274000346 >> 172.21.15.2:0/4274000346 conn(0x7f46b00cf3f0 msgr2=0x7f46b00cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:43.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f46b4e1a640 1 -- 172.21.15.2:0/4274000346 shutdown_connections 2023-11-25T04:08:43.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f203119e640 1 -- 172.21.15.2:0/622747197 shutdown_connections 2023-11-25T04:08:43.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f203119e640 1 --2- 172.21.15.2:0/622747197 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 0x7f202c09a080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f203119e640 1 --2- 172.21.15.2:0/622747197 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f203119e640 1 -- 172.21.15.2:0/622747197 >> 172.21.15.2:0/622747197 conn(0x7f202c0b2a70 msgr2=0x7f202c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:43.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7ff504aca640 1 -- 172.21.15.2:0/3044140980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e7430 msgr2=0x7ff4f80370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7ff504aca640 1 --2- 172.21.15.2:0/3044140980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e7430 0x7ff4f80370c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff5000620a0 tx=0x7ff5000a5e50 comp rx=0 tx=0).stop 2023-11-25T04:08:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7ff504aca640 1 -- 172.21.15.2:0/3044140980 shutdown_connections 2023-11-25T04:08:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7ff504aca640 1 --2- 172.21.15.2:0/3044140980 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 0x7ff4f80e6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7ff504aca640 1 --2- 172.21.15.2:0/3044140980 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e7430 0x7ff4f80370c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7ff504aca640 1 -- 172.21.15.2:0/3044140980 >> 172.21.15.2:0/3044140980 conn(0x7ff4f8020000 msgr2=0x7ff4f8056d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7ff504aca640 1 -- 172.21.15.2:0/3044140980 shutdown_connections 2023-11-25T04:08:43.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7ff504aca640 1 -- 172.21.15.2:0/3044140980 wait complete. 2023-11-25T04:08:43.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f5e637fe640 1 -- 172.21.15.2:0/1520497863 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c034640 con 0x7f5e64099970 2023-11-25T04:08:43.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f5e6aead640 1 -- 172.21.15.2:0/1520497863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64099970 msgr2=0x7f5e64099dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f5e6aead640 1 --2- 172.21.15.2:0/1520497863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64099970 0x7f5e64099dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5e640b3b20 tx=0x7f5e5c02bee0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7fd8ac851640 1 -- 172.21.15.2:0/988815184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a8071a40 msgr2=0x7fd8a80adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7fd8ac851640 1 --2- 172.21.15.2:0/988815184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a8071a40 0x7fd8a80adcb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd8a80ce9e0 tx=0x7fd8a002be20 comp rx=0 tx=0).stop 2023-11-25T04:08:43.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.814+0000 7f46b4e1a640 1 -- 172.21.15.2:0/4274000346 wait complete. 2023-11-25T04:08:43.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f203119e640 1 -- 172.21.15.2:0/622747197 shutdown_connections 2023-11-25T04:08:43.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f1082e36640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 0x7f107c14e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f5e6aead640 1 -- 172.21.15.2:0/1520497863 shutdown_connections 2023-11-25T04:08:43.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f5e6aead640 1 --2- 172.21.15.2:0/1520497863 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64099970 0x7f5e64099dd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f5e6aead640 1 --2- 172.21.15.2:0/1520497863 >> v2:172.21.15.66:3300/0 conn(0x7f5e6415e830 0x7f5e640b1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f5e6aead640 1 -- 172.21.15.2:0/1520497863 >> 172.21.15.2:0/1520497863 conn(0x7f5e640b2a20 msgr2=0x7f5e640b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:43.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f203119e640 1 -- 172.21.15.2:0/622747197 wait complete. 2023-11-25T04:08:43.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f1082e36640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f107c159010 0x7f107c14ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f5e6aead640 1 -- 172.21.15.2:0/1520497863 shutdown_connections 2023-11-25T04:08:43.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f5e6aead640 1 -- 172.21.15.2:0/1520497863 wait complete. 2023-11-25T04:08:43.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.815+0000 7f1082e36640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f107c14bc50 0x7f107c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f1080bd2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 0x7f107c14e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f1080bd2640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 0x7f107c14e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55228/0 (socket says 172.21.15.2:55228) 2023-11-25T04:08:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7fd8ac851640 1 -- 172.21.15.2:0/988815184 shutdown_connections 2023-11-25T04:08:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7fd8ac851640 1 --2- 172.21.15.2:0/988815184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a8071a40 0x7fd8a80adcb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7fd8ac851640 1 --2- 172.21.15.2:0/988815184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a815a010 0x7fd8a806f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7fd8ac851640 1 -- 172.21.15.2:0/988815184 >> 172.21.15.2:0/988815184 conn(0x7fd8a80cfe00 msgr2=0x7fd8a80d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:43.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f107bfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f107c159010 0x7f107c14ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f719a7c0640 1 --2- 172.21.15.2:0/4084364377 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71940d0240 0x7f71940ce230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f718c013150 tx=0x7f718c033f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f4fe50d8f4fd8d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7fd8ac851640 1 -- 172.21.15.2:0/988815184 shutdown_connections 2023-11-25T04:08:43.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7fd8ac851640 1 -- 172.21.15.2:0/988815184 wait complete. 2023-11-25T04:08:43.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f1080bd2640 1 -- 172.21.15.2:0/2545152763 learned_addr learned my addr 172.21.15.2:0/2545152763 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f7198fbd640 1 -- 172.21.15.2:0/4084364377 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c034c90 con 0x7f71940d0240 2023-11-25T04:08:43.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c148c70 con 0x7f107c14bc50 2023-11-25T04:08:43.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107c14e780 con 0x7f107c06c9f0 2023-11-25T04:08:43.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f7198fbd640 1 -- 172.21.15.2:0/4084364377 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c034df0 con 0x7f71940d0240 2023-11-25T04:08:43.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107c148ee0 con 0x7f107c159010 2023-11-25T04:08:43.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7f46b4e1a640 1 Processor -- start 2023-11-25T04:08:43.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.817+0000 7f46b4e1a640 1 -- start start 2023-11-25T04:08:43.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7ff504aca640 1 Processor -- start 2023-11-25T04:08:43.848 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.816+0000 7ff504aca640 1 -- start start 2023-11-25T04:08:43.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.817+0000 7f10813d3640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f107c14bc50 0x7f107c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.817+0000 7f719c223640 1 -- 172.21.15.2:0/4084364377 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71940d0240 msgr2=0x7f71940ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.817+0000 7f719c223640 1 --2- 172.21.15.2:0/4084364377 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71940d0240 0x7f71940ce230 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f718c013150 tx=0x7f718c033f60 comp rx=0 tx=0).stop 2023-11-25T04:08:43.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.817+0000 7f719c223640 1 -- 172.21.15.2:0/4084364377 shutdown_connections 2023-11-25T04:08:43.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.817+0000 7f719c223640 1 --2- 172.21.15.2:0/4084364377 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71940d0240 0x7f71940ce230 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.817+0000 7f719c223640 1 --2- 172.21.15.2:0/4084364377 >> v2:172.21.15.2:3300/0 conn(0x7f7194160ad0 0x7f71940b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.817+0000 7f719c223640 1 -- 172.21.15.2:0/4084364377 >> 172.21.15.2:0/4084364377 conn(0x7f719409c500 msgr2=0x7f71940d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:43.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.817+0000 7ff504aca640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 0x7ff4f804c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff504aca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e3300 0x7ff4f817cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f10813d3640 1 -- 172.21.15.2:0/2545152763 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f107c159010 msgr2=0x7f107c14ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff504aca640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4f80e7430 0x7ff4f817d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f719c223640 1 -- 172.21.15.2:0/4084364377 shutdown_connections 2023-11-25T04:08:43.851 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f10813d3640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f107c159010 0x7f107c14ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f203119e640 1 Processor -- start 2023-11-25T04:08:43.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46b4e1a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46b0153b10 0x7f46b015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff4feffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e3300 0x7ff4f817cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff4feffd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e3300 0x7ff4f817cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55236/0 (socket says 172.21.15.2:55236) 2023-11-25T04:08:43.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff4feffd640 1 -- 172.21.15.2:0/2099343328 learned_addr learned my addr 172.21.15.2:0/2099343328 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff504aca640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f817d5e0 con 0x7ff4f80e7430 2023-11-25T04:08:43.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46b4e1a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46b0159b40 0x7f46b015b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f203119e640 1 -- start start 2023-11-25T04:08:43.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f804cfc0 con 0x7ff4f80e3300 2023-11-25T04:08:43.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46b4e1a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00adf10 0x7f46b01ffe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80da9a0 con 0x7ff4f80579d0 2023-11-25T04:08:43.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46b4e1a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b0200bd0 con 0x7f46b00adf10 2023-11-25T04:08:43.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f719c223640 1 -- 172.21.15.2:0/4084364377 wait complete. 2023-11-25T04:08:43.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46b4e1a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00af040 con 0x7f46b0153b10 2023-11-25T04:08:43.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46b4e1a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b00af320 con 0x7f46b0159b40 2023-11-25T04:08:43.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff4ff7fe640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 0x7ff4f804c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46af7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46b0153b10 0x7f46b015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46affff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00adf10 0x7f46b01ffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.856 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46af7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46b0153b10 0x7f46b015b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55250/0 (socket says 172.21.15.2:55250) 2023-11-25T04:08:43.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46af7fe640 1 -- 172.21.15.2:0/454786012 learned_addr learned my addr 172.21.15.2:0/454786012 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f46aeffd640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46b0159b40 0x7f46b015b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7ff4fffff640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4f80e7430 0x7ff4f817d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7f5e6aead640 1 Processor -- start 2023-11-25T04:08:43.857 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7f5e6aead640 1 -- start start 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f10813d3640 1 -- 172.21.15.2:0/2545152763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 msgr2=0x7f107c14e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f10813d3640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 0x7f107c14e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f10813d3640 1 -- 172.21.15.2:0/2545152763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070009d60 con 0x7f107c14bc50 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7f1080bd2640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 0x7f107c14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7f46af7fe640 1 -- 172.21.15.2:0/454786012 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46b0159b40 msgr2=0x7f46b015b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7f46af7fe640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46b0159b40 0x7f46b015b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7f46af7fe640 1 -- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00adf10 msgr2=0x7f46b01ffe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7f46af7fe640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00adf10 0x7f46b01ffe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7f46af7fe640 1 -- 172.21.15.2:0/454786012 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4009400 con 0x7f46b0153b10 2023-11-25T04:08:43.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7f46affff640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00adf10 0x7f46b01ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4feffd640 1 -- 172.21.15.2:0/2099343328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 msgr2=0x7ff4f804c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4feffd640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 0x7ff4f804c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4feffd640 1 -- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4f80e7430 msgr2=0x7ff4f817d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4feffd640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4f80e7430 0x7ff4f817d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4feffd640 1 -- 172.21.15.2:0/2099343328 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff50004f730 con 0x7ff4f80e3300 2023-11-25T04:08:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4ff7fe640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 0x7ff4f804c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:43.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4feffd640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e3300 0x7ff4f817cb60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00e870 tx=0x7ff4ec00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7fd8ac851640 1 Processor -- start 2023-11-25T04:08:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4ebfff640 1 -- 172.21.15.2:0/2099343328 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0094f0 con 0x7ff4f80e3300 2023-11-25T04:08:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4ebfff640 1 -- 172.21.15.2:0/2099343328 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec00c940 con 0x7ff4f80e3300 2023-11-25T04:08:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7ff4ebfff640 1 -- 172.21.15.2:0/2099343328 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec00ccf0 con 0x7ff4f80e3300 2023-11-25T04:08:43.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f80e3860 con 0x7ff4f80e3300 2023-11-25T04:08:43.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f719c223640 1 Processor -- start 2023-11-25T04:08:43.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f203119e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 0x7f202c155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f719c223640 1 -- start start 2023-11-25T04:08:43.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f80dac40 con 0x7ff4f80e3300 2023-11-25T04:08:43.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f203119e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f203119e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f202c15ebf0 0x7f202c0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f5e6aead640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64099970 0x7f5e640ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.818+0000 7fd8ac851640 1 -- start start 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7fd8ac851640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8071a40 0x7fd8a8158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7fd8ac851640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a815a010 0x7fd8a814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7fd8ac851640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a814b870 0x7fd8a81f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7fd8ac851640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a81ec4b0 con 0x7fd8a815a010 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7fd8ac851640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a814a290 con 0x7fd8a814b870 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7fd8ac851640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a814a570 con 0x7fd8a8071a40 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a815a010 0x7fd8a814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a815a010 0x7fd8a814b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53448/0 (socket says 172.21.15.2:53448) 2023-11-25T04:08:43.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a5d9b640 1 -- 172.21.15.2:0/2547882877 learned_addr learned my addr 172.21.15.2:0/2547882877 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a659c640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8071a40 0x7fd8a8158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a6d9d640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a814b870 0x7fd8a81f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a5d9b640 1 -- 172.21.15.2:0/2547882877 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8071a40 msgr2=0x7fd8a8158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a5d9b640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8071a40 0x7fd8a8158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a5d9b640 1 -- 172.21.15.2:0/2547882877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a814b870 msgr2=0x7fd8a81f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a5d9b640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a814b870 0x7fd8a81f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a5d9b640 1 -- 172.21.15.2:0/2547882877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a0009a70 con 0x7fd8a815a010 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a6d9d640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a814b870 0x7fd8a81f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7fd8a5d9b640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a815a010 0x7fd8a814b330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00b430 tx=0x7fd89c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f10813d3640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f107c14bc50 0x7f107c15a290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1070033000 tx=0x7f10700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f202ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 0x7f202c155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f202ad9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 0x7f202c155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55272/0 (socket says 172.21.15.2:55272) 2023-11-25T04:08:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f202a59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f202a59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0c8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:39930/0 (socket says 172.21.15.2:39930) 2023-11-25T04:08:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f202b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f202c15ebf0 0x7f202c0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f202b59e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f202c15ebf0 0x7f202c0c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53454/0 (socket says 172.21.15.2:53454) 2023-11-25T04:08:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.819+0000 7f46af7fe640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46b0153b10 0x7f46b015b200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46a000a7f0 tx=0x7f46a000acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f4697fff640 1 -- 172.21.15.2:0/454786012 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000d930 con 0x7f46b0153b10 2023-11-25T04:08:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b0154070 con 0x7f46b0153b10 2023-11-25T04:08:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b00af8e0 con 0x7f46b0153b10 2023-11-25T04:08:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f4697fff640 1 -- 172.21.15.2:0/454786012 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a000da90 con 0x7f46b0153b10 2023-11-25T04:08:43.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f4697fff640 1 -- 172.21.15.2:0/454786012 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a000d930 con 0x7f46b0153b10 2023-11-25T04:08:43.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7fd896ffd640 1 -- 172.21.15.2:0/2547882877 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c011830 con 0x7fd8a815a010 2023-11-25T04:08:43.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7fd896ffd640 1 -- 172.21.15.2:0/2547882877 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89c0119b0 con 0x7fd8a815a010 2023-11-25T04:08:43.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7fd8ac851640 1 -- 172.21.15.2:0/2547882877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a814a850 con 0x7fd8a815a010 2023-11-25T04:08:43.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7fd896ffd640 1 -- 172.21.15.2:0/2547882877 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89c011d60 con 0x7fd8a815a010 2023-11-25T04:08:43.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7fd8ac851640 1 -- 172.21.15.2:0/2547882877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a814ae10 con 0x7fd8a815a010 2023-11-25T04:08:43.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f5e6aead640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5e640b0830 0x7f5e6414d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.820+0000 7f5e6aead640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e6415e830 0x7f5e641f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f5e6aead640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e641f7bb0 con 0x7f5e64099970 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f5e6aead640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e640cd040 con 0x7f5e6415e830 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f5e6aead640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e641f7dc0 con 0x7f5e640b0830 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f5e6944a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e6415e830 0x7f5e641f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f5e6944a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e6415e830 0x7f5e641f7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55274/0 (socket says 172.21.15.2:55274) 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f5e6944a640 1 -- 172.21.15.2:0/863628862 learned_addr learned my addr 172.21.15.2:0/863628862 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f5e63fff640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5e640b0830 0x7f5e6414d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f5e68c49640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64099970 0x7f5e640ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f719c223640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940b2110 0x7f71941ef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f719c223640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71940d0240 0x7f71940b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f719c223640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7194160ad0 0x7f71940b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f719c223640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b6d10 con 0x7f71940b2110 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f719c223640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71940b6fc0 con 0x7f71940d0240 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f719c223640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719415e490 con 0x7f7194160ad0 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f71997be640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71940d0240 0x7f71940b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f71997be640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71940d0240 0x7f71940b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55288/0 (socket says 172.21.15.2:55288) 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f71997be640 1 -- 172.21.15.2:0/4247158511 learned_addr learned my addr 172.21.15.2:0/4247158511 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.821+0000 7f719a7c0640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7194160ad0 0x7f71940b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f71997be640 1 -- 172.21.15.2:0/4247158511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7194160ad0 msgr2=0x7f71940b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f71997be640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7194160ad0 0x7f71940b67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f71997be640 1 -- 172.21.15.2:0/4247158511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940b2110 msgr2=0x7f71941ef0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f71997be640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940b2110 0x7f71941ef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f203119e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0c9820 con 0x7f202c15ebf0 2023-11-25T04:08:43.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c158590 con 0x7f202c0cd540 2023-11-25T04:08:43.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f202ad9d640 1 -- 172.21.15.2:0/1984335427 learned_addr learned my addr 172.21.15.2:0/1984335427 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:43.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c155870 con 0x7f202c15e810 2023-11-25T04:08:43.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f5e6944a640 1 -- 172.21.15.2:0/863628862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5e640b0830 msgr2=0x7f5e6414d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f5e6944a640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5e640b0830 0x7f5e6414d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f80056d0 con 0x7ff4f80e3300 2023-11-25T04:08:43.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f5e6944a640 1 -- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64099970 msgr2=0x7f5e640ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f5e6944a640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64099970 0x7f5e640ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f71997be640 1 -- 172.21.15.2:0/4247158511 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c011d70 con 0x7f71940d0240 2023-11-25T04:08:43.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7fd894ff9640 1 -- 172.21.15.2:0/2547882877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd880005250 con 0x7fd8a815a010 2023-11-25T04:08:43.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f5e6944a640 1 -- 172.21.15.2:0/863628862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c009a70 con 0x7f5e6415e830 2023-11-25T04:08:43.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f719a7c0640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7194160ad0 0x7f71940b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:43.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f71997be640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71940d0240 0x7f71940b87f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f718400c780 tx=0x7f718400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f10797fa640 1 -- 172.21.15.2:0/2545152763 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107003f830 con 0x7f107c14bc50 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f10797fa640 1 -- 172.21.15.2:0/2545152763 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107003f990 con 0x7f107c14bc50 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f10797fa640 1 -- 172.21.15.2:0/2545152763 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107003fd40 con 0x7f107c14bc50 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f107c1491c0 con 0x7f107c14bc50 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.822+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107c14d430 con 0x7f107c14bc50 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f202ad9d640 1 -- 172.21.15.2:0/1984335427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 msgr2=0x7f202c0c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f202ad9d640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f202ad9d640 1 -- 172.21.15.2:0/1984335427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f202c15ebf0 msgr2=0x7f202c0c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f202ad9d640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f202c15ebf0 0x7f202c0c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:43.880 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f202ad9d640 1 -- 172.21.15.2:0/1984335427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2024009a70 con 0x7f202c0cd540 2023-11-25T04:08:43.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f718a7fc640 1 -- 172.21.15.2:0/4247158511 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7184005270 con 0x7f71940d0240 2023-11-25T04:08:43.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f718a7fc640 1 -- 172.21.15.2:0/4247158511 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71840053d0 con 0x7f71940d0240 2023-11-25T04:08:43.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719415e770 con 0x7f71940d0240 2023-11-25T04:08:43.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f5e6944a640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e6415e830 0x7f5e641f7670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800c3c0 tx=0x7f5e58001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f202ad9d640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 0x7f202c155330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2020009fd0 tx=0x7f202000ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7194157be0 con 0x7f71940d0240 2023-11-25T04:08:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4690005250 con 0x7f46b0153b10 2023-11-25T04:08:43.886 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f4697fff640 1 -- 172.21.15.2:0/454786012 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f46a000dc00 con 0x7f46b0153b10 2023-11-25T04:08:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.823+0000 7f4697fff640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f469c06af00 0x7f469c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.824+0000 7f718a7fc640 1 -- 172.21.15.2:0/4247158511 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718400a840 con 0x7f71940d0240 2023-11-25T04:08:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.824+0000 7ff4ebfff640 1 -- 172.21.15.2:0/2099343328 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4ec005990 con 0x7ff4f80e3300 2023-11-25T04:08:43.887 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.824+0000 7f4697fff640 1 -- 172.21.15.2:0/454786012 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46a0058740 con 0x7f46b0153b10 2023-11-25T04:08:43.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.824+0000 7f46aeffd640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f469c06af00 0x7f469c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.824+0000 7ff4ebfff640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff4e406ae90 0x7ff4e406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.824+0000 7ff4ebfff640 1 -- 172.21.15.2:0/2099343328 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4ec089560 con 0x7ff4f80e3300 2023-11-25T04:08:43.888 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.825+0000 7ff4ff7fe640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff4e406ae90 0x7ff4e406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.825+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71940a11e0 con 0x7f71940d0240 2023-11-25T04:08:43.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.825+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c005250 con 0x7f107c14bc50 2023-11-25T04:08:43.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.825+0000 7f46aeffd640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f469c06af00 0x7f469c06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46a4038000 tx=0x7f46a4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.825+0000 7ff4ff7fe640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff4e406ae90 0x7ff4e406d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4000fb0 tx=0x7ff4f4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.825+0000 7fd896ffd640 1 -- 172.21.15.2:0/2547882877 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd89c01a400 con 0x7fd8a815a010 2023-11-25T04:08:43.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.826+0000 7fd896ffd640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd88806ae90 0x7fd88806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.826+0000 7f10797fa640 1 -- 172.21.15.2:0/2545152763 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f107003b040 con 0x7f107c14bc50 2023-11-25T04:08:43.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.826+0000 7fd896ffd640 1 -- 172.21.15.2:0/2547882877 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd89c089c20 con 0x7fd8a815a010 2023-11-25T04:08:43.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.826+0000 7fd8a659c640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd88806ae90 0x7fd88806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.826+0000 7f10797fa640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f106806ae90 0x7f106806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.826+0000 7f1080bd2640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f106806ae90 0x7f106806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.827+0000 7fd8a659c640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd88806ae90 0x7fd88806d350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd89800b240 tx=0x7fd89800b3a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.827+0000 7f1080bd2640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f106806ae90 0x7f106806d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f107400c570 tx=0x7f107400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.828+0000 7ff4ebfff640 1 -- 172.21.15.2:0/2099343328 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4ec054780 con 0x7ff4f80e3300 2023-11-25T04:08:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.829+0000 7f718a7fc640 1 -- 172.21.15.2:0/4247158511 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f718400a9a0 con 0x7f71940d0240 2023-11-25T04:08:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.829+0000 7f718a7fc640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f717806ae40 0x7f717806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.829+0000 7f7199fbf640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f717806ae40 0x7f717806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.830+0000 7f7199fbf640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f717806ae40 0x7f717806d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71900070b0 tx=0x7f7190007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.832+0000 7f718a7fc640 1 -- 172.21.15.2:0/4247158511 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7184057f30 con 0x7f71940d0240 2023-11-25T04:08:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.832+0000 7f20137fe640 1 -- 172.21.15.2:0/1984335427 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000c940 con 0x7f202c0cd540 2023-11-25T04:08:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.832+0000 7f4697fff640 1 -- 172.21.15.2:0/454786012 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46a0054b10 con 0x7f46b0153b10 2023-11-25T04:08:43.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.832+0000 7f20137fe640 1 -- 172.21.15.2:0/1984335427 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f202000caa0 con 0x7f202c0cd540 2023-11-25T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.832+0000 7f5e617fa640 1 -- 172.21.15.2:0/863628862 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58005ce0 con 0x7f5e6415e830 2023-11-25T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.832+0000 7f5e617fa640 1 -- 172.21.15.2:0/863628862 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e58005e40 con 0x7f5e6415e830 2023-11-25T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.832+0000 7f5e617fa640 1 -- 172.21.15.2:0/863628862 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58007310 con 0x7f5e6415e830 2023-11-25T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.833+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e641f80a0 con 0x7f5e6415e830 2023-11-25T04:08:43.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.833+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e641f8660 con 0x7f5e6415e830 2023-11-25T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.833+0000 7f20137fe640 1 -- 172.21.15.2:0/1984335427 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f202000ce30 con 0x7f202c0cd540 2023-11-25T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.833+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202c0c8c10 con 0x7f202c0cd540 2023-11-25T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.833+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c0c91d0 con 0x7f202c0cd540 2023-11-25T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.834+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e641f8850 con 0x7f5e6415e830 2023-11-25T04:08:43.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.835+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c09ef40 con 0x7f202c0cd540 2023-11-25T04:08:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.835+0000 7fd896ffd640 1 -- 172.21.15.2:0/2547882877 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd89c054db0 con 0x7fd8a815a010 2023-11-25T04:08:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.835+0000 7f10797fa640 1 -- 172.21.15.2:0/2545152763 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f107007ae10 con 0x7f107c14bc50 2023-11-25T04:08:43.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.836+0000 7f718a7fc640 1 -- 172.21.15.2:0/4247158511 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7184054270 con 0x7f71940d0240 2023-11-25T04:08:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.839+0000 7f20137fe640 1 -- 172.21.15.2:0/1984335427 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2020013470 con 0x7f202c0cd540 2023-11-25T04:08:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.840+0000 7f20137fe640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f201806aec0 0x7f201806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.840+0000 7f20137fe640 1 -- 172.21.15.2:0/1984335427 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2020089ea0 con 0x7f202c0cd540 2023-11-25T04:08:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.840+0000 7f202a59c640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f201806aec0 0x7f201806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.841+0000 7f202a59c640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f201806aec0 0x7f201806d380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f202c1fa770 tx=0x7f201c000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.840+0000 7f5e617fa640 1 -- 172.21.15.2:0/863628862 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e58007470 con 0x7f5e6415e830 2023-11-25T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.841+0000 7f5e617fa640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5e5006af10 0x7f5e5006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.841+0000 7f5e617fa640 1 -- 172.21.15.2:0/863628862 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e58089000 con 0x7f5e6415e830 2023-11-25T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.841+0000 7f5e617fa640 1 -- 172.21.15.2:0/863628862 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e58054140 con 0x7f5e6415e830 2023-11-25T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.841+0000 7f5e68c49640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5e5006af10 0x7f5e5006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.842+0000 7f5e68c49640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5e5006af10 0x7f5e5006d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e54006fd0 tx=0x7f5e54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:43.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.844+0000 7f10797fa640 1 -- 172.21.15.2:0/2545152763 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1070077150 con 0x7f107c14bc50 2023-11-25T04:08:43.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:43.846+0000 7f20137fe640 1 -- 172.21.15.2:0/1984335427 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2020054fe0 con 0x7f202c0cd540 2023-11-25T04:08:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.175+0000 7f3eb0809640 1 -- 172.21.15.2:0/3781256690 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3e8c0050c0 con 0x7f3ea4035d50 2023-11-25T04:08:44.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.176+0000 7f3e97fff640 1 -- 172.21.15.2:0/3781256690 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e98053c30 con 0x7f3ea4035d50 2023-11-25T04:08:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:55834574853 2023-11-25T04:08:44.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.179+0000 7f3e95ffb640 1 -- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3e9006af10 msgr2=0x7f3e9006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.179+0000 7f3e95ffb640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3e9006af10 0x7f3e9006d3d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3ea400dbf0 tx=0x7f3ea0008040 comp rx=0 tx=0).stop 2023-11-25T04:08:44.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.180+0000 7f3e95ffb640 1 -- 172.21.15.2:0/3781256690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ea4035d50 msgr2=0x7f3ea40506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.180+0000 7f3e95ffb640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ea4035d50 0x7f3ea40506d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3e9800c360 tx=0x7f3e9800c820 comp rx=0 tx=0).stop 2023-11-25T04:08:44.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.180+0000 7f3e95ffb640 1 -- 172.21.15.2:0/3781256690 shutdown_connections 2023-11-25T04:08:44.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.180+0000 7f3e95ffb640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f3ea4057770 0x7f3ea40d51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.180+0000 7f3e95ffb640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ea4036130 0x7f3ea40d4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.180+0000 7f3e95ffb640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f3e9006af10 0x7f3e9006d3d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.180+0000 7f3e95ffb640 1 --2- 172.21.15.2:0/3781256690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ea4035d50 0x7f3ea40506d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.180+0000 7f3e95ffb640 1 -- 172.21.15.2:0/3781256690 >> 172.21.15.2:0/3781256690 conn(0x7f3ea4053710 msgr2=0x7f3ea4056200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:44.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.180+0000 7f3e95ffb640 1 -- 172.21.15.2:0/3781256690 shutdown_connections 2023-11-25T04:08:44.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.181+0000 7f3e95ffb640 1 -- 172.21.15.2:0/3781256690 wait complete. 2023-11-25T04:08:44.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-11-25T04:08:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.222+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f719404e920 con 0x7f71940d0240 2023-11-25T04:08:44.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.222+0000 7f718a7fc640 1 -- 172.21.15.2:0/4247158511 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7184057890 con 0x7f71940d0240 2023-11-25T04:08:44.224 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-25T04:08:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f717806ae40 msgr2=0x7f717806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f717806ae40 0x7f717806d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f71900070b0 tx=0x7f7190007040 comp rx=0 tx=0).stop 2023-11-25T04:08:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71940d0240 msgr2=0x7f71940b87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71940d0240 0x7f71940b87f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f718400c780 tx=0x7f718400cc40 comp rx=0 tx=0).stop 2023-11-25T04:08:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 shutdown_connections 2023-11-25T04:08:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7194160ad0 0x7f71940b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f717806ae40 0x7f717806d300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.228 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71940d0240 0x7f71940b87f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 --2- 172.21.15.2:0/4247158511 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f71940b2110 0x7f71941ef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 >> 172.21.15.2:0/4247158511 conn(0x7f719409c500 msgr2=0x7f71940ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:44.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 shutdown_connections 2023-11-25T04:08:44.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.225+0000 7f719c223640 1 -- 172.21.15.2:0/4247158511 wait complete. 2023-11-25T04:08:44.238 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.2 2023-11-25T04:08:44.239 DEBUG:teuthology.parallel:result is None 2023-11-25T04:08:44.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.241+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff4f8050f50 con 0x7ff4f80e3300 2023-11-25T04:08:44.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.241+0000 7ff4ebfff640 1 -- 172.21.15.2:0/2099343328 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff4ec021020 con 0x7ff4f80e3300 2023-11-25T04:08:44.243 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-25T04:08:44.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.244+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f46900057d0 con 0x7f46b0153b10 2023-11-25T04:08:44.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.244+0000 7f4697fff640 1 -- 172.21.15.2:0/454786012 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46a0054b10 con 0x7f46b0153b10 2023-11-25T04:08:44.246 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-25T04:08:44.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.244+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff4e406ae90 msgr2=0x7ff4e406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff4e406ae90 0x7ff4e406d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4000fb0 tx=0x7ff4f4007d50 comp rx=0 tx=0).stop 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e3300 msgr2=0x7ff4f817cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e3300 0x7ff4f817cb60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00e870 tx=0x7ff4ec00ed30 comp rx=0 tx=0).stop 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 shutdown_connections 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff4f80e7430 0x7ff4f817d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff4e406ae90 0x7ff4e406d350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4f80e3300 0x7ff4f817cb60 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00e870 tx=0x7ff4ec00ed30 comp rx=0 tx=0).stop 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 --2- 172.21.15.2:0/2099343328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4f80579d0 0x7ff4f804c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 >> 172.21.15.2:0/2099343328 conn(0x7ff4f8020000 msgr2=0x7ff4f8005af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 shutdown_connections 2023-11-25T04:08:44.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.245+0000 7ff504aca640 1 -- 172.21.15.2:0/2099343328 wait complete. 2023-11-25T04:08:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f469c06af00 msgr2=0x7f469c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f469c06af00 0x7f469c06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f46a4038000 tx=0x7f46a4008030 comp rx=0 tx=0).stop 2023-11-25T04:08:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46b0153b10 msgr2=0x7f46b015b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46b0153b10 0x7f46b015b200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f46a000a7f0 tx=0x7f46a000acb0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 shutdown_connections 2023-11-25T04:08:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f46b00adf10 0x7f46b01ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46b0159b40 0x7f46b015b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f469c06af00 0x7f469c06d3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 --2- 172.21.15.2:0/454786012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46b0153b10 0x7f46b015b200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 >> 172.21.15.2:0/454786012 conn(0x7f46b00cf3f0 msgr2=0x7f46b00cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 shutdown_connections 2023-11-25T04:08:44.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.247+0000 7f46b4e1a640 1 -- 172.21.15.2:0/454786012 wait complete. 2023-11-25T04:08:44.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.250+0000 7fd894ff9640 1 -- 172.21.15.2:0/2547882877 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd8800057d0 con 0x7fd8a815a010 2023-11-25T04:08:44.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.250+0000 7fd896ffd640 1 -- 172.21.15.2:0/2547882877 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd89c015020 con 0x7fd8a815a010 2023-11-25T04:08:44.252 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-25T04:08:44.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.252+0000 7fd894ff9640 1 -- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd88806ae90 msgr2=0x7fd88806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.252+0000 7fd894ff9640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd88806ae90 0x7fd88806d350 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd89800b240 tx=0x7fd89800b3a0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.252+0000 7fd894ff9640 1 -- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a815a010 msgr2=0x7fd8a814b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.252+0000 7fd894ff9640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a815a010 0x7fd8a814b330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd89c00b430 tx=0x7fd89c00b8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.253+0000 7fd894ff9640 1 -- 172.21.15.2:0/2547882877 shutdown_connections 2023-11-25T04:08:44.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.253+0000 7fd894ff9640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd88806ae90 0x7fd88806d350 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.253+0000 7fd894ff9640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a814b870 0x7fd8a81f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.253+0000 7fd894ff9640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8a815a010 0x7fd8a814b330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.253+0000 7fd894ff9640 1 --2- 172.21.15.2:0/2547882877 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8071a40 0x7fd8a8158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.253+0000 7fd894ff9640 1 -- 172.21.15.2:0/2547882877 >> 172.21.15.2:0/2547882877 conn(0x7fd8a80cfe00 msgr2=0x7fd8a806a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:44.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.253+0000 7fd894ff9640 1 -- 172.21.15.2:0/2547882877 shutdown_connections 2023-11-25T04:08:44.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.253+0000 7fd894ff9640 1 -- 172.21.15.2:0/2547882877 wait complete. 2023-11-25T04:08:44.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.257+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f105c0057d0 con 0x7f107c14bc50 2023-11-25T04:08:44.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.257+0000 7f10797fa640 1 -- 172.21.15.2:0/2545152763 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1070077150 con 0x7f107c14bc50 2023-11-25T04:08:44.259 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-25T04:08:44.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.258+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5e6409ef40 con 0x7f5e6415e830 2023-11-25T04:08:44.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.259+0000 7f5e617fa640 1 -- 172.21.15.2:0/863628862 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5e58017090 con 0x7f5e6415e830 2023-11-25T04:08:44.262 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2023-11-25T04:08:44.264 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2023-11-25T04:08:44.266 DEBUG:teuthology.parallel:result is None 2023-11-25T04:08:44.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.260+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f106806ae90 msgr2=0x7f106806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.260+0000 7f1082e36640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f106806ae90 0x7f106806d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f107400c570 tx=0x7f107400b040 comp rx=0 tx=0).stop 2023-11-25T04:08:44.267 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f107c14bc50 msgr2=0x7f107c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f107c14bc50 0x7f107c15a290 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1070033000 tx=0x7f10700046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 shutdown_connections 2023-11-25T04:08:44.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f107c14bc50 0x7f107c15a290 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f107c159010 0x7f107c14ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f106806ae90 0x7f106806d350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 --2- 172.21.15.2:0/2545152763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f107c06c9f0 0x7f107c14e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 >> 172.21.15.2:0/2545152763 conn(0x7f107c06a4d0 msgr2=0x7f107c155c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:44.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 shutdown_connections 2023-11-25T04:08:44.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.261+0000 7f1082e36640 1 -- 172.21.15.2:0/2545152763 wait complete. 2023-11-25T04:08:44.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5e5006af10 msgr2=0x7f5e5006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5e5006af10 0x7f5e5006d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e54006fd0 tx=0x7f5e54008040 comp rx=0 tx=0).stop 2023-11-25T04:08:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e6415e830 msgr2=0x7f5e641f7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e6415e830 0x7f5e641f7670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800c3c0 tx=0x7f5e58001e70 comp rx=0 tx=0).stop 2023-11-25T04:08:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 shutdown_connections 2023-11-25T04:08:44.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5e5006af10 0x7f5e5006d3d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e6415e830 0x7f5e641f7670 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5e640b0830 0x7f5e6414d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 --2- 172.21.15.2:0/863628862 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5e64099970 0x7f5e640ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 >> 172.21.15.2:0/863628862 conn(0x7f5e640b2a20 msgr2=0x7f5e6406f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:44.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 shutdown_connections 2023-11-25T04:08:44.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.262+0000 7f5e6aead640 1 -- 172.21.15.2:0/863628862 wait complete. 2023-11-25T04:08:44.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.0 2023-11-25T04:08:44.276 DEBUG:teuthology.parallel:result is None 2023-11-25T04:08:44.278 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.3 2023-11-25T04:08:44.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.267+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f202c0b3590 con 0x7f202c0cd540 2023-11-25T04:08:44.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.268+0000 7f20137fe640 1 -- 172.21.15.2:0/1984335427 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2020017090 con 0x7f202c0cd540 2023-11-25T04:08:44.280 DEBUG:teuthology.parallel:result is None 2023-11-25T04:08:44.280 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-25T04:08:44.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f201806aec0 msgr2=0x7f201806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f201806aec0 0x7f201806d380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f202c1fa770 tx=0x7f201c000ed0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 msgr2=0x7f202c155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:44.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 0x7f202c155330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2020009fd0 tx=0x7f202000ed40 comp rx=0 tx=0).stop 2023-11-25T04:08:44.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 shutdown_connections 2023-11-25T04:08:44.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f202c15ebf0 0x7f202c0c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f202c15e810 0x7f202c0c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f201806aec0 0x7f201806d380 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 --2- 172.21.15.2:0/1984335427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f202c0cd540 0x7f202c155330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:44.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 >> 172.21.15.2:0/1984335427 conn(0x7f202c0b2a70 msgr2=0x7f202c158db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:44.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 shutdown_connections 2023-11-25T04:08:44.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:44.270+0000 7f203119e640 1 -- 172.21.15.2:0/1984335427 wait complete. 2023-11-25T04:08:44.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2023-11-25T04:08:44.285 DEBUG:teuthology.parallel:result is None 2023-11-25T04:08:44.286 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2023-11-25T04:08:44.286 DEBUG:teuthology.parallel:result is None 2023-11-25T04:08:44.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.1 2023-11-25T04:08:44.287 DEBUG:teuthology.parallel:result is None 2023-11-25T04:08:45.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-25T04:08:45.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.318+0000 7f76879fb640 1 Processor -- start 2023-11-25T04:08:45.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.319+0000 7f76879fb640 1 -- start start 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.319+0000 7f76879fb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 0x7f76800d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.319+0000 7f76879fb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76800cef00 0x7f7680161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.319+0000 7f76879fb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76800ce360 con 0x7f76800b2aa0 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.319+0000 7f76879fb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76800b2f20 con 0x7f76800cef00 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.319+0000 7f76879fb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76800cdd50 con 0x7f7680160b70 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7685f98640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f76800cef00 0x7f7680161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7684f96640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f76800b2aa0 0x7f76800ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33100/0 (socket says 172.21.15.2:33100) 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7684f96640 1 -- 172.21.15.2:0/2752549605 learned_addr learned my addr 172.21.15.2:0/2752549605 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7685797640 1 --2- 172.21.15.2:0/2752549605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 0x7f76800d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7685f98640 1 -- 172.21.15.2:0/2752549605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 msgr2=0x7f76800d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7685f98640 1 --2- 172.21.15.2:0/2752549605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 0x7f76800d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7685f98640 1 -- 172.21.15.2:0/2752549605 >> v1:172.21.15.2:6789/0 conn(0x7f76800b2aa0 legacy=0x7f76800ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7685f98640 1 -- 172.21.15.2:0/2752549605 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76800d1c70 con 0x7f76800cef00 2023-11-25T04:08:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7677fff640 1 -- 172.21.15.2:0/2752549605 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4236883392 0 0) 0x7f76800ce360 con 0x7f76800b2aa0 2023-11-25T04:08:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.320+0000 7f7685797640 1 --2- 172.21.15.2:0/2752549605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 0x7f76800d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.321+0000 7f7685f98640 1 --2- 172.21.15.2:0/2752549605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 0x7f7680161230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7678009d90 tx=0x7f767802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93c6c7df6ffa836 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.321+0000 7f7677fff640 1 -- 172.21.15.2:0/2752549605 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767802cc50 con 0x7f76800cef00 2023-11-25T04:08:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.321+0000 7f7677fff640 1 -- 172.21.15.2:0/2752549605 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767802cdb0 con 0x7f76800cef00 2023-11-25T04:08:45.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.321+0000 7f7677fff640 1 -- 172.21.15.2:0/2752549605 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7678034660 con 0x7f76800cef00 2023-11-25T04:08:45.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.321+0000 7f76879fb640 1 -- 172.21.15.2:0/2752549605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 msgr2=0x7f7680161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.321+0000 7f76879fb640 1 --2- 172.21.15.2:0/2752549605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 0x7f7680161230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7678009d90 tx=0x7f767802bea0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.322+0000 7f76879fb640 1 -- 172.21.15.2:0/2752549605 shutdown_connections 2023-11-25T04:08:45.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.322+0000 7f76879fb640 1 --2- 172.21.15.2:0/2752549605 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 0x7f7680161230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.322+0000 7f76879fb640 1 --2- 172.21.15.2:0/2752549605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 0x7f76800d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.322+0000 7f76879fb640 1 -- 172.21.15.2:0/2752549605 >> 172.21.15.2:0/2752549605 conn(0x7f768009c470 msgr2=0x7f76800d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:45.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.322+0000 7f76879fb640 1 -- 172.21.15.2:0/2752549605 shutdown_connections 2023-11-25T04:08:45.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.322+0000 7f76879fb640 1 -- 172.21.15.2:0/2752549605 wait complete. 2023-11-25T04:08:45.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.323+0000 7f76879fb640 1 Processor -- start 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.323+0000 7f76879fb640 1 -- start start 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f76879fb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76800b2aa0 0x7f76800c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f76879fb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 0x7f76800cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f76879fb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 0x7f768006c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f76879fb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7680144760 con 0x7f76800cef00 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f76879fb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76800cc850 con 0x7f76800b2aa0 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f76879fb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76800ccb30 con 0x7f7680160b70 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7684f96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 0x7f76800cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7684f96640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 0x7f76800cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53484/0 (socket says 172.21.15.2:53484) 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7684f96640 1 -- 172.21.15.2:0/3930481635 learned_addr learned my addr 172.21.15.2:0/3930481635 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:45.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7685f98640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 0x7f768006c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7685797640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76800b2aa0 0x7f76800c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7684f96640 1 -- 172.21.15.2:0/3930481635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 msgr2=0x7f768006c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7684f96640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 0x7f768006c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7684f96640 1 -- 172.21.15.2:0/3930481635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76800b2aa0 msgr2=0x7f76800c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7684f96640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76800b2aa0 0x7f76800c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7684f96640 1 -- 172.21.15.2:0/3930481635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7678009a70 con 0x7f76800cef00 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7685797640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76800b2aa0 0x7f76800c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7684f96640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 0x7f76800cbe70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f767000c430 tx=0x7f767000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7675ffb640 1 -- 172.21.15.2:0/3930481635 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76700074e0 con 0x7f76800cef00 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7675ffb640 1 -- 172.21.15.2:0/3930481635 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7670007660 con 0x7f76800cef00 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76800cce10 con 0x7f76800cef00 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.324+0000 7f7675ffb640 1 -- 172.21.15.2:0/3930481635 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7670004a20 con 0x7f76800cef00 2023-11-25T04:08:45.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.325+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76800cc3b0 con 0x7f76800cef00 2023-11-25T04:08:45.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.326+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7680144910 con 0x7f76800cef00 2023-11-25T04:08:45.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.326+0000 7f7675ffb640 1 -- 172.21.15.2:0/3930481635 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7670004b80 con 0x7f76800cef00 2023-11-25T04:08:45.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.327+0000 7f7675ffb640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f766406ae40 0x7f766406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.327+0000 7f7675ffb640 1 -- 172.21.15.2:0/3930481635 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76700893a0 con 0x7f76800cef00 2023-11-25T04:08:45.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.327+0000 7f7685797640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f766406ae40 0x7f766406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.327+0000 7f7685797640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f766406ae40 0x7f766406d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76800cb9e0 tx=0x7f767c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:45.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.331+0000 7f7675ffb640 1 -- 172.21.15.2:0/3930481635 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7680144910 con 0x7f76800cef00 2023-11-25T04:08:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.509+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f76800cc5d0 con 0x7f76800cef00 2023-11-25T04:08:45.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.509+0000 7f7675ffb640 1 -- 172.21.15.2:0/3930481635 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7670054450 con 0x7f76800cef00 2023-11-25T04:08:45.511 INFO:teuthology.orchestra.run.smithi002.stdout:55834574855 2023-11-25T04:08:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f766406ae40 msgr2=0x7f766406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f766406ae40 0x7f766406d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f76800cb9e0 tx=0x7f767c008040 comp rx=0 tx=0).stop 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 msgr2=0x7f76800cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 0x7f76800cbe70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f767000c430 tx=0x7f767000c8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 shutdown_connections 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7680160b70 0x7f768006c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f76800cef00 0x7f76800cbe70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f766406ae40 0x7f766406d300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 --2- 172.21.15.2:0/3930481635 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76800b2aa0 0x7f76800c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 >> 172.21.15.2:0/3930481635 conn(0x7f768009c470 msgr2=0x7f76800afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 shutdown_connections 2023-11-25T04:08:45.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.511+0000 7f76879fb640 1 -- 172.21.15.2:0/3930481635 wait complete. 2023-11-25T04:08:45.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574855 for osd.5 2023-11-25T04:08:45.524 DEBUG:teuthology.parallel:result is None 2023-11-25T04:08:45.524 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-25T04:08:45.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-25T04:08:45.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.628+0000 7fceff916640 1 Processor -- start 2023-11-25T04:08:45.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.629+0000 7fceff916640 1 -- start start 2023-11-25T04:08:45.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.629+0000 7fceff916640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcef806bff0 0x7fcef806c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.629+0000 7fceff916640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcef80b0ee0 0x7fcef80b1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.629+0000 7fceff916640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef8161c50 con 0x7fcef8161100 2023-11-25T04:08:45.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.629+0000 7fceff916640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef8161eb0 con 0x7fcef806bff0 2023-11-25T04:08:45.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.629+0000 7fceff916640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef806c910 con 0x7fcef80b0ee0 2023-11-25T04:08:45.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.629+0000 7fcefd6b2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcef806bff0 0x7fcef806c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.629+0000 7fcefd6b2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fcef806bff0 0x7fcef806c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53498/0 (socket says 172.21.15.2:53498) 2023-11-25T04:08:45.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.629+0000 7fcefd6b2640 1 -- 172.21.15.2:0/3679889079 learned_addr learned my addr 172.21.15.2:0/3679889079 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:45.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.630+0000 7fcefdeb3640 1 --2- 172.21.15.2:0/3679889079 >> v2:172.21.15.66:3300/0 conn(0x7fcef80b0ee0 0x7fcef80b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.630+0000 7fcefd6b2640 1 -- 172.21.15.2:0/3679889079 >> v2:172.21.15.66:3300/0 conn(0x7fcef80b0ee0 msgr2=0x7fcef80b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.630+0000 7fcefd6b2640 1 --2- 172.21.15.2:0/3679889079 >> v2:172.21.15.66:3300/0 conn(0x7fcef80b0ee0 0x7fcef80b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.630+0000 7fcefd6b2640 1 -- 172.21.15.2:0/3679889079 >> v1:172.21.15.66:6789/0 conn(0x7fcef8161100 legacy=0x7fcef8161540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.630+0000 7fcefd6b2640 1 -- 172.21.15.2:0/3679889079 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80cd8f0 con 0x7fcef806bff0 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.630+0000 7fcefd6b2640 1 --2- 172.21.15.2:0/3679889079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef806bff0 0x7fcef806c3d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcef806bda0 tx=0x7fcef002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b60bd37aacc20fd server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceeffff640 1 -- 172.21.15.2:0/3679889079 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0030860 con 0x7fcef806bff0 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceeffff640 1 -- 172.21.15.2:0/3679889079 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef00309c0 con 0x7fcef806bff0 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceeffff640 1 -- 172.21.15.2:0/3679889079 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef0030d50 con 0x7fcef806bff0 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceff916640 1 -- 172.21.15.2:0/3679889079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef806bff0 msgr2=0x7fcef806c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceff916640 1 --2- 172.21.15.2:0/3679889079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef806bff0 0x7fcef806c3d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcef806bda0 tx=0x7fcef002b9a0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceff916640 1 -- 172.21.15.2:0/3679889079 shutdown_connections 2023-11-25T04:08:45.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceff916640 1 --2- 172.21.15.2:0/3679889079 >> v2:172.21.15.66:3300/0 conn(0x7fcef80b0ee0 0x7fcef80b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceff916640 1 --2- 172.21.15.2:0/3679889079 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef806bff0 0x7fcef806c3d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceff916640 1 -- 172.21.15.2:0/3679889079 >> 172.21.15.2:0/3679889079 conn(0x7fcef80d0f60 msgr2=0x7fcef80d1370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:45.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceff916640 1 -- 172.21.15.2:0/3679889079 shutdown_connections 2023-11-25T04:08:45.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.631+0000 7fceff916640 1 -- 172.21.15.2:0/3679889079 wait complete. 2023-11-25T04:08:45.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.632+0000 7fceff916640 1 Processor -- start 2023-11-25T04:08:45.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.632+0000 7fceff916640 1 -- start start 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.633+0000 7fceff916640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef806bff0 0x7fcef8155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.633+0000 7fceff916640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef80b0ee0 0x7fcef814b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.633+0000 7fceff916640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8161100 0x7fcef8157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.633+0000 7fceff916640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80cb400 con 0x7fcef8161100 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.633+0000 7fceff916640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef8156230 con 0x7fcef806bff0 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.633+0000 7fceff916640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef814b7b0 con 0x7fcef80b0ee0 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.633+0000 7fcefdeb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8161100 0x7fcef8157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.633+0000 7fcefdeb3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8161100 0x7fcef8157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53504/0 (socket says 172.21.15.2:53504) 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.633+0000 7fcefdeb3640 1 -- 172.21.15.2:0/4108057017 learned_addr learned my addr 172.21.15.2:0/4108057017 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:45.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefd6b2640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef806bff0 0x7fcef8155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefceb1640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef80b0ee0 0x7fcef814b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefdeb3640 1 -- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef80b0ee0 msgr2=0x7fcef814b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefdeb3640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef80b0ee0 0x7fcef814b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefdeb3640 1 -- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef806bff0 msgr2=0x7fcef8155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefdeb3640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef806bff0 0x7fcef8155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefdeb3640 1 -- 172.21.15.2:0/4108057017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef00094d0 con 0x7fcef8161100 2023-11-25T04:08:45.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefd6b2640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef806bff0 0x7fcef8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:45.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefceb1640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef80b0ee0 0x7fcef814b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:45.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fcefdeb3640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8161100 0x7fcef8157650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009dd0 tx=0x7fcef400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:45.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fceedffb640 1 -- 172.21.15.2:0/4108057017 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef400ced0 con 0x7fcef8161100 2023-11-25T04:08:45.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fceedffb640 1 -- 172.21.15.2:0/4108057017 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef400f040 con 0x7fcef8161100 2023-11-25T04:08:45.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef8158400 con 0x7fcef8161100 2023-11-25T04:08:45.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fceedffb640 1 -- 172.21.15.2:0/4108057017 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40146c0 con 0x7fcef8161100 2023-11-25T04:08:45.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.634+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef8158790 con 0x7fcef8161100 2023-11-25T04:08:45.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.635+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef8068470 con 0x7fcef8161100 2023-11-25T04:08:45.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.636+0000 7fceedffb640 1 -- 172.21.15.2:0/4108057017 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcef4014820 con 0x7fcef8161100 2023-11-25T04:08:45.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.636+0000 7fceedffb640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcedc06ae40 0x7fcedc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.636+0000 7fceedffb640 1 -- 172.21.15.2:0/4108057017 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcef408a0d0 con 0x7fcef8161100 2023-11-25T04:08:45.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.636+0000 7fcefd6b2640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcedc06ae40 0x7fcedc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.637+0000 7fcefd6b2640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcedc06ae40 0x7fcedc06d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcef0036000 tx=0x7fcef003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:45.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.640+0000 7fceedffb640 1 -- 172.21.15.2:0/4108057017 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcef4055210 con 0x7fcef8161100 2023-11-25T04:08:45.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.812+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 --> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcef80ce190 con 0x7fcedc06ae40 2023-11-25T04:08:45.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.819+0000 7fceedffb640 1 -- 172.21.15.2:0/4108057017 <== mgr.4107 v2:172.21.15.2:6832/523998843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264573 (secure 0 0 0) 0x7fcef0030c30 con 0x7fcedc06ae40 2023-11-25T04:08:45.824 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:45.825 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-25T04:08:45.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcedc06ae40 msgr2=0x7fcedc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcedc06ae40 0x7fcedc06d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcef0036000 tx=0x7fcef003b040 comp rx=0 tx=0).stop 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8161100 msgr2=0x7fcef8157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8161100 0x7fcef8157650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcef4009dd0 tx=0x7fcef400c490 comp rx=0 tx=0).stop 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 shutdown_connections 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fcef8161100 0x7fcef8157650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcef80b0ee0 0x7fcef814b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fcedc06ae40 0x7fcedc06d300 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 --2- 172.21.15.2:0/4108057017 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcef806bff0 0x7fcef8155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 >> 172.21.15.2:0/4108057017 conn(0x7fcef80d0f60 msgr2=0x7fcef80d0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:45.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 shutdown_connections 2023-11-25T04:08:45.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.822+0000 7fceff916640 1 -- 172.21.15.2:0/4108057017 wait complete. 2023-11-25T04:08:45.835 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-25T04:08:45.479530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235636,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.342362"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082720+0000","last_change":"2023-11-25T04:08:36.163622+0000","last_active":"2023-11-25T04:08:39.082720+0000","last_peered":"2023-11-25T04:08:39.082720+0000","last_clean":"2023-11-25T04:08:39.082720+0000","last_became_active":"2023-11-25T04:08:36.163344+0000","last_became_peered":"2023-11-25T04:08:36.163344+0000","last_unstale":"2023-11-25T04:08:39.082720+0000","last_undegraded":"2023-11-25T04:08:39.082720+0000","last_fullsized":"2023-11-25T04:08:39.082720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:20:43.504787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140999+0000","last_change":"2023-11-25T04:08:36.153711+0000","last_active":"2023-11-25T04:08:37.140999+0000","last_peered":"2023-11-25T04:08:37.140999+0000","last_clean":"2023-11-25T04:08:37.140999+0000","last_became_active":"2023-11-25T04:08:36.153447+0000","last_became_peered":"2023-11-25T04:08:36.153447+0000","last_unstale":"2023-11-25T04:08:37.140999+0000","last_undegraded":"2023-11-25T04:08:37.140999+0000","last_fullsized":"2023-11-25T04:08:37.140999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081247+0000","last_change":"2023-11-25T04:08:36.151108+0000","last_active":"2023-11-25T04:08:39.081247+0000","last_peered":"2023-11-25T04:08:39.081247+0000","last_clean":"2023-11-25T04:08:39.081247+0000","last_became_active":"2023-11-25T04:08:36.150809+0000","last_became_peered":"2023-11-25T04:08:36.150809+0000","last_unstale":"2023-11-25T04:08:39.081247+0000","last_undegraded":"2023-11-25T04:08:39.081247+0000","last_fullsized":"2023-11-25T04:08:39.081247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081708+0000","last_change":"2023-11-25T04:08:36.157420+0000","last_active":"2023-11-25T04:08:39.081708+0000","last_peered":"2023-11-25T04:08:39.081708+0000","last_clean":"2023-11-25T04:08:39.081708+0000","last_became_active":"2023-11-25T04:08:36.157122+0000","last_became_peered":"2023-11-25T04:08:36.157122+0000","last_unstale":"2023-11-25T04:08:39.081708+0000","last_undegraded":"2023-11-25T04:08:39.081708+0000","last_fullsized":"2023-11-25T04:08:39.081708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:56:48.338925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082094+0000","last_change":"2023-11-25T04:08:36.157106+0000","last_active":"2023-11-25T04:08:39.082094+0000","last_peered":"2023-11-25T04:08:39.082094+0000","last_clean":"2023-11-25T04:08:39.082094+0000","last_became_active":"2023-11-25T04:08:36.156764+0000","last_became_peered":"2023-11-25T04:08:36.156764+0000","last_unstale":"2023-11-25T04:08:39.082094+0000","last_undegraded":"2023-11-25T04:08:39.082094+0000","last_fullsized":"2023-11-25T04:08:39.082094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:10:58.141053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082361+0000","last_change":"2023-11-25T04:08:36.156211+0000","last_active":"2023-11-25T04:08:39.082361+0000","last_peered":"2023-11-25T04:08:39.082361+0000","last_clean":"2023-11-25T04:08:39.082361+0000","last_became_active":"2023-11-25T04:08:36.154680+0000","last_became_peered":"2023-11-25T04:08:36.154680+0000","last_unstale":"2023-11-25T04:08:39.082361+0000","last_undegraded":"2023-11-25T04:08:39.082361+0000","last_fullsized":"2023-11-25T04:08:39.082361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:01:26.950408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081381+0000","last_change":"2023-11-25T04:08:36.156525+0000","last_active":"2023-11-25T04:08:39.081381+0000","last_peered":"2023-11-25T04:08:39.081381+0000","last_clean":"2023-11-25T04:08:39.081381+0000","last_became_active":"2023-11-25T04:08:36.156219+0000","last_became_peered":"2023-11-25T04:08:36.156219+0000","last_unstale":"2023-11-25T04:08:39.081381+0000","last_undegraded":"2023-11-25T04:08:39.081381+0000","last_fullsized":"2023-11-25T04:08:39.081381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:50.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139675+0000","last_change":"2023-11-25T04:08:36.155837+0000","last_active":"2023-11-25T04:08:37.139675+0000","last_peered":"2023-11-25T04:08:37.139675+0000","last_clean":"2023-11-25T04:08:37.139675+0000","last_became_active":"2023-11-25T04:08:36.155513+0000","last_became_peered":"2023-11-25T04:08:36.155513+0000","last_unstale":"2023-11-25T04:08:37.139675+0000","last_undegraded":"2023-11-25T04:08:37.139675+0000","last_fullsized":"2023-11-25T04:08:37.139675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082786+0000","last_change":"2023-11-25T04:08:36.162855+0000","last_active":"2023-11-25T04:08:39.082786+0000","last_peered":"2023-11-25T04:08:39.082786+0000","last_clean":"2023-11-25T04:08:39.082786+0000","last_became_active":"2023-11-25T04:08:36.162564+0000","last_became_peered":"2023-11-25T04:08:36.162564+0000","last_unstale":"2023-11-25T04:08:39.082786+0000","last_undegraded":"2023-11-25T04:08:39.082786+0000","last_fullsized":"2023-11-25T04:08:39.082786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:18.611394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081853+0000","last_change":"2023-11-25T04:08:36.163530+0000","last_active":"2023-11-25T04:08:39.081853+0000","last_peered":"2023-11-25T04:08:39.081853+0000","last_clean":"2023-11-25T04:08:39.081853+0000","last_became_active":"2023-11-25T04:08:36.163227+0000","last_became_peered":"2023-11-25T04:08:36.163227+0000","last_unstale":"2023-11-25T04:08:39.081853+0000","last_undegraded":"2023-11-25T04:08:39.081853+0000","last_fullsized":"2023-11-25T04:08:39.081853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081609+0000","last_change":"2023-11-25T04:08:36.163831+0000","last_active":"2023-11-25T04:08:39.081609+0000","last_peered":"2023-11-25T04:08:39.081609+0000","last_clean":"2023-11-25T04:08:39.081609+0000","last_became_active":"2023-11-25T04:08:36.163508+0000","last_became_peered":"2023-11-25T04:08:36.163508+0000","last_unstale":"2023-11-25T04:08:39.081609+0000","last_undegraded":"2023-11-25T04:08:39.081609+0000","last_fullsized":"2023-11-25T04:08:39.081609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141201+0000","last_change":"2023-11-25T04:08:36.158244+0000","last_active":"2023-11-25T04:08:37.141201+0000","last_peered":"2023-11-25T04:08:37.141201+0000","last_clean":"2023-11-25T04:08:37.141201+0000","last_became_active":"2023-11-25T04:08:36.157786+0000","last_became_peered":"2023-11-25T04:08:36.157786+0000","last_unstale":"2023-11-25T04:08:37.141201+0000","last_undegraded":"2023-11-25T04:08:37.141201+0000","last_fullsized":"2023-11-25T04:08:37.141201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139966+0000","last_change":"2023-11-25T04:08:36.156689+0000","last_active":"2023-11-25T04:08:37.139966+0000","last_peered":"2023-11-25T04:08:37.139966+0000","last_clean":"2023-11-25T04:08:37.139966+0000","last_became_active":"2023-11-25T04:08:36.156198+0000","last_became_peered":"2023-11-25T04:08:36.156198+0000","last_unstale":"2023-11-25T04:08:37.139966+0000","last_undegraded":"2023-11-25T04:08:37.139966+0000","last_fullsized":"2023-11-25T04:08:37.139966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081031+0000","last_change":"2023-11-25T04:08:36.154649+0000","last_active":"2023-11-25T04:08:39.081031+0000","last_peered":"2023-11-25T04:08:39.081031+0000","last_clean":"2023-11-25T04:08:39.081031+0000","last_became_active":"2023-11-25T04:08:36.154367+0000","last_became_peered":"2023-11-25T04:08:36.154367+0000","last_unstale":"2023-11-25T04:08:39.081031+0000","last_undegraded":"2023-11-25T04:08:39.081031+0000","last_fullsized":"2023-11-25T04:08:39.081031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:22.951831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140716+0000","last_change":"2023-11-25T04:08:36.154568+0000","last_active":"2023-11-25T04:08:37.140716+0000","last_peered":"2023-11-25T04:08:37.140716+0000","last_clean":"2023-11-25T04:08:37.140716+0000","last_became_active":"2023-11-25T04:08:36.154254+0000","last_became_peered":"2023-11-25T04:08:36.154254+0000","last_unstale":"2023-11-25T04:08:37.140716+0000","last_undegraded":"2023-11-25T04:08:37.140716+0000","last_fullsized":"2023-11-25T04:08:37.140716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081194+0000","last_change":"2023-11-25T04:08:36.156505+0000","last_active":"2023-11-25T04:08:39.081194+0000","last_peered":"2023-11-25T04:08:39.081194+0000","last_clean":"2023-11-25T04:08:39.081194+0000","last_became_active":"2023-11-25T04:08:36.156200+0000","last_became_peered":"2023-11-25T04:08:36.156200+0000","last_unstale":"2023-11-25T04:08:39.081194+0000","last_undegraded":"2023-11-25T04:08:39.081194+0000","last_fullsized":"2023-11-25T04:08:39.081194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082121+0000","last_change":"2023-11-25T04:08:36.154932+0000","last_active":"2023-11-25T04:08:39.082121+0000","last_peered":"2023-11-25T04:08:39.082121+0000","last_clean":"2023-11-25T04:08:39.082121+0000","last_became_active":"2023-11-25T04:08:36.154561+0000","last_became_peered":"2023-11-25T04:08:36.154561+0000","last_unstale":"2023-11-25T04:08:39.082121+0000","last_undegraded":"2023-11-25T04:08:39.082121+0000","last_fullsized":"2023-11-25T04:08:39.082121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:03:24.390936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.980141+0000","last_change":"2023-11-25T04:08:36.157418+0000","last_active":"2023-11-25T04:08:37.980141+0000","last_peered":"2023-11-25T04:08:37.980141+0000","last_clean":"2023-11-25T04:08:37.980141+0000","last_became_active":"2023-11-25T04:08:36.157130+0000","last_became_peered":"2023-11-25T04:08:36.157130+0000","last_unstale":"2023-11-25T04:08:37.980141+0000","last_undegraded":"2023-11-25T04:08:37.980141+0000","last_fullsized":"2023-11-25T04:08:37.980141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082191+0000","last_change":"2023-11-25T04:08:36.157854+0000","last_active":"2023-11-25T04:08:39.082191+0000","last_peered":"2023-11-25T04:08:39.082191+0000","last_clean":"2023-11-25T04:08:39.082191+0000","last_became_active":"2023-11-25T04:08:36.156836+0000","last_became_peered":"2023-11-25T04:08:36.156836+0000","last_unstale":"2023-11-25T04:08:39.082191+0000","last_undegraded":"2023-11-25T04:08:39.082191+0000","last_fullsized":"2023-11-25T04:08:39.082191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:03:24.390936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081576+0000","last_change":"2023-11-25T04:08:36.155924+0000","last_active":"2023-11-25T04:08:39.081576+0000","last_peered":"2023-11-25T04:08:39.081576+0000","last_clean":"2023-11-25T04:08:39.081576+0000","last_became_active":"2023-11-25T04:08:36.155624+0000","last_became_peered":"2023-11-25T04:08:36.155624+0000","last_unstale":"2023-11-25T04:08:39.081576+0000","last_undegraded":"2023-11-25T04:08:39.081576+0000","last_fullsized":"2023-11-25T04:08:39.081576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081224+0000","last_change":"2023-11-25T04:08:36.153091+0000","last_active":"2023-11-25T04:08:39.081224+0000","last_peered":"2023-11-25T04:08:39.081224+0000","last_clean":"2023-11-25T04:08:39.081224+0000","last_became_active":"2023-11-25T04:08:36.152775+0000","last_became_peered":"2023-11-25T04:08:36.152775+0000","last_unstale":"2023-11-25T04:08:39.081224+0000","last_undegraded":"2023-11-25T04:08:39.081224+0000","last_fullsized":"2023-11-25T04:08:39.081224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082510+0000","last_change":"2023-11-25T04:08:36.156488+0000","last_active":"2023-11-25T04:08:39.082510+0000","last_peered":"2023-11-25T04:08:39.082510+0000","last_clean":"2023-11-25T04:08:39.082510+0000","last_became_active":"2023-11-25T04:08:36.156156+0000","last_became_peered":"2023-11-25T04:08:36.156156+0000","last_unstale":"2023-11-25T04:08:39.082510+0000","last_undegraded":"2023-11-25T04:08:39.082510+0000","last_fullsized":"2023-11-25T04:08:39.082510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:20:43.504787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139732+0000","last_change":"2023-11-25T04:08:36.153601+0000","last_active":"2023-11-25T04:08:37.139732+0000","last_peered":"2023-11-25T04:08:37.139732+0000","last_clean":"2023-11-25T04:08:37.139732+0000","last_became_active":"2023-11-25T04:08:36.153299+0000","last_became_peered":"2023-11-25T04:08:36.153299+0000","last_unstale":"2023-11-25T04:08:37.139732+0000","last_undegraded":"2023-11-25T04:08:37.139732+0000","last_fullsized":"2023-11-25T04:08:37.139732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081352+0000","last_change":"2023-11-25T04:08:36.152977+0000","last_active":"2023-11-25T04:08:39.081352+0000","last_peered":"2023-11-25T04:08:39.081352+0000","last_clean":"2023-11-25T04:08:39.081352+0000","last_became_active":"2023-11-25T04:08:36.152565+0000","last_became_peered":"2023-11-25T04:08:36.152565+0000","last_unstale":"2023-11-25T04:08:39.081352+0000","last_undegraded":"2023-11-25T04:08:39.081352+0000","last_fullsized":"2023-11-25T04:08:39.081352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:50.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140274+0000","last_change":"2023-11-25T04:08:36.151764+0000","last_active":"2023-11-25T04:08:37.140274+0000","last_peered":"2023-11-25T04:08:37.140274+0000","last_clean":"2023-11-25T04:08:37.140274+0000","last_became_active":"2023-11-25T04:08:36.150463+0000","last_became_peered":"2023-11-25T04:08:36.150463+0000","last_unstale":"2023-11-25T04:08:37.140274+0000","last_undegraded":"2023-11-25T04:08:37.140274+0000","last_fullsized":"2023-11-25T04:08:37.140274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081943+0000","last_change":"2023-11-25T04:08:36.162948+0000","last_active":"2023-11-25T04:08:39.081943+0000","last_peered":"2023-11-25T04:08:39.081943+0000","last_clean":"2023-11-25T04:08:39.081943+0000","last_became_active":"2023-11-25T04:08:36.162672+0000","last_became_peered":"2023-11-25T04:08:36.162672+0000","last_unstale":"2023-11-25T04:08:39.081943+0000","last_undegraded":"2023-11-25T04:08:39.081943+0000","last_fullsized":"2023-11-25T04:08:39.081943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140927+0000","last_change":"2023-11-25T04:08:36.159466+0000","last_active":"2023-11-25T04:08:37.140927+0000","last_peered":"2023-11-25T04:08:37.140927+0000","last_clean":"2023-11-25T04:08:37.140927+0000","last_became_active":"2023-11-25T04:08:36.159177+0000","last_became_peered":"2023-11-25T04:08:36.159177+0000","last_unstale":"2023-11-25T04:08:37.140927+0000","last_undegraded":"2023-11-25T04:08:37.140927+0000","last_fullsized":"2023-11-25T04:08:37.140927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140078+0000","last_change":"2023-11-25T04:08:36.153899+0000","last_active":"2023-11-25T04:08:37.140078+0000","last_peered":"2023-11-25T04:08:37.140078+0000","last_clean":"2023-11-25T04:08:37.140078+0000","last_became_active":"2023-11-25T04:08:36.152798+0000","last_became_peered":"2023-11-25T04:08:36.152798+0000","last_unstale":"2023-11-25T04:08:37.140078+0000","last_undegraded":"2023-11-25T04:08:37.140078+0000","last_fullsized":"2023-11-25T04:08:37.140078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081428+0000","last_change":"2023-11-25T04:08:36.145773+0000","last_active":"2023-11-25T04:08:39.081428+0000","last_peered":"2023-11-25T04:08:39.081428+0000","last_clean":"2023-11-25T04:08:39.081428+0000","last_became_active":"2023-11-25T04:08:36.144733+0000","last_became_peered":"2023-11-25T04:08:36.144733+0000","last_unstale":"2023-11-25T04:08:39.081428+0000","last_undegraded":"2023-11-25T04:08:39.081428+0000","last_fullsized":"2023-11-25T04:08:39.081428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082662+0000","last_change":"2023-11-25T04:08:36.154902+0000","last_active":"2023-11-25T04:08:39.082662+0000","last_peered":"2023-11-25T04:08:39.082662+0000","last_clean":"2023-11-25T04:08:39.082662+0000","last_became_active":"2023-11-25T04:08:36.154382+0000","last_became_peered":"2023-11-25T04:08:36.154382+0000","last_unstale":"2023-11-25T04:08:39.082662+0000","last_undegraded":"2023-11-25T04:08:39.082662+0000","last_fullsized":"2023-11-25T04:08:39.082662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:13:50.582370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.980118+0000","last_change":"2023-11-25T04:08:36.157895+0000","last_active":"2023-11-25T04:08:37.980118+0000","last_peered":"2023-11-25T04:08:37.980118+0000","last_clean":"2023-11-25T04:08:37.980118+0000","last_became_active":"2023-11-25T04:08:36.157530+0000","last_became_peered":"2023-11-25T04:08:36.157530+0000","last_unstale":"2023-11-25T04:08:37.980118+0000","last_undegraded":"2023-11-25T04:08:37.980118+0000","last_fullsized":"2023-11-25T04:08:37.980118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082180+0000","last_change":"2023-11-25T04:08:36.158558+0000","last_active":"2023-11-25T04:08:39.082180+0000","last_peered":"2023-11-25T04:08:39.082180+0000","last_clean":"2023-11-25T04:08:39.082180+0000","last_became_active":"2023-11-25T04:08:36.158280+0000","last_became_peered":"2023-11-25T04:08:36.158280+0000","last_unstale":"2023-11-25T04:08:39.082180+0000","last_undegraded":"2023-11-25T04:08:39.082180+0000","last_fullsized":"2023-11-25T04:08:39.082180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141133+0000","last_change":"2023-11-25T04:08:36.155419+0000","last_active":"2023-11-25T04:08:37.141133+0000","last_peered":"2023-11-25T04:08:37.141133+0000","last_clean":"2023-11-25T04:08:37.141133+0000","last_became_active":"2023-11-25T04:08:36.155113+0000","last_became_peered":"2023-11-25T04:08:36.155113+0000","last_unstale":"2023-11-25T04:08:37.141133+0000","last_undegraded":"2023-11-25T04:08:37.141133+0000","last_fullsized":"2023-11-25T04:08:37.141133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:06.500587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140200+0000","last_change":"2023-11-25T04:08:35.170018+0000","last_active":"2023-11-25T04:08:37.140200+0000","last_peered":"2023-11-25T04:08:37.140200+0000","last_clean":"2023-11-25T04:08:37.140200+0000","last_became_active":"2023-11-25T04:08:35.169712+0000","last_became_peered":"2023-11-25T04:08:35.169712+0000","last_unstale":"2023-11-25T04:08:37.140200+0000","last_undegraded":"2023-11-25T04:08:37.140200+0000","last_fullsized":"2023-11-25T04:08:37.140200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:21.947721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081440+0000","last_change":"2023-11-25T04:08:36.149119+0000","last_active":"2023-11-25T04:08:39.081440+0000","last_peered":"2023-11-25T04:08:39.081440+0000","last_clean":"2023-11-25T04:08:39.081440+0000","last_became_active":"2023-11-25T04:08:36.148656+0000","last_became_peered":"2023-11-25T04:08:36.148656+0000","last_unstale":"2023-11-25T04:08:39.081440+0000","last_undegraded":"2023-11-25T04:08:39.081440+0000","last_fullsized":"2023-11-25T04:08:39.081440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494575+0000","last_change":"2023-11-25T04:08:35.169640+0000","last_active":"2023-11-25T04:08:37.494575+0000","last_peered":"2023-11-25T04:08:37.494575+0000","last_clean":"2023-11-25T04:08:37.494575+0000","last_became_active":"2023-11-25T04:08:35.169229+0000","last_became_peered":"2023-11-25T04:08:35.169229+0000","last_unstale":"2023-11-25T04:08:37.494575+0000","last_undegraded":"2023-11-25T04:08:37.494575+0000","last_fullsized":"2023-11-25T04:08:37.494575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139797+0000","last_change":"2023-11-25T04:08:35.165325+0000","last_active":"2023-11-25T04:08:37.139797+0000","last_peered":"2023-11-25T04:08:37.139797+0000","last_clean":"2023-11-25T04:08:37.139797+0000","last_became_active":"2023-11-25T04:08:35.164962+0000","last_became_peered":"2023-11-25T04:08:35.164962+0000","last_unstale":"2023-11-25T04:08:37.139797+0000","last_undegraded":"2023-11-25T04:08:37.139797+0000","last_fullsized":"2023-11-25T04:08:37.139797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139742+0000","last_change":"2023-11-25T04:08:36.146000+0000","last_active":"2023-11-25T04:08:37.139742+0000","last_peered":"2023-11-25T04:08:37.139742+0000","last_clean":"2023-11-25T04:08:37.139742+0000","last_became_active":"2023-11-25T04:08:36.145662+0000","last_became_peered":"2023-11-25T04:08:36.145662+0000","last_unstale":"2023-11-25T04:08:37.139742+0000","last_undegraded":"2023-11-25T04:08:37.139742+0000","last_fullsized":"2023-11-25T04:08:37.139742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495693+0000","last_change":"2023-11-25T04:08:35.164501+0000","last_active":"2023-11-25T04:08:37.495693+0000","last_peered":"2023-11-25T04:08:37.495693+0000","last_clean":"2023-11-25T04:08:37.495693+0000","last_became_active":"2023-11-25T04:08:35.164008+0000","last_became_peered":"2023-11-25T04:08:35.164008+0000","last_unstale":"2023-11-25T04:08:37.495693+0000","last_undegraded":"2023-11-25T04:08:37.495693+0000","last_fullsized":"2023-11-25T04:08:37.495693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:49.360276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140664+0000","last_change":"2023-11-25T04:08:36.157653+0000","last_active":"2023-11-25T04:08:37.140664+0000","last_peered":"2023-11-25T04:08:37.140664+0000","last_clean":"2023-11-25T04:08:37.140664+0000","last_became_active":"2023-11-25T04:08:36.157323+0000","last_became_peered":"2023-11-25T04:08:36.157323+0000","last_unstale":"2023-11-25T04:08:37.140664+0000","last_undegraded":"2023-11-25T04:08:37.140664+0000","last_fullsized":"2023-11-25T04:08:37.140664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494708+0000","last_change":"2023-11-25T04:08:35.166516+0000","last_active":"2023-11-25T04:08:37.494708+0000","last_peered":"2023-11-25T04:08:37.494708+0000","last_clean":"2023-11-25T04:08:37.494708+0000","last_became_active":"2023-11-25T04:08:35.166204+0000","last_became_peered":"2023-11-25T04:08:35.166204+0000","last_unstale":"2023-11-25T04:08:37.494708+0000","last_undegraded":"2023-11-25T04:08:37.494708+0000","last_fullsized":"2023-11-25T04:08:37.494708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081546+0000","last_change":"2023-11-25T04:08:36.157253+0000","last_active":"2023-11-25T04:08:39.081546+0000","last_peered":"2023-11-25T04:08:39.081546+0000","last_clean":"2023-11-25T04:08:39.081546+0000","last_became_active":"2023-11-25T04:08:36.156799+0000","last_became_peered":"2023-11-25T04:08:36.156799+0000","last_unstale":"2023-11-25T04:08:39.081546+0000","last_undegraded":"2023-11-25T04:08:39.081546+0000","last_fullsized":"2023-11-25T04:08:39.081546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:34:53.382347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495845+0000","last_change":"2023-11-25T04:08:35.165700+0000","last_active":"2023-11-25T04:08:37.495845+0000","last_peered":"2023-11-25T04:08:37.495845+0000","last_clean":"2023-11-25T04:08:37.495845+0000","last_became_active":"2023-11-25T04:08:35.165341+0000","last_became_peered":"2023-11-25T04:08:35.165341+0000","last_unstale":"2023-11-25T04:08:37.495845+0000","last_undegraded":"2023-11-25T04:08:37.495845+0000","last_fullsized":"2023-11-25T04:08:37.495845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:58.609810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081389+0000","last_change":"2023-11-25T04:08:36.158411+0000","last_active":"2023-11-25T04:08:39.081389+0000","last_peered":"2023-11-25T04:08:39.081389+0000","last_clean":"2023-11-25T04:08:39.081389+0000","last_became_active":"2023-11-25T04:08:36.156523+0000","last_became_peered":"2023-11-25T04:08:36.156523+0000","last_unstale":"2023-11-25T04:08:39.081389+0000","last_undegraded":"2023-11-25T04:08:39.081389+0000","last_fullsized":"2023-11-25T04:08:39.081389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140940+0000","last_change":"2023-11-25T04:08:35.167699+0000","last_active":"2023-11-25T04:08:37.140940+0000","last_peered":"2023-11-25T04:08:37.140940+0000","last_clean":"2023-11-25T04:08:37.140940+0000","last_became_active":"2023-11-25T04:08:35.167457+0000","last_became_peered":"2023-11-25T04:08:35.167457+0000","last_unstale":"2023-11-25T04:08:37.140940+0000","last_undegraded":"2023-11-25T04:08:37.140940+0000","last_fullsized":"2023-11-25T04:08:37.140940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:22.460231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141339+0000","last_change":"2023-11-25T04:08:36.149678+0000","last_active":"2023-11-25T04:08:37.141339+0000","last_peered":"2023-11-25T04:08:37.141339+0000","last_clean":"2023-11-25T04:08:37.141339+0000","last_became_active":"2023-11-25T04:08:36.149356+0000","last_became_peered":"2023-11-25T04:08:36.149356+0000","last_unstale":"2023-11-25T04:08:37.141339+0000","last_undegraded":"2023-11-25T04:08:37.141339+0000","last_fullsized":"2023-11-25T04:08:37.141339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494625+0000","last_change":"2023-11-25T04:08:35.164920+0000","last_active":"2023-11-25T04:08:37.494625+0000","last_peered":"2023-11-25T04:08:37.494625+0000","last_clean":"2023-11-25T04:08:37.494625+0000","last_became_active":"2023-11-25T04:08:35.164319+0000","last_became_peered":"2023-11-25T04:08:35.164319+0000","last_unstale":"2023-11-25T04:08:37.494625+0000","last_undegraded":"2023-11-25T04:08:37.494625+0000","last_fullsized":"2023-11-25T04:08:37.494625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:50.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081774+0000","last_change":"2023-11-25T04:08:36.158479+0000","last_active":"2023-11-25T04:08:39.081774+0000","last_peered":"2023-11-25T04:08:39.081774+0000","last_clean":"2023-11-25T04:08:39.081774+0000","last_became_active":"2023-11-25T04:08:36.158222+0000","last_became_peered":"2023-11-25T04:08:36.158222+0000","last_unstale":"2023-11-25T04:08:39.081774+0000","last_undegraded":"2023-11-25T04:08:39.081774+0000","last_fullsized":"2023-11-25T04:08:39.081774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:56:48.338925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494482+0000","last_change":"2023-11-25T04:08:35.175417+0000","last_active":"2023-11-25T04:08:37.494482+0000","last_peered":"2023-11-25T04:08:37.494482+0000","last_clean":"2023-11-25T04:08:37.494482+0000","last_became_active":"2023-11-25T04:08:35.175050+0000","last_became_peered":"2023-11-25T04:08:35.175050+0000","last_unstale":"2023-11-25T04:08:37.494482+0000","last_undegraded":"2023-11-25T04:08:37.494482+0000","last_fullsized":"2023-11-25T04:08:37.494482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081052+0000","last_change":"2023-11-25T04:08:36.155250+0000","last_active":"2023-11-25T04:08:39.081052+0000","last_peered":"2023-11-25T04:08:39.081052+0000","last_clean":"2023-11-25T04:08:39.081052+0000","last_became_active":"2023-11-25T04:08:36.154944+0000","last_became_peered":"2023-11-25T04:08:36.154944+0000","last_unstale":"2023-11-25T04:08:39.081052+0000","last_undegraded":"2023-11-25T04:08:39.081052+0000","last_fullsized":"2023-11-25T04:08:39.081052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:23.464341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495746+0000","last_change":"2023-11-25T04:08:35.162897+0000","last_active":"2023-11-25T04:08:37.495746+0000","last_peered":"2023-11-25T04:08:37.495746+0000","last_clean":"2023-11-25T04:08:37.495746+0000","last_became_active":"2023-11-25T04:08:35.162684+0000","last_became_peered":"2023-11-25T04:08:35.162684+0000","last_unstale":"2023-11-25T04:08:37.495746+0000","last_undegraded":"2023-11-25T04:08:37.495746+0000","last_fullsized":"2023-11-25T04:08:37.495746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:07.785129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082246+0000","last_change":"2023-11-25T04:08:36.153204+0000","last_active":"2023-11-25T04:08:39.082246+0000","last_peered":"2023-11-25T04:08:39.082246+0000","last_clean":"2023-11-25T04:08:39.082246+0000","last_became_active":"2023-11-25T04:08:36.152856+0000","last_became_peered":"2023-11-25T04:08:36.152856+0000","last_unstale":"2023-11-25T04:08:39.082246+0000","last_undegraded":"2023-11-25T04:08:39.082246+0000","last_fullsized":"2023-11-25T04:08:39.082246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:01:26.950408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494527+0000","last_change":"2023-11-25T04:08:35.170232+0000","last_active":"2023-11-25T04:08:37.494527+0000","last_peered":"2023-11-25T04:08:37.494527+0000","last_clean":"2023-11-25T04:08:37.494527+0000","last_became_active":"2023-11-25T04:08:35.168959+0000","last_became_peered":"2023-11-25T04:08:35.168959+0000","last_unstale":"2023-11-25T04:08:37.494527+0000","last_undegraded":"2023-11-25T04:08:37.494527+0000","last_fullsized":"2023-11-25T04:08:37.494527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:25.799051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082327+0000","last_change":"2023-11-25T04:08:36.159133+0000","last_active":"2023-11-25T04:08:39.082327+0000","last_peered":"2023-11-25T04:08:39.082327+0000","last_clean":"2023-11-25T04:08:39.082327+0000","last_became_active":"2023-11-25T04:08:36.158832+0000","last_became_peered":"2023-11-25T04:08:36.158832+0000","last_unstale":"2023-11-25T04:08:39.082327+0000","last_undegraded":"2023-11-25T04:08:39.082327+0000","last_fullsized":"2023-11-25T04:08:39.082327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.498652+0000","last_change":"2023-11-25T04:08:35.158168+0000","last_active":"2023-11-25T04:08:37.498652+0000","last_peered":"2023-11-25T04:08:37.498652+0000","last_clean":"2023-11-25T04:08:37.498652+0000","last_became_active":"2023-11-25T04:08:35.157857+0000","last_became_peered":"2023-11-25T04:08:35.157857+0000","last_unstale":"2023-11-25T04:08:37.498652+0000","last_undegraded":"2023-11-25T04:08:37.498652+0000","last_fullsized":"2023-11-25T04:08:37.498652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:16.648041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081536+0000","last_change":"2023-11-25T04:08:36.153946+0000","last_active":"2023-11-25T04:08:39.081536+0000","last_peered":"2023-11-25T04:08:39.081536+0000","last_clean":"2023-11-25T04:08:39.081536+0000","last_became_active":"2023-11-25T04:08:36.153643+0000","last_became_peered":"2023-11-25T04:08:36.153643+0000","last_unstale":"2023-11-25T04:08:39.081536+0000","last_undegraded":"2023-11-25T04:08:39.081536+0000","last_fullsized":"2023-11-25T04:08:39.081536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:34:53.382347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141439+0000","last_change":"2023-11-25T04:08:35.168907+0000","last_active":"2023-11-25T04:08:37.141439+0000","last_peered":"2023-11-25T04:08:37.141439+0000","last_clean":"2023-11-25T04:08:37.141439+0000","last_became_active":"2023-11-25T04:08:35.168515+0000","last_became_peered":"2023-11-25T04:08:35.168515+0000","last_unstale":"2023-11-25T04:08:37.141439+0000","last_undegraded":"2023-11-25T04:08:37.141439+0000","last_fullsized":"2023-11-25T04:08:37.141439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:16.648041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082398+0000","last_change":"2023-11-25T04:08:36.159282+0000","last_active":"2023-11-25T04:08:39.082398+0000","last_peered":"2023-11-25T04:08:39.082398+0000","last_clean":"2023-11-25T04:08:39.082398+0000","last_became_active":"2023-11-25T04:08:36.159008+0000","last_became_peered":"2023-11-25T04:08:36.159008+0000","last_unstale":"2023-11-25T04:08:39.082398+0000","last_undegraded":"2023-11-25T04:08:39.082398+0000","last_fullsized":"2023-11-25T04:08:39.082398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:15:08.072394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.498705+0000","last_change":"2023-11-25T04:08:35.161420+0000","last_active":"2023-11-25T04:08:37.498705+0000","last_peered":"2023-11-25T04:08:37.498705+0000","last_clean":"2023-11-25T04:08:37.498705+0000","last_became_active":"2023-11-25T04:08:35.161085+0000","last_became_peered":"2023-11-25T04:08:35.161085+0000","last_unstale":"2023-11-25T04:08:37.498705+0000","last_undegraded":"2023-11-25T04:08:37.498705+0000","last_fullsized":"2023-11-25T04:08:37.498705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:37.314044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082853+0000","last_change":"2023-11-25T04:08:36.160108+0000","last_active":"2023-11-25T04:08:39.082853+0000","last_peered":"2023-11-25T04:08:39.082853+0000","last_clean":"2023-11-25T04:08:39.082853+0000","last_became_active":"2023-11-25T04:08:36.159833+0000","last_became_peered":"2023-11-25T04:08:36.159833+0000","last_unstale":"2023-11-25T04:08:39.082853+0000","last_undegraded":"2023-11-25T04:08:39.082853+0000","last_fullsized":"2023-11-25T04:08:39.082853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:13:50.582370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141018+0000","last_change":"2023-11-25T04:08:35.166785+0000","last_active":"2023-11-25T04:08:37.141018+0000","last_peered":"2023-11-25T04:08:37.141018+0000","last_clean":"2023-11-25T04:08:37.141018+0000","last_became_active":"2023-11-25T04:08:35.166502+0000","last_became_peered":"2023-11-25T04:08:35.166502+0000","last_unstale":"2023-11-25T04:08:37.141018+0000","last_undegraded":"2023-11-25T04:08:37.141018+0000","last_fullsized":"2023-11-25T04:08:37.141018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:57.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081993+0000","last_change":"2023-11-25T04:08:36.154284+0000","last_active":"2023-11-25T04:08:39.081993+0000","last_peered":"2023-11-25T04:08:39.081993+0000","last_clean":"2023-11-25T04:08:39.081993+0000","last_became_active":"2023-11-25T04:08:36.152651+0000","last_became_peered":"2023-11-25T04:08:36.152651+0000","last_unstale":"2023-11-25T04:08:39.081993+0000","last_undegraded":"2023-11-25T04:08:39.081993+0000","last_fullsized":"2023-11-25T04:08:39.081993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:10:58.141053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.498688+0000","last_change":"2023-11-25T04:08:35.164026+0000","last_active":"2023-11-25T04:08:37.498688+0000","last_peered":"2023-11-25T04:08:37.498688+0000","last_clean":"2023-11-25T04:08:37.498688+0000","last_became_active":"2023-11-25T04:08:35.163726+0000","last_became_peered":"2023-11-25T04:08:35.163726+0000","last_unstale":"2023-11-25T04:08:37.498688+0000","last_undegraded":"2023-11-25T04:08:37.498688+0000","last_fullsized":"2023-11-25T04:08:37.498688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:25.799051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081940+0000","last_change":"2023-11-25T04:08:36.162872+0000","last_active":"2023-11-25T04:08:39.081940+0000","last_peered":"2023-11-25T04:08:39.081940+0000","last_clean":"2023-11-25T04:08:39.081940+0000","last_became_active":"2023-11-25T04:08:36.162603+0000","last_became_peered":"2023-11-25T04:08:36.162603+0000","last_unstale":"2023-11-25T04:08:39.081940+0000","last_undegraded":"2023-11-25T04:08:39.081940+0000","last_fullsized":"2023-11-25T04:08:39.081940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:09:24.146017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.145255+0000","last_change":"2023-11-25T04:08:24.570240+0000","last_active":"2023-11-25T04:08:36.145255+0000","last_peered":"2023-11-25T04:08:36.145255+0000","last_clean":"2023-11-25T04:08:36.145255+0000","last_became_active":"2023-11-25T04:08:24.569371+0000","last_became_peered":"2023-11-25T04:08:24.569371+0000","last_unstale":"2023-11-25T04:08:36.145255+0000","last_undegraded":"2023-11-25T04:08:36.145255+0000","last_fullsized":"2023-11-25T04:08:36.145255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_clean_scrub_stamp":"2023-11-25T04:08:23.534401+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:28.293127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495768+0000","last_change":"2023-11-25T04:08:35.151872+0000","last_active":"2023-11-25T04:08:37.495768+0000","last_peered":"2023-11-25T04:08:37.495768+0000","last_clean":"2023-11-25T04:08:37.495768+0000","last_became_active":"2023-11-25T04:08:35.151557+0000","last_became_peered":"2023-11-25T04:08:35.151557+0000","last_unstale":"2023-11-25T04:08:37.495768+0000","last_undegraded":"2023-11-25T04:08:37.495768+0000","last_fullsized":"2023-11-25T04:08:37.495768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139961+0000","last_change":"2023-11-25T04:08:36.159174+0000","last_active":"2023-11-25T04:08:37.139961+0000","last_peered":"2023-11-25T04:08:37.139961+0000","last_clean":"2023-11-25T04:08:37.139961+0000","last_became_active":"2023-11-25T04:08:36.158893+0000","last_became_peered":"2023-11-25T04:08:36.158893+0000","last_unstale":"2023-11-25T04:08:37.139961+0000","last_undegraded":"2023-11-25T04:08:37.139961+0000","last_fullsized":"2023-11-25T04:08:37.139961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499145+0000","last_change":"2023-11-25T04:08:35.166896+0000","last_active":"2023-11-25T04:08:37.499145+0000","last_peered":"2023-11-25T04:08:37.499145+0000","last_clean":"2023-11-25T04:08:37.499145+0000","last_became_active":"2023-11-25T04:08:35.166601+0000","last_became_peered":"2023-11-25T04:08:35.166601+0000","last_unstale":"2023-11-25T04:08:37.499145+0000","last_undegraded":"2023-11-25T04:08:37.499145+0000","last_fullsized":"2023-11-25T04:08:37.499145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:05.496477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.080948+0000","last_change":"2023-11-25T04:08:36.147229+0000","last_active":"2023-11-25T04:08:39.080948+0000","last_peered":"2023-11-25T04:08:39.080948+0000","last_clean":"2023-11-25T04:08:39.080948+0000","last_became_active":"2023-11-25T04:08:36.146889+0000","last_became_peered":"2023-11-25T04:08:36.146889+0000","last_unstale":"2023-11-25T04:08:39.080948+0000","last_undegraded":"2023-11-25T04:08:39.080948+0000","last_fullsized":"2023-11-25T04:08:39.080948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:39.596607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.498679+0000","last_change":"2023-11-25T04:08:35.162405+0000","last_active":"2023-11-25T04:08:37.498679+0000","last_peered":"2023-11-25T04:08:37.498679+0000","last_clean":"2023-11-25T04:08:37.498679+0000","last_became_active":"2023-11-25T04:08:35.162084+0000","last_became_peered":"2023-11-25T04:08:35.162084+0000","last_unstale":"2023-11-25T04:08:37.498679+0000","last_undegraded":"2023-11-25T04:08:37.498679+0000","last_fullsized":"2023-11-25T04:08:37.498679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140649+0000","last_change":"2023-11-25T04:08:36.152006+0000","last_active":"2023-11-25T04:08:37.140649+0000","last_peered":"2023-11-25T04:08:37.140649+0000","last_clean":"2023-11-25T04:08:37.140649+0000","last_became_active":"2023-11-25T04:08:36.151655+0000","last_became_peered":"2023-11-25T04:08:36.151655+0000","last_unstale":"2023-11-25T04:08:37.140649+0000","last_undegraded":"2023-11-25T04:08:37.140649+0000","last_fullsized":"2023-11-25T04:08:37.140649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495757+0000","last_change":"2023-11-25T04:08:35.162315+0000","last_active":"2023-11-25T04:08:37.495757+0000","last_peered":"2023-11-25T04:08:37.495757+0000","last_clean":"2023-11-25T04:08:37.495757+0000","last_became_active":"2023-11-25T04:08:35.162052+0000","last_became_peered":"2023-11-25T04:08:35.162052+0000","last_unstale":"2023-11-25T04:08:37.495757+0000","last_undegraded":"2023-11-25T04:08:37.495757+0000","last_fullsized":"2023-11-25T04:08:37.495757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:53.354503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141360+0000","last_change":"2023-11-25T04:08:36.158785+0000","last_active":"2023-11-25T04:08:37.141360+0000","last_peered":"2023-11-25T04:08:37.141360+0000","last_clean":"2023-11-25T04:08:37.141360+0000","last_became_active":"2023-11-25T04:08:36.155440+0000","last_became_peered":"2023-11-25T04:08:36.155440+0000","last_unstale":"2023-11-25T04:08:37.141360+0000","last_undegraded":"2023-11-25T04:08:37.141360+0000","last_fullsized":"2023-11-25T04:08:37.141360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:03.560567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140844+0000","last_change":"2023-11-25T04:08:35.168321+0000","last_active":"2023-11-25T04:08:37.140844+0000","last_peered":"2023-11-25T04:08:37.140844+0000","last_clean":"2023-11-25T04:08:37.140844+0000","last_became_active":"2023-11-25T04:08:35.168047+0000","last_became_peered":"2023-11-25T04:08:35.168047+0000","last_unstale":"2023-11-25T04:08:37.140844+0000","last_undegraded":"2023-11-25T04:08:37.140844+0000","last_fullsized":"2023-11-25T04:08:37.140844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:49.360276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082583+0000","last_change":"2023-11-25T04:08:36.157577+0000","last_active":"2023-11-25T04:08:39.082583+0000","last_peered":"2023-11-25T04:08:39.082583+0000","last_clean":"2023-11-25T04:08:39.082583+0000","last_became_active":"2023-11-25T04:08:36.157302+0000","last_became_peered":"2023-11-25T04:08:36.157302+0000","last_unstale":"2023-11-25T04:08:39.082583+0000","last_undegraded":"2023-11-25T04:08:39.082583+0000","last_fullsized":"2023-11-25T04:08:39.082583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:18.611394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499307+0000","last_change":"2023-11-25T04:08:35.171642+0000","last_active":"2023-11-25T04:08:37.499307+0000","last_peered":"2023-11-25T04:08:37.499307+0000","last_clean":"2023-11-25T04:08:37.499307+0000","last_became_active":"2023-11-25T04:08:35.171169+0000","last_became_peered":"2023-11-25T04:08:35.171169+0000","last_unstale":"2023-11-25T04:08:37.499307+0000","last_undegraded":"2023-11-25T04:08:37.499307+0000","last_fullsized":"2023-11-25T04:08:37.499307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:57.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140868+0000","last_change":"2023-11-25T04:08:36.155558+0000","last_active":"2023-11-25T04:08:37.140868+0000","last_peered":"2023-11-25T04:08:37.140868+0000","last_clean":"2023-11-25T04:08:37.140868+0000","last_became_active":"2023-11-25T04:08:36.155280+0000","last_became_peered":"2023-11-25T04:08:36.155280+0000","last_unstale":"2023-11-25T04:08:37.140868+0000","last_undegraded":"2023-11-25T04:08:37.140868+0000","last_fullsized":"2023-11-25T04:08:37.140868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.503059+0000","last_change":"2023-11-25T04:08:35.164983+0000","last_active":"2023-11-25T04:08:37.503059+0000","last_peered":"2023-11-25T04:08:37.503059+0000","last_clean":"2023-11-25T04:08:37.503059+0000","last_became_active":"2023-11-25T04:08:35.164714+0000","last_became_peered":"2023-11-25T04:08:35.164714+0000","last_unstale":"2023-11-25T04:08:37.503059+0000","last_undegraded":"2023-11-25T04:08:37.503059+0000","last_fullsized":"2023-11-25T04:08:37.503059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:58.609810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140402+0000","last_change":"2023-11-25T04:08:36.155740+0000","last_active":"2023-11-25T04:08:37.140402+0000","last_peered":"2023-11-25T04:08:37.140402+0000","last_clean":"2023-11-25T04:08:37.140402+0000","last_became_active":"2023-11-25T04:08:36.155416+0000","last_became_peered":"2023-11-25T04:08:36.155416+0000","last_unstale":"2023-11-25T04:08:37.140402+0000","last_undegraded":"2023-11-25T04:08:37.140402+0000","last_fullsized":"2023-11-25T04:08:37.140402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:34:53.382347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494721+0000","last_change":"2023-11-25T04:08:35.164671+0000","last_active":"2023-11-25T04:08:37.494721+0000","last_peered":"2023-11-25T04:08:37.494721+0000","last_clean":"2023-11-25T04:08:37.494721+0000","last_became_active":"2023-11-25T04:08:35.164303+0000","last_became_peered":"2023-11-25T04:08:35.164303+0000","last_unstale":"2023-11-25T04:08:37.494721+0000","last_undegraded":"2023-11-25T04:08:37.494721+0000","last_fullsized":"2023-11-25T04:08:37.494721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:21.947721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081397+0000","last_change":"2023-11-25T04:08:36.152277+0000","last_active":"2023-11-25T04:08:39.081397+0000","last_peered":"2023-11-25T04:08:39.081397+0000","last_clean":"2023-11-25T04:08:39.081397+0000","last_became_active":"2023-11-25T04:08:36.151952+0000","last_became_peered":"2023-11-25T04:08:36.151952+0000","last_unstale":"2023-11-25T04:08:39.081397+0000","last_undegraded":"2023-11-25T04:08:39.081397+0000","last_fullsized":"2023-11-25T04:08:39.081397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499129+0000","last_change":"2023-11-25T04:08:35.169634+0000","last_active":"2023-11-25T04:08:37.499129+0000","last_peered":"2023-11-25T04:08:37.499129+0000","last_clean":"2023-11-25T04:08:37.499129+0000","last_became_active":"2023-11-25T04:08:35.169006+0000","last_became_peered":"2023-11-25T04:08:35.169006+0000","last_unstale":"2023-11-25T04:08:37.499129+0000","last_undegraded":"2023-11-25T04:08:37.499129+0000","last_fullsized":"2023-11-25T04:08:37.499129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:37.314044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141007+0000","last_change":"2023-11-25T04:08:36.152671+0000","last_active":"2023-11-25T04:08:37.141007+0000","last_peered":"2023-11-25T04:08:37.141007+0000","last_clean":"2023-11-25T04:08:37.141007+0000","last_became_active":"2023-11-25T04:08:36.152379+0000","last_became_peered":"2023-11-25T04:08:36.152379+0000","last_unstale":"2023-11-25T04:08:37.141007+0000","last_undegraded":"2023-11-25T04:08:37.141007+0000","last_fullsized":"2023-11-25T04:08:37.141007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140747+0000","last_change":"2023-11-25T04:08:35.164407+0000","last_active":"2023-11-25T04:08:37.140747+0000","last_peered":"2023-11-25T04:08:37.140747+0000","last_clean":"2023-11-25T04:08:37.140747+0000","last_became_active":"2023-11-25T04:08:35.164096+0000","last_became_peered":"2023-11-25T04:08:35.164096+0000","last_unstale":"2023-11-25T04:08:37.140747+0000","last_undegraded":"2023-11-25T04:08:37.140747+0000","last_fullsized":"2023-11-25T04:08:37.140747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140279+0000","last_change":"2023-11-25T04:08:36.155323+0000","last_active":"2023-11-25T04:08:37.140279+0000","last_peered":"2023-11-25T04:08:37.140279+0000","last_clean":"2023-11-25T04:08:37.140279+0000","last_became_active":"2023-11-25T04:08:36.154026+0000","last_became_peered":"2023-11-25T04:08:36.154026+0000","last_unstale":"2023-11-25T04:08:37.140279+0000","last_undegraded":"2023-11-25T04:08:37.140279+0000","last_fullsized":"2023-11-25T04:08:37.140279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:50.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140840+0000","last_change":"2023-11-25T04:08:35.161694+0000","last_active":"2023-11-25T04:08:37.140840+0000","last_peered":"2023-11-25T04:08:37.140840+0000","last_clean":"2023-11-25T04:08:37.140840+0000","last_became_active":"2023-11-25T04:08:35.161392+0000","last_became_peered":"2023-11-25T04:08:35.161392+0000","last_unstale":"2023-11-25T04:08:37.140840+0000","last_undegraded":"2023-11-25T04:08:37.140840+0000","last_fullsized":"2023-11-25T04:08:37.140840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140137+0000","last_change":"2023-11-25T04:08:36.147757+0000","last_active":"2023-11-25T04:08:37.140137+0000","last_peered":"2023-11-25T04:08:37.140137+0000","last_clean":"2023-11-25T04:08:37.140137+0000","last_became_active":"2023-11-25T04:08:36.147483+0000","last_became_peered":"2023-11-25T04:08:36.147483+0000","last_unstale":"2023-11-25T04:08:37.140137+0000","last_undegraded":"2023-11-25T04:08:37.140137+0000","last_fullsized":"2023-11-25T04:08:37.140137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499222+0000","last_change":"2023-11-25T04:08:35.170314+0000","last_active":"2023-11-25T04:08:37.499222+0000","last_peered":"2023-11-25T04:08:37.499222+0000","last_clean":"2023-11-25T04:08:37.499222+0000","last_became_active":"2023-11-25T04:08:35.170029+0000","last_became_peered":"2023-11-25T04:08:35.170029+0000","last_unstale":"2023-11-25T04:08:37.499222+0000","last_undegraded":"2023-11-25T04:08:37.499222+0000","last_fullsized":"2023-11-25T04:08:37.499222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:22.460231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081357+0000","last_change":"2023-11-25T04:08:36.161075+0000","last_active":"2023-11-25T04:08:39.081357+0000","last_peered":"2023-11-25T04:08:39.081357+0000","last_clean":"2023-11-25T04:08:39.081357+0000","last_became_active":"2023-11-25T04:08:36.160734+0000","last_became_peered":"2023-11-25T04:08:36.160734+0000","last_unstale":"2023-11-25T04:08:39.081357+0000","last_undegraded":"2023-11-25T04:08:39.081357+0000","last_fullsized":"2023-11-25T04:08:39.081357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082486+0000","last_change":"2023-11-25T04:08:36.160701+0000","last_active":"2023-11-25T04:08:39.082486+0000","last_peered":"2023-11-25T04:08:39.082486+0000","last_clean":"2023-11-25T04:08:39.082486+0000","last_became_active":"2023-11-25T04:08:36.160423+0000","last_became_peered":"2023-11-25T04:08:36.160423+0000","last_unstale":"2023-11-25T04:08:39.082486+0000","last_undegraded":"2023-11-25T04:08:39.082486+0000","last_fullsized":"2023-11-25T04:08:39.082486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:15:08.072394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499236+0000","last_change":"2023-11-25T04:08:35.170930+0000","last_active":"2023-11-25T04:08:37.499236+0000","last_peered":"2023-11-25T04:08:37.499236+0000","last_clean":"2023-11-25T04:08:37.499236+0000","last_became_active":"2023-11-25T04:08:35.170627+0000","last_became_peered":"2023-11-25T04:08:35.170627+0000","last_unstale":"2023-11-25T04:08:37.499236+0000","last_undegraded":"2023-11-25T04:08:37.499236+0000","last_fullsized":"2023-11-25T04:08:37.499236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:50.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081851+0000","last_change":"2023-11-25T04:08:36.151765+0000","last_active":"2023-11-25T04:08:39.081851+0000","last_peered":"2023-11-25T04:08:39.081851+0000","last_clean":"2023-11-25T04:08:39.081851+0000","last_became_active":"2023-11-25T04:08:36.151464+0000","last_became_peered":"2023-11-25T04:08:36.151464+0000","last_unstale":"2023-11-25T04:08:39.081851+0000","last_undegraded":"2023-11-25T04:08:39.081851+0000","last_fullsized":"2023-11-25T04:08:39.081851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:09:24.146017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499283+0000","last_change":"2023-11-25T04:08:35.170080+0000","last_active":"2023-11-25T04:08:37.499283+0000","last_peered":"2023-11-25T04:08:37.499283+0000","last_clean":"2023-11-25T04:08:37.499283+0000","last_became_active":"2023-11-25T04:08:35.169782+0000","last_became_peered":"2023-11-25T04:08:35.169782+0000","last_unstale":"2023-11-25T04:08:37.499283+0000","last_undegraded":"2023-11-25T04:08:37.499283+0000","last_fullsized":"2023-11-25T04:08:37.499283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081376+0000","last_change":"2023-11-25T04:08:36.158134+0000","last_active":"2023-11-25T04:08:39.081376+0000","last_peered":"2023-11-25T04:08:39.081376+0000","last_clean":"2023-11-25T04:08:39.081376+0000","last_became_active":"2023-11-25T04:08:36.157273+0000","last_became_peered":"2023-11-25T04:08:36.157273+0000","last_unstale":"2023-11-25T04:08:39.081376+0000","last_undegraded":"2023-11-25T04:08:39.081376+0000","last_fullsized":"2023-11-25T04:08:39.081376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140288+0000","last_change":"2023-11-25T04:08:35.168130+0000","last_active":"2023-11-25T04:08:37.140288+0000","last_peered":"2023-11-25T04:08:37.140288+0000","last_clean":"2023-11-25T04:08:37.140288+0000","last_became_active":"2023-11-25T04:08:35.167876+0000","last_became_peered":"2023-11-25T04:08:35.167876+0000","last_unstale":"2023-11-25T04:08:37.140288+0000","last_undegraded":"2023-11-25T04:08:37.140288+0000","last_fullsized":"2023-11-25T04:08:37.140288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140071+0000","last_change":"2023-11-25T04:08:36.157577+0000","last_active":"2023-11-25T04:08:37.140071+0000","last_peered":"2023-11-25T04:08:37.140071+0000","last_clean":"2023-11-25T04:08:37.140071+0000","last_became_active":"2023-11-25T04:08:36.157233+0000","last_became_peered":"2023-11-25T04:08:36.157233+0000","last_unstale":"2023-11-25T04:08:37.140071+0000","last_undegraded":"2023-11-25T04:08:37.140071+0000","last_fullsized":"2023-11-25T04:08:37.140071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494594+0000","last_change":"2023-11-25T04:08:35.170151+0000","last_active":"2023-11-25T04:08:37.494594+0000","last_peered":"2023-11-25T04:08:37.494594+0000","last_clean":"2023-11-25T04:08:37.494594+0000","last_became_active":"2023-11-25T04:08:35.169808+0000","last_became_peered":"2023-11-25T04:08:35.169808+0000","last_unstale":"2023-11-25T04:08:37.494594+0000","last_undegraded":"2023-11-25T04:08:37.494594+0000","last_fullsized":"2023-11-25T04:08:37.494594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:05.496477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-25T04:08:45.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-25T04:08:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.979+0000 7f85a81e5640 1 Processor -- start 2023-11-25T04:08:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.979+0000 7f85a81e5640 1 -- start start 2023-11-25T04:08:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.980+0000 7f85a81e5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.980+0000 7f85a81e5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f85a00d37f0 0x7f85a00b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.980+0000 7f85a81e5640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a00cf260 con 0x7f85a00d2010 2023-11-25T04:08:45.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.980+0000 7f85a81e5640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a00ceca0 con 0x7f85a00d37f0 2023-11-25T04:08:45.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.980+0000 7f85a81e5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00cef80 con 0x7f85a015d460 2023-11-25T04:08:45.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.980+0000 7f85a5f81640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.980+0000 7f85a6782640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f85a00d37f0 0x7f85a00b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.980+0000 7f85a5f81640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00d1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:40000/0 (socket says 172.21.15.2:40000) 2023-11-25T04:08:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.980+0000 7f85a5f81640 1 -- 172.21.15.2:0/1591343266 learned_addr learned my addr 172.21.15.2:0/1591343266 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.981+0000 7f85a5f81640 1 -- 172.21.15.2:0/1591343266 >> v2:172.21.15.66:3300/0 conn(0x7f85a00d37f0 msgr2=0x7f85a00b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.981+0000 7f85a5f81640 1 --2- 172.21.15.2:0/1591343266 >> v2:172.21.15.66:3300/0 conn(0x7f85a00d37f0 0x7f85a00b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.981+0000 7f85a5f81640 1 -- 172.21.15.2:0/1591343266 >> v1:172.21.15.66:6789/0 conn(0x7f85a00d2010 legacy=0x7f85a00d30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.981+0000 7f85a5f81640 1 -- 172.21.15.2:0/1591343266 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a00b31b0 con 0x7f85a015d460 2023-11-25T04:08:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.981+0000 7f85a4f7f640 1 -- 172.21.15.2:0/1591343266 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531973394 0 0) 0x7f85a00cf260 con 0x7f85a00d2010 2023-11-25T04:08:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.981+0000 7f85a6782640 1 --2- 172.21.15.2:0/1591343266 >> v2:172.21.15.66:3300/0 conn(0x7f85a00d37f0 0x7f85a00b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:45.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.981+0000 7f85a5f81640 1 --2- 172.21.15.2:0/1591343266 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00d1ad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8598009870 tx=0x7f859802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0af34e5faba6308 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.981+0000 7f85a4f7f640 1 -- 172.21.15.2:0/1591343266 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598031640 con 0x7f85a015d460 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a4f7f640 1 -- 172.21.15.2:0/1591343266 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85980317a0 con 0x7f85a015d460 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a4f7f640 1 -- 172.21.15.2:0/1591343266 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8598031b30 con 0x7f85a015d460 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a81e5640 1 -- 172.21.15.2:0/1591343266 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 msgr2=0x7f85a00d1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a81e5640 1 --2- 172.21.15.2:0/1591343266 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00d1ad0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8598009870 tx=0x7f859802b8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a81e5640 1 -- 172.21.15.2:0/1591343266 shutdown_connections 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a81e5640 1 --2- 172.21.15.2:0/1591343266 >> v2:172.21.15.66:3300/0 conn(0x7f85a00d37f0 0x7f85a00b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a81e5640 1 --2- 172.21.15.2:0/1591343266 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00d1ad0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a81e5640 1 -- 172.21.15.2:0/1591343266 >> 172.21.15.2:0/1591343266 conn(0x7f85a008cb60 msgr2=0x7f85a009c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a81e5640 1 -- 172.21.15.2:0/1591343266 shutdown_connections 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.982+0000 7f85a81e5640 1 -- 172.21.15.2:0/1591343266 wait complete. 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.983+0000 7f85a81e5640 1 Processor -- start 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.983+0000 7f85a81e5640 1 -- start start 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a81e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85a00d2010 0x7f85a00b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a81e5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a00d37f0 0x7f85a014f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a81e5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a81e5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00b72a0 con 0x7f85a00d2010 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a81e5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00b6620 con 0x7f85a00d37f0 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a81e5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a00b6900 con 0x7f85a015d460 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a5f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85a00d2010 0x7f85a00b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a5f81640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85a00d2010 0x7f85a00b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53506/0 (socket says 172.21.15.2:53506) 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a5f81640 1 -- 172.21.15.2:0/3592253192 learned_addr learned my addr 172.21.15.2:0/3592253192 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a5780640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a00d37f0 0x7f85a014f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a6782640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a5f81640 1 -- 172.21.15.2:0/3592253192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 msgr2=0x7f85a00cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a5f81640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a5f81640 1 -- 172.21.15.2:0/3592253192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a00d37f0 msgr2=0x7f85a014f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a5f81640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a00d37f0 0x7f85a014f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.984+0000 7f85a5f81640 1 -- 172.21.15.2:0/3592253192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c009a70 con 0x7f85a00d2010 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.985+0000 7f85a5f81640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85a00d2010 0x7f85a00b5d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f859802b930 tx=0x7f85980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.985+0000 7f85967fc640 1 -- 172.21.15.2:0/3592253192 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859803b940 con 0x7f85a00d2010 2023-11-25T04:08:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.985+0000 7f85967fc640 1 -- 172.21.15.2:0/3592253192 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859803baa0 con 0x7f85a00d2010 2023-11-25T04:08:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.985+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85980094d0 con 0x7f85a00d2010 2023-11-25T04:08:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.985+0000 7f85967fc640 1 -- 172.21.15.2:0/3592253192 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859803be50 con 0x7f85a00d2010 2023-11-25T04:08:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.985+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a00b6ec0 con 0x7f85a00d2010 2023-11-25T04:08:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.986+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a00b73e0 con 0x7f85a00d2010 2023-11-25T04:08:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.986+0000 7f85967fc640 1 -- 172.21.15.2:0/3592253192 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f859802f050 con 0x7f85a00d2010 2023-11-25T04:08:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.987+0000 7f85967fc640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f858406ae40 0x7f858406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.987+0000 7f85967fc640 1 -- 172.21.15.2:0/3592253192 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85980ab2e0 con 0x7f85a00d2010 2023-11-25T04:08:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.987+0000 7f85a5780640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f858406ae40 0x7f858406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.987+0000 7f85a5780640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f858406ae40 0x7f858406d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85a00c9cb0 tx=0x7f8590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:45.991+0000 7f85967fc640 1 -- 172.21.15.2:0/3592253192 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85980763a0 con 0x7f85a00d2010 2023-11-25T04:08:46.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.162+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 --> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f85a00afde0 con 0x7f858406ae40 2023-11-25T04:08:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.169+0000 7f85967fc640 1 -- 172.21.15.2:0/3592253192 <== mgr.4107 v2:172.21.15.2:6832/523998843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264573 (secure 0 0 0) 0x7f8590001420 con 0x7f858406ae40 2023-11-25T04:08:46.174 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-25T04:08:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f858406ae40 msgr2=0x7f858406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f858406ae40 0x7f858406d300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f85a00c9cb0 tx=0x7f8590009040 comp rx=0 tx=0).stop 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85a00d2010 msgr2=0x7f85a00b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85a00d2010 0x7f85a00b5d40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f859802b930 tx=0x7f85980046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 shutdown_connections 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a015d460 0x7f85a00cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f858406ae40 0x7f858406d300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a00d37f0 0x7f85a014f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 --2- 172.21.15.2:0/3592253192 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f85a00d2010 0x7f85a00b5d40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 >> 172.21.15.2:0/3592253192 conn(0x7f85a008cb60 msgr2=0x7f85a006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 shutdown_connections 2023-11-25T04:08:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.172+0000 7f85a81e5640 1 -- 172.21.15.2:0/3592253192 wait complete. 2023-11-25T04:08:46.184 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-11-25T04:08:45.479530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235636,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739084,"statfs":{"total":773094113280,"available":772852822016,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.342362"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082720+0000","last_change":"2023-11-25T04:08:36.163622+0000","last_active":"2023-11-25T04:08:39.082720+0000","last_peered":"2023-11-25T04:08:39.082720+0000","last_clean":"2023-11-25T04:08:39.082720+0000","last_became_active":"2023-11-25T04:08:36.163344+0000","last_became_peered":"2023-11-25T04:08:36.163344+0000","last_unstale":"2023-11-25T04:08:39.082720+0000","last_undegraded":"2023-11-25T04:08:39.082720+0000","last_fullsized":"2023-11-25T04:08:39.082720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:20:43.504787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140999+0000","last_change":"2023-11-25T04:08:36.153711+0000","last_active":"2023-11-25T04:08:37.140999+0000","last_peered":"2023-11-25T04:08:37.140999+0000","last_clean":"2023-11-25T04:08:37.140999+0000","last_became_active":"2023-11-25T04:08:36.153447+0000","last_became_peered":"2023-11-25T04:08:36.153447+0000","last_unstale":"2023-11-25T04:08:37.140999+0000","last_undegraded":"2023-11-25T04:08:37.140999+0000","last_fullsized":"2023-11-25T04:08:37.140999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081247+0000","last_change":"2023-11-25T04:08:36.151108+0000","last_active":"2023-11-25T04:08:39.081247+0000","last_peered":"2023-11-25T04:08:39.081247+0000","last_clean":"2023-11-25T04:08:39.081247+0000","last_became_active":"2023-11-25T04:08:36.150809+0000","last_became_peered":"2023-11-25T04:08:36.150809+0000","last_unstale":"2023-11-25T04:08:39.081247+0000","last_undegraded":"2023-11-25T04:08:39.081247+0000","last_fullsized":"2023-11-25T04:08:39.081247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081708+0000","last_change":"2023-11-25T04:08:36.157420+0000","last_active":"2023-11-25T04:08:39.081708+0000","last_peered":"2023-11-25T04:08:39.081708+0000","last_clean":"2023-11-25T04:08:39.081708+0000","last_became_active":"2023-11-25T04:08:36.157122+0000","last_became_peered":"2023-11-25T04:08:36.157122+0000","last_unstale":"2023-11-25T04:08:39.081708+0000","last_undegraded":"2023-11-25T04:08:39.081708+0000","last_fullsized":"2023-11-25T04:08:39.081708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:56:48.338925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082094+0000","last_change":"2023-11-25T04:08:36.157106+0000","last_active":"2023-11-25T04:08:39.082094+0000","last_peered":"2023-11-25T04:08:39.082094+0000","last_clean":"2023-11-25T04:08:39.082094+0000","last_became_active":"2023-11-25T04:08:36.156764+0000","last_became_peered":"2023-11-25T04:08:36.156764+0000","last_unstale":"2023-11-25T04:08:39.082094+0000","last_undegraded":"2023-11-25T04:08:39.082094+0000","last_fullsized":"2023-11-25T04:08:39.082094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:10:58.141053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082361+0000","last_change":"2023-11-25T04:08:36.156211+0000","last_active":"2023-11-25T04:08:39.082361+0000","last_peered":"2023-11-25T04:08:39.082361+0000","last_clean":"2023-11-25T04:08:39.082361+0000","last_became_active":"2023-11-25T04:08:36.154680+0000","last_became_peered":"2023-11-25T04:08:36.154680+0000","last_unstale":"2023-11-25T04:08:39.082361+0000","last_undegraded":"2023-11-25T04:08:39.082361+0000","last_fullsized":"2023-11-25T04:08:39.082361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:01:26.950408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081381+0000","last_change":"2023-11-25T04:08:36.156525+0000","last_active":"2023-11-25T04:08:39.081381+0000","last_peered":"2023-11-25T04:08:39.081381+0000","last_clean":"2023-11-25T04:08:39.081381+0000","last_became_active":"2023-11-25T04:08:36.156219+0000","last_became_peered":"2023-11-25T04:08:36.156219+0000","last_unstale":"2023-11-25T04:08:39.081381+0000","last_undegraded":"2023-11-25T04:08:39.081381+0000","last_fullsized":"2023-11-25T04:08:39.081381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:50.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139675+0000","last_change":"2023-11-25T04:08:36.155837+0000","last_active":"2023-11-25T04:08:37.139675+0000","last_peered":"2023-11-25T04:08:37.139675+0000","last_clean":"2023-11-25T04:08:37.139675+0000","last_became_active":"2023-11-25T04:08:36.155513+0000","last_became_peered":"2023-11-25T04:08:36.155513+0000","last_unstale":"2023-11-25T04:08:37.139675+0000","last_undegraded":"2023-11-25T04:08:37.139675+0000","last_fullsized":"2023-11-25T04:08:37.139675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082786+0000","last_change":"2023-11-25T04:08:36.162855+0000","last_active":"2023-11-25T04:08:39.082786+0000","last_peered":"2023-11-25T04:08:39.082786+0000","last_clean":"2023-11-25T04:08:39.082786+0000","last_became_active":"2023-11-25T04:08:36.162564+0000","last_became_peered":"2023-11-25T04:08:36.162564+0000","last_unstale":"2023-11-25T04:08:39.082786+0000","last_undegraded":"2023-11-25T04:08:39.082786+0000","last_fullsized":"2023-11-25T04:08:39.082786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:18.611394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081853+0000","last_change":"2023-11-25T04:08:36.163530+0000","last_active":"2023-11-25T04:08:39.081853+0000","last_peered":"2023-11-25T04:08:39.081853+0000","last_clean":"2023-11-25T04:08:39.081853+0000","last_became_active":"2023-11-25T04:08:36.163227+0000","last_became_peered":"2023-11-25T04:08:36.163227+0000","last_unstale":"2023-11-25T04:08:39.081853+0000","last_undegraded":"2023-11-25T04:08:39.081853+0000","last_fullsized":"2023-11-25T04:08:39.081853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081609+0000","last_change":"2023-11-25T04:08:36.163831+0000","last_active":"2023-11-25T04:08:39.081609+0000","last_peered":"2023-11-25T04:08:39.081609+0000","last_clean":"2023-11-25T04:08:39.081609+0000","last_became_active":"2023-11-25T04:08:36.163508+0000","last_became_peered":"2023-11-25T04:08:36.163508+0000","last_unstale":"2023-11-25T04:08:39.081609+0000","last_undegraded":"2023-11-25T04:08:39.081609+0000","last_fullsized":"2023-11-25T04:08:39.081609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141201+0000","last_change":"2023-11-25T04:08:36.158244+0000","last_active":"2023-11-25T04:08:37.141201+0000","last_peered":"2023-11-25T04:08:37.141201+0000","last_clean":"2023-11-25T04:08:37.141201+0000","last_became_active":"2023-11-25T04:08:36.157786+0000","last_became_peered":"2023-11-25T04:08:36.157786+0000","last_unstale":"2023-11-25T04:08:37.141201+0000","last_undegraded":"2023-11-25T04:08:37.141201+0000","last_fullsized":"2023-11-25T04:08:37.141201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139966+0000","last_change":"2023-11-25T04:08:36.156689+0000","last_active":"2023-11-25T04:08:37.139966+0000","last_peered":"2023-11-25T04:08:37.139966+0000","last_clean":"2023-11-25T04:08:37.139966+0000","last_became_active":"2023-11-25T04:08:36.156198+0000","last_became_peered":"2023-11-25T04:08:36.156198+0000","last_unstale":"2023-11-25T04:08:37.139966+0000","last_undegraded":"2023-11-25T04:08:37.139966+0000","last_fullsized":"2023-11-25T04:08:37.139966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081031+0000","last_change":"2023-11-25T04:08:36.154649+0000","last_active":"2023-11-25T04:08:39.081031+0000","last_peered":"2023-11-25T04:08:39.081031+0000","last_clean":"2023-11-25T04:08:39.081031+0000","last_became_active":"2023-11-25T04:08:36.154367+0000","last_became_peered":"2023-11-25T04:08:36.154367+0000","last_unstale":"2023-11-25T04:08:39.081031+0000","last_undegraded":"2023-11-25T04:08:39.081031+0000","last_fullsized":"2023-11-25T04:08:39.081031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:22.951831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140716+0000","last_change":"2023-11-25T04:08:36.154568+0000","last_active":"2023-11-25T04:08:37.140716+0000","last_peered":"2023-11-25T04:08:37.140716+0000","last_clean":"2023-11-25T04:08:37.140716+0000","last_became_active":"2023-11-25T04:08:36.154254+0000","last_became_peered":"2023-11-25T04:08:36.154254+0000","last_unstale":"2023-11-25T04:08:37.140716+0000","last_undegraded":"2023-11-25T04:08:37.140716+0000","last_fullsized":"2023-11-25T04:08:37.140716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081194+0000","last_change":"2023-11-25T04:08:36.156505+0000","last_active":"2023-11-25T04:08:39.081194+0000","last_peered":"2023-11-25T04:08:39.081194+0000","last_clean":"2023-11-25T04:08:39.081194+0000","last_became_active":"2023-11-25T04:08:36.156200+0000","last_became_peered":"2023-11-25T04:08:36.156200+0000","last_unstale":"2023-11-25T04:08:39.081194+0000","last_undegraded":"2023-11-25T04:08:39.081194+0000","last_fullsized":"2023-11-25T04:08:39.081194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082121+0000","last_change":"2023-11-25T04:08:36.154932+0000","last_active":"2023-11-25T04:08:39.082121+0000","last_peered":"2023-11-25T04:08:39.082121+0000","last_clean":"2023-11-25T04:08:39.082121+0000","last_became_active":"2023-11-25T04:08:36.154561+0000","last_became_peered":"2023-11-25T04:08:36.154561+0000","last_unstale":"2023-11-25T04:08:39.082121+0000","last_undegraded":"2023-11-25T04:08:39.082121+0000","last_fullsized":"2023-11-25T04:08:39.082121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:03:24.390936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.980141+0000","last_change":"2023-11-25T04:08:36.157418+0000","last_active":"2023-11-25T04:08:37.980141+0000","last_peered":"2023-11-25T04:08:37.980141+0000","last_clean":"2023-11-25T04:08:37.980141+0000","last_became_active":"2023-11-25T04:08:36.157130+0000","last_became_peered":"2023-11-25T04:08:36.157130+0000","last_unstale":"2023-11-25T04:08:37.980141+0000","last_undegraded":"2023-11-25T04:08:37.980141+0000","last_fullsized":"2023-11-25T04:08:37.980141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:51.273788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082191+0000","last_change":"2023-11-25T04:08:36.157854+0000","last_active":"2023-11-25T04:08:39.082191+0000","last_peered":"2023-11-25T04:08:39.082191+0000","last_clean":"2023-11-25T04:08:39.082191+0000","last_became_active":"2023-11-25T04:08:36.156836+0000","last_became_peered":"2023-11-25T04:08:36.156836+0000","last_unstale":"2023-11-25T04:08:39.082191+0000","last_undegraded":"2023-11-25T04:08:39.082191+0000","last_fullsized":"2023-11-25T04:08:39.082191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:03:24.390936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081576+0000","last_change":"2023-11-25T04:08:36.155924+0000","last_active":"2023-11-25T04:08:39.081576+0000","last_peered":"2023-11-25T04:08:39.081576+0000","last_clean":"2023-11-25T04:08:39.081576+0000","last_became_active":"2023-11-25T04:08:36.155624+0000","last_became_peered":"2023-11-25T04:08:36.155624+0000","last_unstale":"2023-11-25T04:08:39.081576+0000","last_undegraded":"2023-11-25T04:08:39.081576+0000","last_fullsized":"2023-11-25T04:08:39.081576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081224+0000","last_change":"2023-11-25T04:08:36.153091+0000","last_active":"2023-11-25T04:08:39.081224+0000","last_peered":"2023-11-25T04:08:39.081224+0000","last_clean":"2023-11-25T04:08:39.081224+0000","last_became_active":"2023-11-25T04:08:36.152775+0000","last_became_peered":"2023-11-25T04:08:36.152775+0000","last_unstale":"2023-11-25T04:08:39.081224+0000","last_undegraded":"2023-11-25T04:08:39.081224+0000","last_fullsized":"2023-11-25T04:08:39.081224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082510+0000","last_change":"2023-11-25T04:08:36.156488+0000","last_active":"2023-11-25T04:08:39.082510+0000","last_peered":"2023-11-25T04:08:39.082510+0000","last_clean":"2023-11-25T04:08:39.082510+0000","last_became_active":"2023-11-25T04:08:36.156156+0000","last_became_peered":"2023-11-25T04:08:36.156156+0000","last_unstale":"2023-11-25T04:08:39.082510+0000","last_undegraded":"2023-11-25T04:08:39.082510+0000","last_fullsized":"2023-11-25T04:08:39.082510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:20:43.504787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139732+0000","last_change":"2023-11-25T04:08:36.153601+0000","last_active":"2023-11-25T04:08:37.139732+0000","last_peered":"2023-11-25T04:08:37.139732+0000","last_clean":"2023-11-25T04:08:37.139732+0000","last_became_active":"2023-11-25T04:08:36.153299+0000","last_became_peered":"2023-11-25T04:08:36.153299+0000","last_unstale":"2023-11-25T04:08:37.139732+0000","last_undegraded":"2023-11-25T04:08:37.139732+0000","last_fullsized":"2023-11-25T04:08:37.139732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:50.364386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081352+0000","last_change":"2023-11-25T04:08:36.152977+0000","last_active":"2023-11-25T04:08:39.081352+0000","last_peered":"2023-11-25T04:08:39.081352+0000","last_clean":"2023-11-25T04:08:39.081352+0000","last_became_active":"2023-11-25T04:08:36.152565+0000","last_became_peered":"2023-11-25T04:08:36.152565+0000","last_unstale":"2023-11-25T04:08:39.081352+0000","last_undegraded":"2023-11-25T04:08:39.081352+0000","last_fullsized":"2023-11-25T04:08:39.081352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:50.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140274+0000","last_change":"2023-11-25T04:08:36.151764+0000","last_active":"2023-11-25T04:08:37.140274+0000","last_peered":"2023-11-25T04:08:37.140274+0000","last_clean":"2023-11-25T04:08:37.140274+0000","last_became_active":"2023-11-25T04:08:36.150463+0000","last_became_peered":"2023-11-25T04:08:36.150463+0000","last_unstale":"2023-11-25T04:08:37.140274+0000","last_undegraded":"2023-11-25T04:08:37.140274+0000","last_fullsized":"2023-11-25T04:08:37.140274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:59:01.113946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081943+0000","last_change":"2023-11-25T04:08:36.162948+0000","last_active":"2023-11-25T04:08:39.081943+0000","last_peered":"2023-11-25T04:08:39.081943+0000","last_clean":"2023-11-25T04:08:39.081943+0000","last_became_active":"2023-11-25T04:08:36.162672+0000","last_became_peered":"2023-11-25T04:08:36.162672+0000","last_unstale":"2023-11-25T04:08:39.081943+0000","last_undegraded":"2023-11-25T04:08:39.081943+0000","last_fullsized":"2023-11-25T04:08:39.081943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140927+0000","last_change":"2023-11-25T04:08:36.159466+0000","last_active":"2023-11-25T04:08:37.140927+0000","last_peered":"2023-11-25T04:08:37.140927+0000","last_clean":"2023-11-25T04:08:37.140927+0000","last_became_active":"2023-11-25T04:08:36.159177+0000","last_became_peered":"2023-11-25T04:08:36.159177+0000","last_unstale":"2023-11-25T04:08:37.140927+0000","last_undegraded":"2023-11-25T04:08:37.140927+0000","last_fullsized":"2023-11-25T04:08:37.140927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140078+0000","last_change":"2023-11-25T04:08:36.153899+0000","last_active":"2023-11-25T04:08:37.140078+0000","last_peered":"2023-11-25T04:08:37.140078+0000","last_clean":"2023-11-25T04:08:37.140078+0000","last_became_active":"2023-11-25T04:08:36.152798+0000","last_became_peered":"2023-11-25T04:08:36.152798+0000","last_unstale":"2023-11-25T04:08:37.140078+0000","last_undegraded":"2023-11-25T04:08:37.140078+0000","last_fullsized":"2023-11-25T04:08:37.140078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081428+0000","last_change":"2023-11-25T04:08:36.145773+0000","last_active":"2023-11-25T04:08:39.081428+0000","last_peered":"2023-11-25T04:08:39.081428+0000","last_clean":"2023-11-25T04:08:39.081428+0000","last_became_active":"2023-11-25T04:08:36.144733+0000","last_became_peered":"2023-11-25T04:08:36.144733+0000","last_unstale":"2023-11-25T04:08:39.081428+0000","last_undegraded":"2023-11-25T04:08:39.081428+0000","last_fullsized":"2023-11-25T04:08:39.081428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082662+0000","last_change":"2023-11-25T04:08:36.154902+0000","last_active":"2023-11-25T04:08:39.082662+0000","last_peered":"2023-11-25T04:08:39.082662+0000","last_clean":"2023-11-25T04:08:39.082662+0000","last_became_active":"2023-11-25T04:08:36.154382+0000","last_became_peered":"2023-11-25T04:08:36.154382+0000","last_unstale":"2023-11-25T04:08:39.082662+0000","last_undegraded":"2023-11-25T04:08:39.082662+0000","last_fullsized":"2023-11-25T04:08:39.082662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:13:50.582370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.980118+0000","last_change":"2023-11-25T04:08:36.157895+0000","last_active":"2023-11-25T04:08:37.980118+0000","last_peered":"2023-11-25T04:08:37.980118+0000","last_clean":"2023-11-25T04:08:37.980118+0000","last_became_active":"2023-11-25T04:08:36.157530+0000","last_became_peered":"2023-11-25T04:08:36.157530+0000","last_unstale":"2023-11-25T04:08:37.980118+0000","last_undegraded":"2023-11-25T04:08:37.980118+0000","last_fullsized":"2023-11-25T04:08:37.980118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082180+0000","last_change":"2023-11-25T04:08:36.158558+0000","last_active":"2023-11-25T04:08:39.082180+0000","last_peered":"2023-11-25T04:08:39.082180+0000","last_clean":"2023-11-25T04:08:39.082180+0000","last_became_active":"2023-11-25T04:08:36.158280+0000","last_became_peered":"2023-11-25T04:08:36.158280+0000","last_unstale":"2023-11-25T04:08:39.082180+0000","last_undegraded":"2023-11-25T04:08:39.082180+0000","last_fullsized":"2023-11-25T04:08:39.082180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141133+0000","last_change":"2023-11-25T04:08:36.155419+0000","last_active":"2023-11-25T04:08:37.141133+0000","last_peered":"2023-11-25T04:08:37.141133+0000","last_clean":"2023-11-25T04:08:37.141133+0000","last_became_active":"2023-11-25T04:08:36.155113+0000","last_became_peered":"2023-11-25T04:08:36.155113+0000","last_unstale":"2023-11-25T04:08:37.141133+0000","last_undegraded":"2023-11-25T04:08:37.141133+0000","last_fullsized":"2023-11-25T04:08:37.141133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:06.500587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140200+0000","last_change":"2023-11-25T04:08:35.170018+0000","last_active":"2023-11-25T04:08:37.140200+0000","last_peered":"2023-11-25T04:08:37.140200+0000","last_clean":"2023-11-25T04:08:37.140200+0000","last_became_active":"2023-11-25T04:08:35.169712+0000","last_became_peered":"2023-11-25T04:08:35.169712+0000","last_unstale":"2023-11-25T04:08:37.140200+0000","last_undegraded":"2023-11-25T04:08:37.140200+0000","last_fullsized":"2023-11-25T04:08:37.140200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:21.947721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081440+0000","last_change":"2023-11-25T04:08:36.149119+0000","last_active":"2023-11-25T04:08:39.081440+0000","last_peered":"2023-11-25T04:08:39.081440+0000","last_clean":"2023-11-25T04:08:39.081440+0000","last_became_active":"2023-11-25T04:08:36.148656+0000","last_became_peered":"2023-11-25T04:08:36.148656+0000","last_unstale":"2023-11-25T04:08:39.081440+0000","last_undegraded":"2023-11-25T04:08:39.081440+0000","last_fullsized":"2023-11-25T04:08:39.081440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494575+0000","last_change":"2023-11-25T04:08:35.169640+0000","last_active":"2023-11-25T04:08:37.494575+0000","last_peered":"2023-11-25T04:08:37.494575+0000","last_clean":"2023-11-25T04:08:37.494575+0000","last_became_active":"2023-11-25T04:08:35.169229+0000","last_became_peered":"2023-11-25T04:08:35.169229+0000","last_unstale":"2023-11-25T04:08:37.494575+0000","last_undegraded":"2023-11-25T04:08:37.494575+0000","last_fullsized":"2023-11-25T04:08:37.494575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139797+0000","last_change":"2023-11-25T04:08:35.165325+0000","last_active":"2023-11-25T04:08:37.139797+0000","last_peered":"2023-11-25T04:08:37.139797+0000","last_clean":"2023-11-25T04:08:37.139797+0000","last_became_active":"2023-11-25T04:08:35.164962+0000","last_became_peered":"2023-11-25T04:08:35.164962+0000","last_unstale":"2023-11-25T04:08:37.139797+0000","last_undegraded":"2023-11-25T04:08:37.139797+0000","last_fullsized":"2023-11-25T04:08:37.139797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139742+0000","last_change":"2023-11-25T04:08:36.146000+0000","last_active":"2023-11-25T04:08:37.139742+0000","last_peered":"2023-11-25T04:08:37.139742+0000","last_clean":"2023-11-25T04:08:37.139742+0000","last_became_active":"2023-11-25T04:08:36.145662+0000","last_became_peered":"2023-11-25T04:08:36.145662+0000","last_unstale":"2023-11-25T04:08:37.139742+0000","last_undegraded":"2023-11-25T04:08:37.139742+0000","last_fullsized":"2023-11-25T04:08:37.139742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495693+0000","last_change":"2023-11-25T04:08:35.164501+0000","last_active":"2023-11-25T04:08:37.495693+0000","last_peered":"2023-11-25T04:08:37.495693+0000","last_clean":"2023-11-25T04:08:37.495693+0000","last_became_active":"2023-11-25T04:08:35.164008+0000","last_became_peered":"2023-11-25T04:08:35.164008+0000","last_unstale":"2023-11-25T04:08:37.495693+0000","last_undegraded":"2023-11-25T04:08:37.495693+0000","last_fullsized":"2023-11-25T04:08:37.495693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:49.360276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140664+0000","last_change":"2023-11-25T04:08:36.157653+0000","last_active":"2023-11-25T04:08:37.140664+0000","last_peered":"2023-11-25T04:08:37.140664+0000","last_clean":"2023-11-25T04:08:37.140664+0000","last_became_active":"2023-11-25T04:08:36.157323+0000","last_became_peered":"2023-11-25T04:08:36.157323+0000","last_unstale":"2023-11-25T04:08:37.140664+0000","last_undegraded":"2023-11-25T04:08:37.140664+0000","last_fullsized":"2023-11-25T04:08:37.140664+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494708+0000","last_change":"2023-11-25T04:08:35.166516+0000","last_active":"2023-11-25T04:08:37.494708+0000","last_peered":"2023-11-25T04:08:37.494708+0000","last_clean":"2023-11-25T04:08:37.494708+0000","last_became_active":"2023-11-25T04:08:35.166204+0000","last_became_peered":"2023-11-25T04:08:35.166204+0000","last_unstale":"2023-11-25T04:08:37.494708+0000","last_undegraded":"2023-11-25T04:08:37.494708+0000","last_fullsized":"2023-11-25T04:08:37.494708+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081546+0000","last_change":"2023-11-25T04:08:36.157253+0000","last_active":"2023-11-25T04:08:39.081546+0000","last_peered":"2023-11-25T04:08:39.081546+0000","last_clean":"2023-11-25T04:08:39.081546+0000","last_became_active":"2023-11-25T04:08:36.156799+0000","last_became_peered":"2023-11-25T04:08:36.156799+0000","last_unstale":"2023-11-25T04:08:39.081546+0000","last_undegraded":"2023-11-25T04:08:39.081546+0000","last_fullsized":"2023-11-25T04:08:39.081546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:34:53.382347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495845+0000","last_change":"2023-11-25T04:08:35.165700+0000","last_active":"2023-11-25T04:08:37.495845+0000","last_peered":"2023-11-25T04:08:37.495845+0000","last_clean":"2023-11-25T04:08:37.495845+0000","last_became_active":"2023-11-25T04:08:35.165341+0000","last_became_peered":"2023-11-25T04:08:35.165341+0000","last_unstale":"2023-11-25T04:08:37.495845+0000","last_undegraded":"2023-11-25T04:08:37.495845+0000","last_fullsized":"2023-11-25T04:08:37.495845+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:58.609810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081389+0000","last_change":"2023-11-25T04:08:36.158411+0000","last_active":"2023-11-25T04:08:39.081389+0000","last_peered":"2023-11-25T04:08:39.081389+0000","last_clean":"2023-11-25T04:08:39.081389+0000","last_became_active":"2023-11-25T04:08:36.156523+0000","last_became_peered":"2023-11-25T04:08:36.156523+0000","last_unstale":"2023-11-25T04:08:39.081389+0000","last_undegraded":"2023-11-25T04:08:39.081389+0000","last_fullsized":"2023-11-25T04:08:39.081389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:16.501735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140940+0000","last_change":"2023-11-25T04:08:35.167699+0000","last_active":"2023-11-25T04:08:37.140940+0000","last_peered":"2023-11-25T04:08:37.140940+0000","last_clean":"2023-11-25T04:08:37.140940+0000","last_became_active":"2023-11-25T04:08:35.167457+0000","last_became_peered":"2023-11-25T04:08:35.167457+0000","last_unstale":"2023-11-25T04:08:37.140940+0000","last_undegraded":"2023-11-25T04:08:37.140940+0000","last_fullsized":"2023-11-25T04:08:37.140940+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:22.460231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141339+0000","last_change":"2023-11-25T04:08:36.149678+0000","last_active":"2023-11-25T04:08:37.141339+0000","last_peered":"2023-11-25T04:08:37.141339+0000","last_clean":"2023-11-25T04:08:37.141339+0000","last_became_active":"2023-11-25T04:08:36.149356+0000","last_became_peered":"2023-11-25T04:08:36.149356+0000","last_unstale":"2023-11-25T04:08:37.141339+0000","last_undegraded":"2023-11-25T04:08:37.141339+0000","last_fullsized":"2023-11-25T04:08:37.141339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:44:50.306013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494625+0000","last_change":"2023-11-25T04:08:35.164920+0000","last_active":"2023-11-25T04:08:37.494625+0000","last_peered":"2023-11-25T04:08:37.494625+0000","last_clean":"2023-11-25T04:08:37.494625+0000","last_became_active":"2023-11-25T04:08:35.164319+0000","last_became_peered":"2023-11-25T04:08:35.164319+0000","last_unstale":"2023-11-25T04:08:37.494625+0000","last_undegraded":"2023-11-25T04:08:37.494625+0000","last_fullsized":"2023-11-25T04:08:37.494625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:50.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081774+0000","last_change":"2023-11-25T04:08:36.158479+0000","last_active":"2023-11-25T04:08:39.081774+0000","last_peered":"2023-11-25T04:08:39.081774+0000","last_clean":"2023-11-25T04:08:39.081774+0000","last_became_active":"2023-11-25T04:08:36.158222+0000","last_became_peered":"2023-11-25T04:08:36.158222+0000","last_unstale":"2023-11-25T04:08:39.081774+0000","last_undegraded":"2023-11-25T04:08:39.081774+0000","last_fullsized":"2023-11-25T04:08:39.081774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:56:48.338925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494482+0000","last_change":"2023-11-25T04:08:35.175417+0000","last_active":"2023-11-25T04:08:37.494482+0000","last_peered":"2023-11-25T04:08:37.494482+0000","last_clean":"2023-11-25T04:08:37.494482+0000","last_became_active":"2023-11-25T04:08:35.175050+0000","last_became_peered":"2023-11-25T04:08:35.175050+0000","last_unstale":"2023-11-25T04:08:37.494482+0000","last_undegraded":"2023-11-25T04:08:37.494482+0000","last_fullsized":"2023-11-25T04:08:37.494482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081052+0000","last_change":"2023-11-25T04:08:36.155250+0000","last_active":"2023-11-25T04:08:39.081052+0000","last_peered":"2023-11-25T04:08:39.081052+0000","last_clean":"2023-11-25T04:08:39.081052+0000","last_became_active":"2023-11-25T04:08:36.154944+0000","last_became_peered":"2023-11-25T04:08:36.154944+0000","last_unstale":"2023-11-25T04:08:39.081052+0000","last_undegraded":"2023-11-25T04:08:39.081052+0000","last_fullsized":"2023-11-25T04:08:39.081052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:23.464341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495746+0000","last_change":"2023-11-25T04:08:35.162897+0000","last_active":"2023-11-25T04:08:37.495746+0000","last_peered":"2023-11-25T04:08:37.495746+0000","last_clean":"2023-11-25T04:08:37.495746+0000","last_became_active":"2023-11-25T04:08:35.162684+0000","last_became_peered":"2023-11-25T04:08:35.162684+0000","last_unstale":"2023-11-25T04:08:37.495746+0000","last_undegraded":"2023-11-25T04:08:37.495746+0000","last_fullsized":"2023-11-25T04:08:37.495746+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:07.785129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082246+0000","last_change":"2023-11-25T04:08:36.153204+0000","last_active":"2023-11-25T04:08:39.082246+0000","last_peered":"2023-11-25T04:08:39.082246+0000","last_clean":"2023-11-25T04:08:39.082246+0000","last_became_active":"2023-11-25T04:08:36.152856+0000","last_became_peered":"2023-11-25T04:08:36.152856+0000","last_unstale":"2023-11-25T04:08:39.082246+0000","last_undegraded":"2023-11-25T04:08:39.082246+0000","last_fullsized":"2023-11-25T04:08:39.082246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:01:26.950408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494527+0000","last_change":"2023-11-25T04:08:35.170232+0000","last_active":"2023-11-25T04:08:37.494527+0000","last_peered":"2023-11-25T04:08:37.494527+0000","last_clean":"2023-11-25T04:08:37.494527+0000","last_became_active":"2023-11-25T04:08:35.168959+0000","last_became_peered":"2023-11-25T04:08:35.168959+0000","last_unstale":"2023-11-25T04:08:37.494527+0000","last_undegraded":"2023-11-25T04:08:37.494527+0000","last_fullsized":"2023-11-25T04:08:37.494527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:25.799051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082327+0000","last_change":"2023-11-25T04:08:36.159133+0000","last_active":"2023-11-25T04:08:39.082327+0000","last_peered":"2023-11-25T04:08:39.082327+0000","last_clean":"2023-11-25T04:08:39.082327+0000","last_became_active":"2023-11-25T04:08:36.158832+0000","last_became_peered":"2023-11-25T04:08:36.158832+0000","last_unstale":"2023-11-25T04:08:39.082327+0000","last_undegraded":"2023-11-25T04:08:39.082327+0000","last_fullsized":"2023-11-25T04:08:39.082327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.498652+0000","last_change":"2023-11-25T04:08:35.158168+0000","last_active":"2023-11-25T04:08:37.498652+0000","last_peered":"2023-11-25T04:08:37.498652+0000","last_clean":"2023-11-25T04:08:37.498652+0000","last_became_active":"2023-11-25T04:08:35.157857+0000","last_became_peered":"2023-11-25T04:08:35.157857+0000","last_unstale":"2023-11-25T04:08:37.498652+0000","last_undegraded":"2023-11-25T04:08:37.498652+0000","last_fullsized":"2023-11-25T04:08:37.498652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:16.648041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081536+0000","last_change":"2023-11-25T04:08:36.153946+0000","last_active":"2023-11-25T04:08:39.081536+0000","last_peered":"2023-11-25T04:08:39.081536+0000","last_clean":"2023-11-25T04:08:39.081536+0000","last_became_active":"2023-11-25T04:08:36.153643+0000","last_became_peered":"2023-11-25T04:08:36.153643+0000","last_unstale":"2023-11-25T04:08:39.081536+0000","last_undegraded":"2023-11-25T04:08:39.081536+0000","last_fullsized":"2023-11-25T04:08:39.081536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:34:53.382347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141439+0000","last_change":"2023-11-25T04:08:35.168907+0000","last_active":"2023-11-25T04:08:37.141439+0000","last_peered":"2023-11-25T04:08:37.141439+0000","last_clean":"2023-11-25T04:08:37.141439+0000","last_became_active":"2023-11-25T04:08:35.168515+0000","last_became_peered":"2023-11-25T04:08:35.168515+0000","last_unstale":"2023-11-25T04:08:37.141439+0000","last_undegraded":"2023-11-25T04:08:37.141439+0000","last_fullsized":"2023-11-25T04:08:37.141439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T16:07:16.648041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082398+0000","last_change":"2023-11-25T04:08:36.159282+0000","last_active":"2023-11-25T04:08:39.082398+0000","last_peered":"2023-11-25T04:08:39.082398+0000","last_clean":"2023-11-25T04:08:39.082398+0000","last_became_active":"2023-11-25T04:08:36.159008+0000","last_became_peered":"2023-11-25T04:08:36.159008+0000","last_unstale":"2023-11-25T04:08:39.082398+0000","last_undegraded":"2023-11-25T04:08:39.082398+0000","last_fullsized":"2023-11-25T04:08:39.082398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:15:08.072394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.498705+0000","last_change":"2023-11-25T04:08:35.161420+0000","last_active":"2023-11-25T04:08:37.498705+0000","last_peered":"2023-11-25T04:08:37.498705+0000","last_clean":"2023-11-25T04:08:37.498705+0000","last_became_active":"2023-11-25T04:08:35.161085+0000","last_became_peered":"2023-11-25T04:08:35.161085+0000","last_unstale":"2023-11-25T04:08:37.498705+0000","last_undegraded":"2023-11-25T04:08:37.498705+0000","last_fullsized":"2023-11-25T04:08:37.498705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:37.314044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082853+0000","last_change":"2023-11-25T04:08:36.160108+0000","last_active":"2023-11-25T04:08:39.082853+0000","last_peered":"2023-11-25T04:08:39.082853+0000","last_clean":"2023-11-25T04:08:39.082853+0000","last_became_active":"2023-11-25T04:08:36.159833+0000","last_became_peered":"2023-11-25T04:08:36.159833+0000","last_unstale":"2023-11-25T04:08:39.082853+0000","last_undegraded":"2023-11-25T04:08:39.082853+0000","last_fullsized":"2023-11-25T04:08:39.082853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:13:50.582370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141018+0000","last_change":"2023-11-25T04:08:35.166785+0000","last_active":"2023-11-25T04:08:37.141018+0000","last_peered":"2023-11-25T04:08:37.141018+0000","last_clean":"2023-11-25T04:08:37.141018+0000","last_became_active":"2023-11-25T04:08:35.166502+0000","last_became_peered":"2023-11-25T04:08:35.166502+0000","last_unstale":"2023-11-25T04:08:37.141018+0000","last_undegraded":"2023-11-25T04:08:37.141018+0000","last_fullsized":"2023-11-25T04:08:37.141018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:57.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081993+0000","last_change":"2023-11-25T04:08:36.154284+0000","last_active":"2023-11-25T04:08:39.081993+0000","last_peered":"2023-11-25T04:08:39.081993+0000","last_clean":"2023-11-25T04:08:39.081993+0000","last_became_active":"2023-11-25T04:08:36.152651+0000","last_became_peered":"2023-11-25T04:08:36.152651+0000","last_unstale":"2023-11-25T04:08:39.081993+0000","last_undegraded":"2023-11-25T04:08:39.081993+0000","last_fullsized":"2023-11-25T04:08:39.081993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:10:58.141053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.498688+0000","last_change":"2023-11-25T04:08:35.164026+0000","last_active":"2023-11-25T04:08:37.498688+0000","last_peered":"2023-11-25T04:08:37.498688+0000","last_clean":"2023-11-25T04:08:37.498688+0000","last_became_active":"2023-11-25T04:08:35.163726+0000","last_became_peered":"2023-11-25T04:08:35.163726+0000","last_unstale":"2023-11-25T04:08:37.498688+0000","last_undegraded":"2023-11-25T04:08:37.498688+0000","last_fullsized":"2023-11-25T04:08:37.498688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:02:25.799051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081940+0000","last_change":"2023-11-25T04:08:36.162872+0000","last_active":"2023-11-25T04:08:39.081940+0000","last_peered":"2023-11-25T04:08:39.081940+0000","last_clean":"2023-11-25T04:08:39.081940+0000","last_became_active":"2023-11-25T04:08:36.162603+0000","last_became_peered":"2023-11-25T04:08:36.162603+0000","last_unstale":"2023-11-25T04:08:39.081940+0000","last_undegraded":"2023-11-25T04:08:39.081940+0000","last_fullsized":"2023-11-25T04:08:39.081940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:09:24.146017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:36.145255+0000","last_change":"2023-11-25T04:08:24.570240+0000","last_active":"2023-11-25T04:08:36.145255+0000","last_peered":"2023-11-25T04:08:36.145255+0000","last_clean":"2023-11-25T04:08:36.145255+0000","last_became_active":"2023-11-25T04:08:24.569371+0000","last_became_peered":"2023-11-25T04:08:24.569371+0000","last_unstale":"2023-11-25T04:08:36.145255+0000","last_undegraded":"2023-11-25T04:08:36.145255+0000","last_fullsized":"2023-11-25T04:08:36.145255+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_clean_scrub_stamp":"2023-11-25T04:08:23.534401+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:28.293127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495768+0000","last_change":"2023-11-25T04:08:35.151872+0000","last_active":"2023-11-25T04:08:37.495768+0000","last_peered":"2023-11-25T04:08:37.495768+0000","last_clean":"2023-11-25T04:08:37.495768+0000","last_became_active":"2023-11-25T04:08:35.151557+0000","last_became_peered":"2023-11-25T04:08:35.151557+0000","last_unstale":"2023-11-25T04:08:37.495768+0000","last_undegraded":"2023-11-25T04:08:37.495768+0000","last_fullsized":"2023-11-25T04:08:37.495768+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.139961+0000","last_change":"2023-11-25T04:08:36.159174+0000","last_active":"2023-11-25T04:08:37.139961+0000","last_peered":"2023-11-25T04:08:37.139961+0000","last_clean":"2023-11-25T04:08:37.139961+0000","last_became_active":"2023-11-25T04:08:36.158893+0000","last_became_peered":"2023-11-25T04:08:36.158893+0000","last_unstale":"2023-11-25T04:08:37.139961+0000","last_undegraded":"2023-11-25T04:08:37.139961+0000","last_fullsized":"2023-11-25T04:08:37.139961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499145+0000","last_change":"2023-11-25T04:08:35.166896+0000","last_active":"2023-11-25T04:08:37.499145+0000","last_peered":"2023-11-25T04:08:37.499145+0000","last_clean":"2023-11-25T04:08:37.499145+0000","last_became_active":"2023-11-25T04:08:35.166601+0000","last_became_peered":"2023-11-25T04:08:35.166601+0000","last_unstale":"2023-11-25T04:08:37.499145+0000","last_undegraded":"2023-11-25T04:08:37.499145+0000","last_fullsized":"2023-11-25T04:08:37.499145+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:05.496477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.080948+0000","last_change":"2023-11-25T04:08:36.147229+0000","last_active":"2023-11-25T04:08:39.080948+0000","last_peered":"2023-11-25T04:08:39.080948+0000","last_clean":"2023-11-25T04:08:39.080948+0000","last_became_active":"2023-11-25T04:08:36.146889+0000","last_became_peered":"2023-11-25T04:08:36.146889+0000","last_unstale":"2023-11-25T04:08:39.080948+0000","last_undegraded":"2023-11-25T04:08:39.080948+0000","last_fullsized":"2023-11-25T04:08:39.080948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:39.596607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.498679+0000","last_change":"2023-11-25T04:08:35.162405+0000","last_active":"2023-11-25T04:08:37.498679+0000","last_peered":"2023-11-25T04:08:37.498679+0000","last_clean":"2023-11-25T04:08:37.498679+0000","last_became_active":"2023-11-25T04:08:35.162084+0000","last_became_peered":"2023-11-25T04:08:35.162084+0000","last_unstale":"2023-11-25T04:08:37.498679+0000","last_undegraded":"2023-11-25T04:08:37.498679+0000","last_fullsized":"2023-11-25T04:08:37.498679+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:12:56.628323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140649+0000","last_change":"2023-11-25T04:08:36.152006+0000","last_active":"2023-11-25T04:08:37.140649+0000","last_peered":"2023-11-25T04:08:37.140649+0000","last_clean":"2023-11-25T04:08:37.140649+0000","last_became_active":"2023-11-25T04:08:36.151655+0000","last_became_peered":"2023-11-25T04:08:36.151655+0000","last_unstale":"2023-11-25T04:08:37.140649+0000","last_undegraded":"2023-11-25T04:08:37.140649+0000","last_fullsized":"2023-11-25T04:08:37.140649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.495757+0000","last_change":"2023-11-25T04:08:35.162315+0000","last_active":"2023-11-25T04:08:37.495757+0000","last_peered":"2023-11-25T04:08:37.495757+0000","last_clean":"2023-11-25T04:08:37.495757+0000","last_became_active":"2023-11-25T04:08:35.162052+0000","last_became_peered":"2023-11-25T04:08:35.162052+0000","last_unstale":"2023-11-25T04:08:37.495757+0000","last_undegraded":"2023-11-25T04:08:37.495757+0000","last_fullsized":"2023-11-25T04:08:37.495757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:53.354503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141360+0000","last_change":"2023-11-25T04:08:36.158785+0000","last_active":"2023-11-25T04:08:37.141360+0000","last_peered":"2023-11-25T04:08:37.141360+0000","last_clean":"2023-11-25T04:08:37.141360+0000","last_became_active":"2023-11-25T04:08:36.155440+0000","last_became_peered":"2023-11-25T04:08:36.155440+0000","last_unstale":"2023-11-25T04:08:37.141360+0000","last_undegraded":"2023-11-25T04:08:37.141360+0000","last_fullsized":"2023-11-25T04:08:37.141360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:03.560567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140844+0000","last_change":"2023-11-25T04:08:35.168321+0000","last_active":"2023-11-25T04:08:37.140844+0000","last_peered":"2023-11-25T04:08:37.140844+0000","last_clean":"2023-11-25T04:08:37.140844+0000","last_became_active":"2023-11-25T04:08:35.168047+0000","last_became_peered":"2023-11-25T04:08:35.168047+0000","last_unstale":"2023-11-25T04:08:37.140844+0000","last_undegraded":"2023-11-25T04:08:37.140844+0000","last_fullsized":"2023-11-25T04:08:37.140844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:27:49.360276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082583+0000","last_change":"2023-11-25T04:08:36.157577+0000","last_active":"2023-11-25T04:08:39.082583+0000","last_peered":"2023-11-25T04:08:39.082583+0000","last_clean":"2023-11-25T04:08:39.082583+0000","last_became_active":"2023-11-25T04:08:36.157302+0000","last_became_peered":"2023-11-25T04:08:36.157302+0000","last_unstale":"2023-11-25T04:08:39.082583+0000","last_undegraded":"2023-11-25T04:08:39.082583+0000","last_fullsized":"2023-11-25T04:08:39.082583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:55:18.611394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499307+0000","last_change":"2023-11-25T04:08:35.171642+0000","last_active":"2023-11-25T04:08:37.499307+0000","last_peered":"2023-11-25T04:08:37.499307+0000","last_clean":"2023-11-25T04:08:37.499307+0000","last_became_active":"2023-11-25T04:08:35.171169+0000","last_became_peered":"2023-11-25T04:08:35.171169+0000","last_unstale":"2023-11-25T04:08:37.499307+0000","last_undegraded":"2023-11-25T04:08:37.499307+0000","last_fullsized":"2023-11-25T04:08:37.499307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:57.805432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140868+0000","last_change":"2023-11-25T04:08:36.155558+0000","last_active":"2023-11-25T04:08:37.140868+0000","last_peered":"2023-11-25T04:08:37.140868+0000","last_clean":"2023-11-25T04:08:37.140868+0000","last_became_active":"2023-11-25T04:08:36.155280+0000","last_became_peered":"2023-11-25T04:08:36.155280+0000","last_unstale":"2023-11-25T04:08:37.140868+0000","last_undegraded":"2023-11-25T04:08:37.140868+0000","last_fullsized":"2023-11-25T04:08:37.140868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:06:08.789238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.503059+0000","last_change":"2023-11-25T04:08:35.164983+0000","last_active":"2023-11-25T04:08:37.503059+0000","last_peered":"2023-11-25T04:08:37.503059+0000","last_clean":"2023-11-25T04:08:37.503059+0000","last_became_active":"2023-11-25T04:08:35.164714+0000","last_became_peered":"2023-11-25T04:08:35.164714+0000","last_unstale":"2023-11-25T04:08:37.503059+0000","last_undegraded":"2023-11-25T04:08:37.503059+0000","last_fullsized":"2023-11-25T04:08:37.503059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:58.609810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140402+0000","last_change":"2023-11-25T04:08:36.155740+0000","last_active":"2023-11-25T04:08:37.140402+0000","last_peered":"2023-11-25T04:08:37.140402+0000","last_clean":"2023-11-25T04:08:37.140402+0000","last_became_active":"2023-11-25T04:08:36.155416+0000","last_became_peered":"2023-11-25T04:08:36.155416+0000","last_unstale":"2023-11-25T04:08:37.140402+0000","last_undegraded":"2023-11-25T04:08:37.140402+0000","last_fullsized":"2023-11-25T04:08:37.140402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:34:53.382347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494721+0000","last_change":"2023-11-25T04:08:35.164671+0000","last_active":"2023-11-25T04:08:37.494721+0000","last_peered":"2023-11-25T04:08:37.494721+0000","last_clean":"2023-11-25T04:08:37.494721+0000","last_became_active":"2023-11-25T04:08:35.164303+0000","last_became_peered":"2023-11-25T04:08:35.164303+0000","last_unstale":"2023-11-25T04:08:37.494721+0000","last_undegraded":"2023-11-25T04:08:37.494721+0000","last_fullsized":"2023-11-25T04:08:37.494721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:54:21.947721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081397+0000","last_change":"2023-11-25T04:08:36.152277+0000","last_active":"2023-11-25T04:08:39.081397+0000","last_peered":"2023-11-25T04:08:39.081397+0000","last_clean":"2023-11-25T04:08:39.081397+0000","last_became_active":"2023-11-25T04:08:36.151952+0000","last_became_peered":"2023-11-25T04:08:36.151952+0000","last_unstale":"2023-11-25T04:08:39.081397+0000","last_undegraded":"2023-11-25T04:08:39.081397+0000","last_fullsized":"2023-11-25T04:08:39.081397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:50:41.582246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499129+0000","last_change":"2023-11-25T04:08:35.169634+0000","last_active":"2023-11-25T04:08:37.499129+0000","last_peered":"2023-11-25T04:08:37.499129+0000","last_clean":"2023-11-25T04:08:37.499129+0000","last_became_active":"2023-11-25T04:08:35.169006+0000","last_became_peered":"2023-11-25T04:08:35.169006+0000","last_unstale":"2023-11-25T04:08:37.499129+0000","last_undegraded":"2023-11-25T04:08:37.499129+0000","last_fullsized":"2023-11-25T04:08:37.499129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:37.314044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.141007+0000","last_change":"2023-11-25T04:08:36.152671+0000","last_active":"2023-11-25T04:08:37.141007+0000","last_peered":"2023-11-25T04:08:37.141007+0000","last_clean":"2023-11-25T04:08:37.141007+0000","last_became_active":"2023-11-25T04:08:36.152379+0000","last_became_peered":"2023-11-25T04:08:36.152379+0000","last_unstale":"2023-11-25T04:08:37.141007+0000","last_undegraded":"2023-11-25T04:08:37.141007+0000","last_fullsized":"2023-11-25T04:08:37.141007+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:40:38.318153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140747+0000","last_change":"2023-11-25T04:08:35.164407+0000","last_active":"2023-11-25T04:08:37.140747+0000","last_peered":"2023-11-25T04:08:37.140747+0000","last_clean":"2023-11-25T04:08:37.140747+0000","last_became_active":"2023-11-25T04:08:35.164096+0000","last_became_peered":"2023-11-25T04:08:35.164096+0000","last_unstale":"2023-11-25T04:08:37.140747+0000","last_undegraded":"2023-11-25T04:08:37.140747+0000","last_fullsized":"2023-11-25T04:08:37.140747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140279+0000","last_change":"2023-11-25T04:08:36.155323+0000","last_active":"2023-11-25T04:08:37.140279+0000","last_peered":"2023-11-25T04:08:37.140279+0000","last_clean":"2023-11-25T04:08:37.140279+0000","last_became_active":"2023-11-25T04:08:36.154026+0000","last_became_peered":"2023-11-25T04:08:36.154026+0000","last_unstale":"2023-11-25T04:08:37.140279+0000","last_undegraded":"2023-11-25T04:08:37.140279+0000","last_fullsized":"2023-11-25T04:08:37.140279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:50.896892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140840+0000","last_change":"2023-11-25T04:08:35.161694+0000","last_active":"2023-11-25T04:08:37.140840+0000","last_peered":"2023-11-25T04:08:37.140840+0000","last_clean":"2023-11-25T04:08:37.140840+0000","last_became_active":"2023-11-25T04:08:35.161392+0000","last_became_peered":"2023-11-25T04:08:35.161392+0000","last_unstale":"2023-11-25T04:08:37.140840+0000","last_undegraded":"2023-11-25T04:08:37.140840+0000","last_fullsized":"2023-11-25T04:08:37.140840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140137+0000","last_change":"2023-11-25T04:08:36.147757+0000","last_active":"2023-11-25T04:08:37.140137+0000","last_peered":"2023-11-25T04:08:37.140137+0000","last_clean":"2023-11-25T04:08:37.140137+0000","last_became_active":"2023-11-25T04:08:36.147483+0000","last_became_peered":"2023-11-25T04:08:36.147483+0000","last_unstale":"2023-11-25T04:08:37.140137+0000","last_undegraded":"2023-11-25T04:08:37.140137+0000","last_fullsized":"2023-11-25T04:08:37.140137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:11:54.358612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499222+0000","last_change":"2023-11-25T04:08:35.170314+0000","last_active":"2023-11-25T04:08:37.499222+0000","last_peered":"2023-11-25T04:08:37.499222+0000","last_clean":"2023-11-25T04:08:37.499222+0000","last_became_active":"2023-11-25T04:08:35.170029+0000","last_became_peered":"2023-11-25T04:08:35.170029+0000","last_unstale":"2023-11-25T04:08:37.499222+0000","last_undegraded":"2023-11-25T04:08:37.499222+0000","last_fullsized":"2023-11-25T04:08:37.499222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:44:22.460231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081357+0000","last_change":"2023-11-25T04:08:36.161075+0000","last_active":"2023-11-25T04:08:39.081357+0000","last_peered":"2023-11-25T04:08:39.081357+0000","last_clean":"2023-11-25T04:08:39.081357+0000","last_became_active":"2023-11-25T04:08:36.160734+0000","last_became_peered":"2023-11-25T04:08:36.160734+0000","last_unstale":"2023-11-25T04:08:39.081357+0000","last_undegraded":"2023-11-25T04:08:39.081357+0000","last_fullsized":"2023-11-25T04:08:39.081357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:11:58.809542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.082486+0000","last_change":"2023-11-25T04:08:36.160701+0000","last_active":"2023-11-25T04:08:39.082486+0000","last_peered":"2023-11-25T04:08:39.082486+0000","last_clean":"2023-11-25T04:08:39.082486+0000","last_became_active":"2023-11-25T04:08:36.160423+0000","last_became_peered":"2023-11-25T04:08:36.160423+0000","last_unstale":"2023-11-25T04:08:39.082486+0000","last_undegraded":"2023-11-25T04:08:39.082486+0000","last_fullsized":"2023-11-25T04:08:39.082486+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:15:08.072394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499236+0000","last_change":"2023-11-25T04:08:35.170930+0000","last_active":"2023-11-25T04:08:37.499236+0000","last_peered":"2023-11-25T04:08:37.499236+0000","last_clean":"2023-11-25T04:08:37.499236+0000","last_became_active":"2023-11-25T04:08:35.170627+0000","last_became_peered":"2023-11-25T04:08:35.170627+0000","last_unstale":"2023-11-25T04:08:37.499236+0000","last_undegraded":"2023-11-25T04:08:37.499236+0000","last_fullsized":"2023-11-25T04:08:37.499236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:33:50.269678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081851+0000","last_change":"2023-11-25T04:08:36.151765+0000","last_active":"2023-11-25T04:08:39.081851+0000","last_peered":"2023-11-25T04:08:39.081851+0000","last_clean":"2023-11-25T04:08:39.081851+0000","last_became_active":"2023-11-25T04:08:36.151464+0000","last_became_peered":"2023-11-25T04:08:36.151464+0000","last_unstale":"2023-11-25T04:08:39.081851+0000","last_undegraded":"2023-11-25T04:08:39.081851+0000","last_fullsized":"2023-11-25T04:08:39.081851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:09:24.146017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.499283+0000","last_change":"2023-11-25T04:08:35.170080+0000","last_active":"2023-11-25T04:08:37.499283+0000","last_peered":"2023-11-25T04:08:37.499283+0000","last_clean":"2023-11-25T04:08:37.499283+0000","last_became_active":"2023-11-25T04:08:35.169782+0000","last_became_peered":"2023-11-25T04:08:35.169782+0000","last_unstale":"2023-11-25T04:08:37.499283+0000","last_undegraded":"2023-11-25T04:08:37.499283+0000","last_fullsized":"2023-11-25T04:08:37.499283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:47:02.556458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:39.081376+0000","last_change":"2023-11-25T04:08:36.158134+0000","last_active":"2023-11-25T04:08:39.081376+0000","last_peered":"2023-11-25T04:08:39.081376+0000","last_clean":"2023-11-25T04:08:39.081376+0000","last_became_active":"2023-11-25T04:08:36.157273+0000","last_became_peered":"2023-11-25T04:08:36.157273+0000","last_unstale":"2023-11-25T04:08:39.081376+0000","last_undegraded":"2023-11-25T04:08:39.081376+0000","last_fullsized":"2023-11-25T04:08:39.081376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:14:59.613919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140288+0000","last_change":"2023-11-25T04:08:35.168130+0000","last_active":"2023-11-25T04:08:37.140288+0000","last_peered":"2023-11-25T04:08:37.140288+0000","last_clean":"2023-11-25T04:08:37.140288+0000","last_became_active":"2023-11-25T04:08:35.167876+0000","last_became_peered":"2023-11-25T04:08:35.167876+0000","last_unstale":"2023-11-25T04:08:37.140288+0000","last_undegraded":"2023-11-25T04:08:37.140288+0000","last_fullsized":"2023-11-25T04:08:37.140288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:48:38.592497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.140071+0000","last_change":"2023-11-25T04:08:36.157577+0000","last_active":"2023-11-25T04:08:37.140071+0000","last_peered":"2023-11-25T04:08:37.140071+0000","last_clean":"2023-11-25T04:08:37.140071+0000","last_became_active":"2023-11-25T04:08:36.157233+0000","last_became_peered":"2023-11-25T04:08:36.157233+0000","last_unstale":"2023-11-25T04:08:37.140071+0000","last_undegraded":"2023-11-25T04:08:37.140071+0000","last_fullsized":"2023-11-25T04:08:37.140071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:35.142174+0000","last_clean_scrub_stamp":"2023-11-25T04:08:35.142174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:13:27.356648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-25T04:08:37.494594+0000","last_change":"2023-11-25T04:08:35.170151+0000","last_active":"2023-11-25T04:08:37.494594+0000","last_peered":"2023-11-25T04:08:37.494594+0000","last_clean":"2023-11-25T04:08:37.494594+0000","last_became_active":"2023-11-25T04:08:35.169808+0000","last_became_peered":"2023-11-25T04:08:35.169808+0000","last_unstale":"2023-11-25T04:08:37.494594+0000","last_undegraded":"2023-11-25T04:08:37.494594+0000","last_fullsized":"2023-11-25T04:08:37.494594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:34.138065+0000","last_clean_scrub_stamp":"2023-11-25T04:08:34.138065+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:29:05.496477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5940000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-25T04:08:46.189 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-25T04:08:46.189 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-25T04:08:46.189 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-25T04:08:46.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-25T04:08:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.328+0000 7faebc505640 1 Processor -- start 2023-11-25T04:08:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.328+0000 7faebc505640 1 -- start start 2023-11-25T04:08:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faebc505640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faeb4160ab0 0x7faeb40afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faebc505640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faeb40b2450 0x7faeb40cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faebc505640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faeb40d0030 0x7faeb40d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faebc505640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40cdd30 con 0x7faeb40b2450 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faebc505640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb40ce2d0 con 0x7faeb4160ab0 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faebc505640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb40d0a90 con 0x7faeb40d0030 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faeb9aa0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faeb40b2450 0x7faeb40cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faeb9aa0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7faeb40b2450 0x7faeb40cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53522/0 (socket says 172.21.15.2:53522) 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faeb9aa0640 1 -- 172.21.15.2:0/1438285123 learned_addr learned my addr 172.21.15.2:0/1438285123 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faeb9aa0640 1 -- 172.21.15.2:0/1438285123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faeb40d0030 msgr2=0x7faeb40d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faeb9aa0640 1 --2- 172.21.15.2:0/1438285123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faeb40d0030 0x7faeb40d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faeb9aa0640 1 -- 172.21.15.2:0/1438285123 >> v2:172.21.15.66:3300/0 conn(0x7faeb4160ab0 msgr2=0x7faeb40afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:46.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.329+0000 7faeba2a1640 1 --2- 172.21.15.2:0/1438285123 >> v2:172.21.15.66:3300/0 conn(0x7faeb4160ab0 0x7faeb40afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.330+0000 7faeb9aa0640 1 --2- 172.21.15.2:0/1438285123 >> v2:172.21.15.66:3300/0 conn(0x7faeb4160ab0 0x7faeb40afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.330+0000 7faeb9aa0640 1 -- 172.21.15.2:0/1438285123 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb40b02f0 con 0x7faeb40b2450 2023-11-25T04:08:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.330+0000 7faeb9aa0640 1 --2- 172.21.15.2:0/1438285123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40b2450 0x7faeb40cfaf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faeb40b5cc0 tx=0x7faea802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=563a879c6051a7c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.330+0000 7faeb929f640 1 -- 172.21.15.2:0/1438285123 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea80317e0 con 0x7faeb40b2450 2023-11-25T04:08:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.330+0000 7faeb929f640 1 -- 172.21.15.2:0/1438285123 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8031940 con 0x7faeb40b2450 2023-11-25T04:08:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.330+0000 7faeb929f640 1 -- 172.21.15.2:0/1438285123 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8031cd0 con 0x7faeb40b2450 2023-11-25T04:08:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.331+0000 7faebc505640 1 -- 172.21.15.2:0/1438285123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40b2450 msgr2=0x7faeb40cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.331+0000 7faebc505640 1 --2- 172.21.15.2:0/1438285123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40b2450 0x7faeb40cfaf0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7faeb40b5cc0 tx=0x7faea802b880 comp rx=0 tx=0).stop 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.331+0000 7faebc505640 1 -- 172.21.15.2:0/1438285123 shutdown_connections 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.331+0000 7faebc505640 1 --2- 172.21.15.2:0/1438285123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faeb40d0030 0x7faeb40d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.331+0000 7faebc505640 1 --2- 172.21.15.2:0/1438285123 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40b2450 0x7faeb40cfaf0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.331+0000 7faebc505640 1 --2- 172.21.15.2:0/1438285123 >> v2:172.21.15.66:3300/0 conn(0x7faeb4160ab0 0x7faeb40afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.331+0000 7faebc505640 1 -- 172.21.15.2:0/1438285123 >> 172.21.15.2:0/1438285123 conn(0x7faeb409c450 msgr2=0x7faeb40d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.331+0000 7faebc505640 1 -- 172.21.15.2:0/1438285123 shutdown_connections 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.331+0000 7faebc505640 1 -- 172.21.15.2:0/1438285123 wait complete. 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.332+0000 7faebc505640 1 Processor -- start 2023-11-25T04:08:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.332+0000 7faebc505640 1 -- start start 2023-11-25T04:08:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faebc505640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faeb40b2450 0x7faeb414d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faebc505640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40d0030 0x7faeb40a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faebc505640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb4160ab0 0x7faeb415e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faebc505640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb414ddc0 con 0x7faeb40d0030 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faebc505640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb4149790 con 0x7faeb4160ab0 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faebc505640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb41486f0 con 0x7faeb40b2450 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faeb9aa0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40d0030 0x7faeb40a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faeb9aa0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40d0030 0x7faeb40a0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53530/0 (socket says 172.21.15.2:53530) 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faeb9aa0640 1 -- 172.21.15.2:0/3137644236 learned_addr learned my addr 172.21.15.2:0/3137644236 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faebaaa2640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb4160ab0 0x7faeb415e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faeba2a1640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faeb40b2450 0x7faeb414d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faeb9aa0640 1 -- 172.21.15.2:0/3137644236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faeb40b2450 msgr2=0x7faeb414d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faeb9aa0640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faeb40b2450 0x7faeb414d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faeb9aa0640 1 -- 172.21.15.2:0/3137644236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb4160ab0 msgr2=0x7faeb415e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faeb9aa0640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb4160ab0 0x7faeb415e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faeb9aa0640 1 -- 172.21.15.2:0/3137644236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea80094d0 con 0x7faeb40d0030 2023-11-25T04:08:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.333+0000 7faebaaa2640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb4160ab0 0x7faeb415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.334+0000 7faeb9aa0640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40d0030 0x7faeb40a0860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faea8000c00 tx=0x7faea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.334+0000 7faeb2ffd640 1 -- 172.21.15.2:0/3137644236 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8032980 con 0x7faeb40d0030 2023-11-25T04:08:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.334+0000 7faeb2ffd640 1 -- 172.21.15.2:0/3137644236 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea8032ae0 con 0x7faeb40d0030 2023-11-25T04:08:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.334+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb41489d0 con 0x7faeb40d0030 2023-11-25T04:08:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.334+0000 7faeb2ffd640 1 -- 172.21.15.2:0/3137644236 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea8032e90 con 0x7faeb40d0030 2023-11-25T04:08:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.334+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb4148f90 con 0x7faeb40d0030 2023-11-25T04:08:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.335+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb4067420 con 0x7faeb40d0030 2023-11-25T04:08:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.335+0000 7faeb2ffd640 1 -- 172.21.15.2:0/3137644236 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faea804d3f0 con 0x7faeb40d0030 2023-11-25T04:08:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.336+0000 7faeb2ffd640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faea006ae40 0x7faea006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.336+0000 7faeba2a1640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faea006ae40 0x7faea006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.336+0000 7faeb2ffd640 1 -- 172.21.15.2:0/3137644236 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faea80ab6c0 con 0x7faeb40d0030 2023-11-25T04:08:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.336+0000 7faeba2a1640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faea006ae40 0x7faea006d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faeac006fd0 tx=0x7faeac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.340+0000 7faeb2ffd640 1 -- 172.21.15.2:0/3137644236 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faea8076780 con 0x7faeb40d0030 2023-11-25T04:08:46.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.551+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faeb40d1020 con 0x7faeb40d0030 2023-11-25T04:08:46.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.551+0000 7faeb2ffd640 1 -- 172.21.15.2:0/3137644236 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7faea8079da0 con 0x7faeb40d0030 2023-11-25T04:08:46.553 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:46.554 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-25T04:08:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faea006ae40 msgr2=0x7faea006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faea006ae40 0x7faea006d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faeac006fd0 tx=0x7faeac008040 comp rx=0 tx=0).stop 2023-11-25T04:08:46.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40d0030 msgr2=0x7faeb40a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40d0030 0x7faeb40a0860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faea8000c00 tx=0x7faea80046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 shutdown_connections 2023-11-25T04:08:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7faea006ae40 0x7faea006d300 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faeb4160ab0 0x7faeb415e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7faeb40d0030 0x7faeb40a0860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 --2- 172.21.15.2:0/3137644236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faeb40b2450 0x7faeb414d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 >> 172.21.15.2:0/3137644236 conn(0x7faeb409c450 msgr2=0x7faeb40c95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 shutdown_connections 2023-11-25T04:08:46.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.553+0000 7faebc505640 1 -- 172.21.15.2:0/3137644236 wait complete. 2023-11-25T04:08:46.566 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-25T04:08:46.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.671+0000 7fc8a6815640 1 Processor -- start 2023-11-25T04:08:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.671+0000 7fc8a6815640 1 -- start start 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.672+0000 7fc8a6815640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a00d1720 0x7fc8a00d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.672+0000 7fc8a6815640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc8a00b3db0 0x7fc8a00b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.672+0000 7fc8a6815640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a00b5f90 con 0x7fc8a015d3e0 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.672+0000 7fc8a6815640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a00d20a0 con 0x7fc8a00b3db0 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.672+0000 7fc8a6815640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00b61e0 con 0x7fc8a00d1720 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.672+0000 7fc8a4db2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc8a00b3db0 0x7fc8a00b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.672+0000 7fc8a4db2640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc8a00b3db0 0x7fc8a00b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53540/0 (socket says 172.21.15.2:53540) 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.672+0000 7fc8a4db2640 1 -- 172.21.15.2:0/1771133812 learned_addr learned my addr 172.21.15.2:0/1771133812 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.673+0000 7fc89f7fe640 1 --2- 172.21.15.2:0/1771133812 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a00d1720 0x7fc8a00d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.673+0000 7fc8a4db2640 1 -- 172.21.15.2:0/1771133812 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a00d1720 msgr2=0x7fc8a00d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.673+0000 7fc8a4db2640 1 --2- 172.21.15.2:0/1771133812 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a00d1720 0x7fc8a00d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.673+0000 7fc8a4db2640 1 -- 172.21.15.2:0/1771133812 >> v1:172.21.15.66:6789/0 conn(0x7fc8a015d3e0 legacy=0x7fc8a00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:46.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.673+0000 7fc8a4db2640 1 -- 172.21.15.2:0/1771133812 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a00b64c0 con 0x7fc8a00b3db0 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.673+0000 7fc8a4db2640 1 --2- 172.21.15.2:0/1771133812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 0x7fc8a00b4240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc898009e50 tx=0x7fc89802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321f23486c0f032b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc89effd640 1 -- 172.21.15.2:0/1771133812 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc89802ca70 con 0x7fc8a00b3db0 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc89effd640 1 -- 172.21.15.2:0/1771133812 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89802cbd0 con 0x7fc8a00b3db0 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc89effd640 1 -- 172.21.15.2:0/1771133812 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980343f0 con 0x7fc8a00b3db0 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc8a6815640 1 -- 172.21.15.2:0/1771133812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 msgr2=0x7fc8a00b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc8a6815640 1 --2- 172.21.15.2:0/1771133812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 0x7fc8a00b4240 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc898009e50 tx=0x7fc89802bed0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc8a6815640 1 -- 172.21.15.2:0/1771133812 shutdown_connections 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc8a6815640 1 --2- 172.21.15.2:0/1771133812 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 0x7fc8a00b4240 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc8a6815640 1 --2- 172.21.15.2:0/1771133812 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a00d1720 0x7fc8a00d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc8a6815640 1 -- 172.21.15.2:0/1771133812 >> 172.21.15.2:0/1771133812 conn(0x7fc8a009c480 msgr2=0x7fc8a00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:46.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc8a6815640 1 -- 172.21.15.2:0/1771133812 shutdown_connections 2023-11-25T04:08:46.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.674+0000 7fc8a6815640 1 -- 172.21.15.2:0/1771133812 wait complete. 2023-11-25T04:08:46.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.675+0000 7fc8a6815640 1 Processor -- start 2023-11-25T04:08:46.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc8a6815640 1 -- start start 2023-11-25T04:08:46.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc8a6815640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 0x7fc8a00c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc8a6815640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a00d1720 0x7fc8a00cac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc8a6815640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a015d3e0 0x7fc8a015f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc8a6815640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a015d9f0 con 0x7fc8a00b3db0 2023-11-25T04:08:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc8a6815640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00c9b90 con 0x7fc8a00d1720 2023-11-25T04:08:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc8a6815640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a00cb590 con 0x7fc8a015d3e0 2023-11-25T04:08:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc89ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 0x7fc8a00c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc89ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 0x7fc8a00c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53554/0 (socket says 172.21.15.2:53554) 2023-11-25T04:08:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.676+0000 7fc89ffff640 1 -- 172.21.15.2:0/2957414899 learned_addr learned my addr 172.21.15.2:0/2957414899 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc8a4db2640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a015d3e0 0x7fc8a015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89f7fe640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a00d1720 0x7fc8a00cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89ffff640 1 -- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a015d3e0 msgr2=0x7fc8a015f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89ffff640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a015d3e0 0x7fc8a015f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89ffff640 1 -- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a00d1720 msgr2=0x7fc8a00cac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89ffff640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a00d1720 0x7fc8a00cac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89ffff640 1 -- 172.21.15.2:0/2957414899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc898009b30 con 0x7fc8a00b3db0 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc8a4db2640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a015d3e0 0x7fc8a015f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89f7fe640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a00d1720 0x7fc8a00cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89ffff640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 0x7fc8a00c9650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc89000b3f0 tx=0x7fc89000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89cff9640 1 -- 172.21.15.2:0/2957414899 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890011830 con 0x7fc8a00b3db0 2023-11-25T04:08:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89cff9640 1 -- 172.21.15.2:0/2957414899 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc890011990 con 0x7fc8a00b3db0 2023-11-25T04:08:46.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a00cb870 con 0x7fc8a00b3db0 2023-11-25T04:08:46.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc89cff9640 1 -- 172.21.15.2:0/2957414899 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc890011d40 con 0x7fc8a00b3db0 2023-11-25T04:08:46.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.677+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a00cb160 con 0x7fc8a00b3db0 2023-11-25T04:08:46.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.678+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a00cbd90 con 0x7fc8a00b3db0 2023-11-25T04:08:46.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.679+0000 7fc89cff9640 1 -- 172.21.15.2:0/2957414899 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc89001a400 con 0x7fc8a00b3db0 2023-11-25T04:08:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.679+0000 7fc89cff9640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc88c06ae40 0x7fc88c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.679+0000 7fc89cff9640 1 -- 172.21.15.2:0/2957414899 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc890089410 con 0x7fc8a00b3db0 2023-11-25T04:08:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.679+0000 7fc89f7fe640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc88c06ae40 0x7fc88c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.679+0000 7fc89f7fe640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc88c06ae40 0x7fc88c06d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc8a01f6340 tx=0x7fc894008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.683+0000 7fc89cff9640 1 -- 172.21.15.2:0/2957414899 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc8a00cbd90 con 0x7fc8a00b3db0 2023-11-25T04:08:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.861+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8a015d7c0 con 0x7fc8a00b3db0 2023-11-25T04:08:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.862+0000 7fc89cff9640 1 -- 172.21.15.2:0/2957414899 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fc8a015d7c0 con 0x7fc8a00b3db0 2023-11-25T04:08:46.864 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:46.865 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc88c06ae40 msgr2=0x7fc88c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc88c06ae40 0x7fc88c06d300 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc8a01f6340 tx=0x7fc894008040 comp rx=0 tx=0).stop 2023-11-25T04:08:46.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 msgr2=0x7fc8a00c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 0x7fc8a00c9650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc89000b3f0 tx=0x7fc89000b8b0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 shutdown_connections 2023-11-25T04:08:46.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8a015d3e0 0x7fc8a015f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc88c06ae40 0x7fc88c06d300 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8a00d1720 0x7fc8a00cac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 --2- 172.21.15.2:0/2957414899 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc8a00b3db0 0x7fc8a00c9650 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 >> 172.21.15.2:0/2957414899 conn(0x7fc8a009c480 msgr2=0x7fc8a00d3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 shutdown_connections 2023-11-25T04:08:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.864+0000 7fc8a6815640 1 -- 172.21.15.2:0/2957414899 wait complete. 2023-11-25T04:08:46.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:08:46.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:08:46.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.985+0000 7f0c29e15640 1 Processor -- start 2023-11-25T04:08:46.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.985+0000 7f0c29e15640 1 -- start start 2023-11-25T04:08:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.985+0000 7f0c29e15640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c241465d0 0x7f0c240b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c29e15640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c2406abe0 0x7f0c24160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c29e15640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c240721d0 con 0x7f0c24071d40 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c29e15640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c24161d80 con 0x7f0c241465d0 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c29e15640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c241612d0 con 0x7f0c2406abe0 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c237fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c241465d0 0x7f0c240b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c2406abe0 0x7f0c24160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c237fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c241465d0 0x7f0c240b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55376/0 (socket says 172.21.15.2:55376) 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c22ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f0c24071d40 0x7f0c2406a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:46274/0 (socket says 172.21.15.2:46274) 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c237fe640 1 -- 172.21.15.2:0/2721771627 learned_addr learned my addr 172.21.15.2:0/2721771627 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c23fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c2406abe0 0x7f0c24160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:40058/0 (socket says 172.21.15.2:40058) 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c227fc640 1 -- 172.21.15.2:0/2721771627 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819275093 0 0) 0x7f0c240721d0 con 0x7f0c24071d40 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c227fc640 1 -- 172.21.15.2:0/2721771627 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c0c003520 con 0x7f0c24071d40 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c237fe640 1 -- 172.21.15.2:0/2721771627 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c2406abe0 msgr2=0x7f0c24160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c237fe640 1 --2- 172.21.15.2:0/2721771627 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c2406abe0 0x7f0c24160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c237fe640 1 -- 172.21.15.2:0/2721771627 >> v1:172.21.15.66:6789/0 conn(0x7f0c24071d40 legacy=0x7f0c2406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c237fe640 1 -- 172.21.15.2:0/2721771627 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240cf790 con 0x7f0c241465d0 2023-11-25T04:08:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.986+0000 7f0c23fff640 1 --2- 172.21.15.2:0/2721771627 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c2406abe0 0x7f0c24160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.987+0000 7f0c237fe640 1 --2- 172.21.15.2:0/2721771627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c241465d0 0x7f0c240b2ee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009870 tx=0x7f0c1802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb10ef845d78a5b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.987+0000 7f0c227fc640 1 -- 172.21.15.2:0/2721771627 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18030840 con 0x7f0c241465d0 2023-11-25T04:08:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.987+0000 7f0c227fc640 1 -- 172.21.15.2:0/2721771627 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c180309a0 con 0x7f0c241465d0 2023-11-25T04:08:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.987+0000 7f0c227fc640 1 -- 172.21.15.2:0/2721771627 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18030d10 con 0x7f0c241465d0 2023-11-25T04:08:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.988+0000 7f0c29e15640 1 -- 172.21.15.2:0/2721771627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c241465d0 msgr2=0x7f0c240b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.988+0000 7f0c29e15640 1 --2- 172.21.15.2:0/2721771627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c241465d0 0x7f0c240b2ee0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0c18009870 tx=0x7f0c1802b980 comp rx=0 tx=0).stop 2023-11-25T04:08:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.988+0000 7f0c29e15640 1 -- 172.21.15.2:0/2721771627 shutdown_connections 2023-11-25T04:08:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.988+0000 7f0c29e15640 1 --2- 172.21.15.2:0/2721771627 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c2406abe0 0x7f0c24160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.988+0000 7f0c29e15640 1 --2- 172.21.15.2:0/2721771627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c241465d0 0x7f0c240b2ee0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.988+0000 7f0c29e15640 1 -- 172.21.15.2:0/2721771627 >> 172.21.15.2:0/2721771627 conn(0x7f0c240cc930 msgr2=0x7f0c240ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.988+0000 7f0c29e15640 1 -- 172.21.15.2:0/2721771627 shutdown_connections 2023-11-25T04:08:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.988+0000 7f0c29e15640 1 -- 172.21.15.2:0/2721771627 wait complete. 2023-11-25T04:08:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.989+0000 7f0c29e15640 1 Processor -- start 2023-11-25T04:08:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.989+0000 7f0c29e15640 1 -- start start 2023-11-25T04:08:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c29e15640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c2406abe0 0x7f0c2413e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c29e15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24071d40 0x7f0c24155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c29e15640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c241465d0 0x7f0c240af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c29e15640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240adec0 con 0x7f0c24071d40 2023-11-25T04:08:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c29e15640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2413e790 con 0x7f0c2406abe0 2023-11-25T04:08:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c29e15640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c24155e70 con 0x7f0c241465d0 2023-11-25T04:08:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c22ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24071d40 0x7f0c24155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c22ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24071d40 0x7f0c24155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53560/0 (socket says 172.21.15.2:53560) 2023-11-25T04:08:46.996 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c22ffd640 1 -- 172.21.15.2:0/1346478408 learned_addr learned my addr 172.21.15.2:0/1346478408 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c23fff640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c241465d0 0x7f0c240af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c237fe640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c2406abe0 0x7f0c2413e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c22ffd640 1 -- 172.21.15.2:0/1346478408 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c241465d0 msgr2=0x7f0c240af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c22ffd640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c241465d0 0x7f0c240af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c22ffd640 1 -- 172.21.15.2:0/1346478408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c2406abe0 msgr2=0x7f0c2413e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c22ffd640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c2406abe0 0x7f0c2413e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.990+0000 7f0c22ffd640 1 -- 172.21.15.2:0/1346478408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1c009a70 con 0x7f0c24071d40 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.991+0000 7f0c22ffd640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24071d40 0x7f0c24155930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400c410 tx=0x7f0c1400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.991+0000 7f0c0bfff640 1 -- 172.21.15.2:0/1346478408 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140074e0 con 0x7f0c24071d40 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.991+0000 7f0c0bfff640 1 -- 172.21.15.2:0/1346478408 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c14007640 con 0x7f0c24071d40 2023-11-25T04:08:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.991+0000 7f0c0bfff640 1 -- 172.21.15.2:0/1346478408 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c14004a00 con 0x7f0c24071d40 2023-11-25T04:08:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.991+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c180094d0 con 0x7f0c24071d40 2023-11-25T04:08:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.991+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c240ae3f0 con 0x7f0c24071d40 2023-11-25T04:08:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.992+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2406e6a0 con 0x7f0c24071d40 2023-11-25T04:08:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.992+0000 7f0c0bfff640 1 -- 172.21.15.2:0/1346478408 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c14004b60 con 0x7f0c24071d40 2023-11-25T04:08:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.992+0000 7f0c0bfff640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c1006ae70 0x7f0c1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.993+0000 7f0c0bfff640 1 -- 172.21.15.2:0/1346478408 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c14088ed0 con 0x7f0c24071d40 2023-11-25T04:08:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.993+0000 7f0c237fe640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c1006ae70 0x7f0c1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.993+0000 7f0c237fe640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c1006ae70 0x7f0c1006d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0c18036000 tx=0x7f0c18008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:46.999 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:46.997+0000 7f0c0bfff640 1 -- 172.21.15.2:0/1346478408 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c14053f80 con 0x7f0c24071d40 2023-11-25T04:08:47.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.174+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c2404e920 con 0x7f0c24071d40 2023-11-25T04:08:47.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.174+0000 7f0c0bfff640 1 -- 172.21.15.2:0/1346478408 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c140575a0 con 0x7f0c24071d40 2023-11-25T04:08:47.176 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:08:47.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c1006ae70 msgr2=0x7f0c1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c1006ae70 0x7f0c1006d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0c18036000 tx=0x7f0c18008030 comp rx=0 tx=0).stop 2023-11-25T04:08:47.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24071d40 msgr2=0x7f0c24155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24071d40 0x7f0c24155930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0c1400c410 tx=0x7f0c1400c810 comp rx=0 tx=0).stop 2023-11-25T04:08:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 shutdown_connections 2023-11-25T04:08:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c241465d0 0x7f0c240af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0c24071d40 0x7f0c24155930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c1006ae70 0x7f0c1006d330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 --2- 172.21.15.2:0/1346478408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c2406abe0 0x7f0c2413e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 >> 172.21.15.2:0/1346478408 conn(0x7f0c240cc930 msgr2=0x7f0c2406a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 shutdown_connections 2023-11-25T04:08:47.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.176+0000 7f0c29e15640 1 -- 172.21.15.2:0/1346478408 wait complete. 2023-11-25T04:08:47.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:08:47.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.297+0000 7fedbf353640 1 Processor -- start 2023-11-25T04:08:47.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.297+0000 7fedbf353640 1 -- start start 2023-11-25T04:08:47.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.298+0000 7fedbf353640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fedb8071640 0x7fedb8164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.298+0000 7fedbf353640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb815b530 con 0x7fedb815b0d0 2023-11-25T04:08:47.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.298+0000 7fedbf353640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedb80ce060 con 0x7fedb813f750 2023-11-25T04:08:47.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.298+0000 7fedbf353640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedb80cec70 con 0x7fedb8071640 2023-11-25T04:08:47.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.298+0000 7fedbc8ee640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fedb815b0d0 0x7fedb80cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33104/0 (socket says 172.21.15.2:33104) 2023-11-25T04:08:47.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.298+0000 7fedbc8ee640 1 -- 172.21.15.2:0/2553552654 learned_addr learned my addr 172.21.15.2:0/2553552654 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:47.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.298+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357914125 0 0) 0x7fedb815b530 con 0x7fedb815b0d0 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.298+0000 7fedbd8f0640 1 --2- 172.21.15.2:0/2553552654 >> v2:172.21.15.66:3300/0 conn(0x7fedb8071640 0x7fedb8164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.298+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feda0003520 con 0x7fedb815b0d0 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1942647662 0 0) 0x7feda0003520 con 0x7fedb815b0d0 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 >> v2:172.21.15.66:3300/0 conn(0x7fedb8071640 msgr2=0x7fedb8164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 --2- 172.21.15.2:0/2553552654 >> v2:172.21.15.66:3300/0 conn(0x7fedb8071640 0x7fedb8164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 >> v1:172.21.15.66:6789/0 conn(0x7fedb813f750 legacy=0x7fedb813fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb80ce340 con 0x7fedb815b0d0 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7fedac001670 con 0x7fedb815b0d0 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 >> v1:172.21.15.2:6789/0 conn(0x7fedb815b0d0 legacy=0x7fedb80cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feda0003970 0x7feda0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feda00047c0 0x7feda0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7feda000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb80cec70 con 0x7feda0005180 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda000c020 con 0x7feda0003970 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda000c1e0 con 0x7feda00047c0 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedbd8f0640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7feda000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedbd0ef640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feda0003970 0x7feda0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedbc8ee640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feda00047c0 0x7feda0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedbd8f0640 1 -- 172.21.15.2:0/2553552654 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feda00047c0 msgr2=0x7feda0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedbd8f0640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feda00047c0 0x7feda0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedbd8f0640 1 -- 172.21.15.2:0/2553552654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feda0003970 msgr2=0x7feda0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedbd8f0640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feda0003970 0x7feda0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.299+0000 7fedbd8f0640 1 -- 172.21.15.2:0/2553552654 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda0003520 con 0x7feda0005180 2023-11-25T04:08:47.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.300+0000 7fedbd8f0640 1 -- 172.21.15.2:0/2553552654 reap_dead start 2023-11-25T04:08:47.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.300+0000 7fedbd8f0640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7feda000b980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feda8009f90 tx=0x7feda00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d094e0f47ad727 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:47.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.300+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda802cc20 con 0x7feda0005180 2023-11-25T04:08:47.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.300+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda800f040 con 0x7feda0005180 2023-11-25T04:08:47.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.300+0000 7fedb7fff640 1 -- 172.21.15.2:0/2553552654 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda8034440 con 0x7feda0005180 2023-11-25T04:08:47.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.300+0000 7fedbf353640 1 -- 172.21.15.2:0/2553552654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 msgr2=0x7feda000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.300+0000 7fedbf353640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7feda000b980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feda8009f90 tx=0x7feda00057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.301+0000 7fedbf353640 1 -- 172.21.15.2:0/2553552654 shutdown_connections 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.301+0000 7fedbf353640 1 --2- 172.21.15.2:0/2553552654 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7feda000b980 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.301+0000 7fedbf353640 1 -- 172.21.15.2:0/2553552654 >> 172.21.15.2:0/2553552654 conn(0x7fedb806a8f0 msgr2=0x7fedb806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.301+0000 7fedbf353640 1 -- 172.21.15.2:0/2553552654 shutdown_connections 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.301+0000 7fedbf353640 1 -- 172.21.15.2:0/2553552654 wait complete. 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.302+0000 7fedbf353640 1 Processor -- start 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.302+0000 7fedbf353640 1 -- start start 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.302+0000 7fedbf353640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7fedb8135590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.302+0000 7fedbf353640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedb815bf00 0x7fedb80afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.302+0000 7fedbf353640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fedb815c360 0x7fedb80b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.302+0000 7fedbf353640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8146800 con 0x7feda0005180 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.302+0000 7fedbf353640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8146ae0 con 0x7fedb815bf00 2023-11-25T04:08:47.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.302+0000 7fedbf353640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8146dc0 con 0x7fedb815c360 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd0ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7fedb8135590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd0ef640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7fedb8135590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53576/0 (socket says 172.21.15.2:53576) 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd0ef640 1 -- 172.21.15.2:0/3434581155 learned_addr learned my addr 172.21.15.2:0/3434581155 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd8f0640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fedb815c360 0x7fedb80b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbc8ee640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedb815bf00 0x7fedb80afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd0ef640 1 -- 172.21.15.2:0/3434581155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fedb815c360 msgr2=0x7fedb80b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd0ef640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fedb815c360 0x7fedb80b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd0ef640 1 -- 172.21.15.2:0/3434581155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedb815bf00 msgr2=0x7fedb80afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd0ef640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedb815bf00 0x7fedb80afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd0ef640 1 -- 172.21.15.2:0/3434581155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb81470a0 con 0x7feda0005180 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbd0ef640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7fedb8135590 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fedb000f5f0 tx=0x7fedb000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:47.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedb5ffb640 1 -- 172.21.15.2:0/3434581155 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00052e0 con 0x7feda0005180 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedb5ffb640 1 -- 172.21.15.2:0/3434581155 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb0005440 con 0x7feda0005180 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb8147380 con 0x7feda0005180 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedb5ffb640 1 -- 172.21.15.2:0/3434581155 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0003810 con 0x7feda0005180 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.303+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb8135ad0 con 0x7feda0005180 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.305+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb8072ae0 con 0x7feda0005180 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.305+0000 7fedb5ffb640 1 -- 172.21.15.2:0/3434581155 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fedb0003970 con 0x7feda0005180 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.305+0000 7fedb5ffb640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7feda406ae70 0x7feda406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.305+0000 7fedb5ffb640 1 -- 172.21.15.2:0/3434581155 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedb00895a0 con 0x7feda0005180 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.305+0000 7fedbc8ee640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7feda406ae70 0x7feda406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.306+0000 7fedbc8ee640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7feda406ae70 0x7feda406d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fedb81f2750 tx=0x7fedac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:47.312 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.309+0000 7fedb5ffb640 1 -- 172.21.15.2:0/3434581155 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fedb00545c0 con 0x7feda0005180 2023-11-25T04:08:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.484+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fedb8072190 con 0x7feda0005180 2023-11-25T04:08:47.486 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.484+0000 7fedb5ffb640 1 -- 172.21.15.2:0/3434581155 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fedb0057be0 con 0x7feda0005180 2023-11-25T04:08:47.486 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:08:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7feda406ae70 msgr2=0x7feda406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7feda406ae70 0x7feda406d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fedb81f2750 tx=0x7fedac009040 comp rx=0 tx=0).stop 2023-11-25T04:08:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 msgr2=0x7fedb8135590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7fedb8135590 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fedb000f5f0 tx=0x7fedb000fab0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 shutdown_connections 2023-11-25T04:08:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fedb815c360 0x7fedb80b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7feda406ae70 0x7feda406d330 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedb815bf00 0x7fedb80afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 --2- 172.21.15.2:0/3434581155 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7feda0005180 0x7fedb8135590 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 >> 172.21.15.2:0/3434581155 conn(0x7fedb806a8f0 msgr2=0x7fedb80b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 shutdown_connections 2023-11-25T04:08:47.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.486+0000 7fedbf353640 1 -- 172.21.15.2:0/3434581155 wait complete. 2023-11-25T04:08:47.499 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:08:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.606+0000 7f0dc09dc640 1 Processor -- start 2023-11-25T04:08:47.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.606+0000 7f0dc09dc640 1 -- start start 2023-11-25T04:08:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dc09dc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dc09dc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0dbc070630 0x7f0dbc070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dc09dc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc0ce060 con 0x7f0dbc13fb30 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dc09dc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc0cec70 con 0x7f0dbc070630 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dc09dc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0ce340 con 0x7f0dbc13f750 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dbad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0dbc070630 0x7f0dbc070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dba59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dba59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc15b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:40082/0 (socket says 172.21.15.2:40082) 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dbad9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0dbc070630 0x7f0dbc070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55434/0 (socket says 172.21.15.2:55434) 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0db1d9b640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f0dbc13fb30 0x7f0dbc0cd7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:46280/0 (socket says 172.21.15.2:46280) 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dba59c640 1 -- 172.21.15.2:0/1460656333 learned_addr learned my addr 172.21.15.2:0/1460656333 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0db9d9b640 1 -- 172.21.15.2:0/1460656333 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544920658 0 0) 0x7f0dbc0ce060 con 0x7f0dbc13fb30 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0db9d9b640 1 -- 172.21.15.2:0/1460656333 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da8003520 con 0x7f0dbc13fb30 2023-11-25T04:08:47.610 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dbad9d640 1 -- 172.21.15.2:0/1460656333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 msgr2=0x7f0dbc15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dbad9d640 1 --2- 172.21.15.2:0/1460656333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dbad9d640 1 -- 172.21.15.2:0/1460656333 >> v1:172.21.15.66:6789/0 conn(0x7f0dbc13fb30 legacy=0x7f0dbc0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dbad9d640 1 -- 172.21.15.2:0/1460656333 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc0ce620 con 0x7f0dbc070630 2023-11-25T04:08:47.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.607+0000 7f0dba59c640 1 --2- 172.21.15.2:0/1460656333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.608+0000 7f0dbad9d640 1 --2- 172.21.15.2:0/1460656333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dbc070630 0x7f0dbc070ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009d90 tx=0x7f0db402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d446536ad9074829 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.608+0000 7f0db9d9b640 1 -- 172.21.15.2:0/1460656333 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db402cc50 con 0x7f0dbc070630 2023-11-25T04:08:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.608+0000 7f0db9d9b640 1 -- 172.21.15.2:0/1460656333 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db402cdb0 con 0x7f0dbc070630 2023-11-25T04:08:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.608+0000 7f0db9d9b640 1 -- 172.21.15.2:0/1460656333 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db4034640 con 0x7f0dbc070630 2023-11-25T04:08:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.609+0000 7f0dc09dc640 1 -- 172.21.15.2:0/1460656333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dbc070630 msgr2=0x7f0dbc070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.609+0000 7f0dc09dc640 1 --2- 172.21.15.2:0/1460656333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dbc070630 0x7f0dbc070ac0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009d90 tx=0x7f0db402bea0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.609+0000 7f0dc09dc640 1 -- 172.21.15.2:0/1460656333 shutdown_connections 2023-11-25T04:08:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.609+0000 7f0dc09dc640 1 --2- 172.21.15.2:0/1460656333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dbc070630 0x7f0dbc070ac0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.609+0000 7f0dc09dc640 1 --2- 172.21.15.2:0/1460656333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.609+0000 7f0dc09dc640 1 -- 172.21.15.2:0/1460656333 >> 172.21.15.2:0/1460656333 conn(0x7f0dbc06a8f0 msgr2=0x7f0dbc06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.609+0000 7f0dc09dc640 1 -- 172.21.15.2:0/1460656333 shutdown_connections 2023-11-25T04:08:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.609+0000 7f0dc09dc640 1 -- 172.21.15.2:0/1460656333 wait complete. 2023-11-25T04:08:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.610+0000 7f0dc09dc640 1 Processor -- start 2023-11-25T04:08:47.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.610+0000 7f0dc09dc640 1 -- start start 2023-11-25T04:08:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.611+0000 7f0dc09dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc070630 0x7f0dbc139990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.611+0000 7f0dc09dc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc13d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.611+0000 7f0dc09dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dbc13fb30 0x7f0dbc13db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.611+0000 7f0dc09dc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc13ac10 con 0x7f0dbc070630 2023-11-25T04:08:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.611+0000 7f0dc09dc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc13a370 con 0x7f0dbc13fb30 2023-11-25T04:08:47.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.611+0000 7f0dc09dc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc13a650 con 0x7f0dbc13f750 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.611+0000 7f0dba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc070630 0x7f0dbc139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.611+0000 7f0dba59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc070630 0x7f0dbc139990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53588/0 (socket says 172.21.15.2:53588) 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.611+0000 7f0dba59c640 1 -- 172.21.15.2:0/3963964429 learned_addr learned my addr 172.21.15.2:0/3963964429 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0dbad9d640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dbc13fb30 0x7f0dbc13db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0db1d9b640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc13d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0dba59c640 1 -- 172.21.15.2:0/3963964429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 msgr2=0x7f0dbc13d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0dba59c640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc13d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0dba59c640 1 -- 172.21.15.2:0/3963964429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dbc13fb30 msgr2=0x7f0dbc13db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0dba59c640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dbc13fb30 0x7f0dbc13db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0dba59c640 1 -- 172.21.15.2:0/3963964429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0094d0 con 0x7f0dbc070630 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0dba59c640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc070630 0x7f0dbc139990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00e9d0 tx=0x7f0dac00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0db37fe640 1 -- 172.21.15.2:0/3963964429 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00ca60 con 0x7f0dbc070630 2023-11-25T04:08:47.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0db37fe640 1 -- 172.21.15.2:0/3963964429 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac00cbc0 con 0x7f0dbc070630 2023-11-25T04:08:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db4009a70 con 0x7f0dbc070630 2023-11-25T04:08:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0db37fe640 1 -- 172.21.15.2:0/3963964429 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac013470 con 0x7f0dbc070630 2023-11-25T04:08:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.612+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc155280 con 0x7f0dbc070630 2023-11-25T04:08:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.613+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc072ae0 con 0x7f0dbc070630 2023-11-25T04:08:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.613+0000 7f0db37fe640 1 -- 172.21.15.2:0/3963964429 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0dac0135d0 con 0x7f0dbc070630 2023-11-25T04:08:47.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.614+0000 7f0db37fe640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0d9c06ae40 0x7f0d9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.614+0000 7f0db37fe640 1 -- 172.21.15.2:0/3963964429 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dac089950 con 0x7f0dbc070630 2023-11-25T04:08:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.614+0000 7f0db1d9b640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0d9c06ae40 0x7f0d9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.614+0000 7f0db1d9b640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0d9c06ae40 0x7f0d9c06d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0da4000f60 tx=0x7f0da4007b10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:47.620 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.618+0000 7f0db37fe640 1 -- 172.21.15.2:0/3963964429 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0dac054a00 con 0x7f0dbc070630 2023-11-25T04:08:47.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.794+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0dbc04e920 con 0x7f0dbc070630 2023-11-25T04:08:47.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.794+0000 7f0db37fe640 1 -- 172.21.15.2:0/3963964429 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0dac0170a0 con 0x7f0dbc070630 2023-11-25T04:08:47.798 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0d9c06ae40 msgr2=0x7f0d9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0d9c06ae40 0x7f0d9c06d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0da4000f60 tx=0x7f0da4007b10 comp rx=0 tx=0).stop 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc070630 msgr2=0x7f0dbc139990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc070630 0x7f0dbc139990 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0dac00e9d0 tx=0x7f0dac00ee90 comp rx=0 tx=0).stop 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 shutdown_connections 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0d9c06ae40 0x7f0d9c06d300 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dbc13fb30 0x7f0dbc13db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dbc13f750 0x7f0dbc13d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 --2- 172.21.15.2:0/3963964429 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0dbc070630 0x7f0dbc139990 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 >> 172.21.15.2:0/3963964429 conn(0x7f0dbc06a8f0 msgr2=0x7f0dbc06acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:47.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 shutdown_connections 2023-11-25T04:08:47.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.796+0000 7f0dc09dc640 1 -- 172.21.15.2:0/3963964429 wait complete. 2023-11-25T04:08:47.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:08:47.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.913+0000 7ff79f031640 1 Processor -- start 2023-11-25T04:08:47.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.913+0000 7ff79f031640 1 -- start start 2023-11-25T04:08:47.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79f031640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff7980b2450 0x7ff7980cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79f031640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff7980d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79f031640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7980cdd30 con 0x7ff798160ab0 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79f031640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7980ce2d0 con 0x7ff7980b2450 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79f031640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7980d0a90 con 0x7ff7980d0030 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79d5ce640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff7980d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff78ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff7980b2450 0x7ff7980cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79d5ce640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff7980d1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:40110/0 (socket says 172.21.15.2:40110) 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79cdcd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff798160ab0 0x7ff7980afdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:46282/0 (socket says 172.21.15.2:46282) 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79d5ce640 1 -- 172.21.15.2:0/1102124405 learned_addr learned my addr 172.21.15.2:0/1102124405 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff78ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff7980b2450 0x7ff7980cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:55462/0 (socket says 172.21.15.2:55462) 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff78f7fe640 1 -- 172.21.15.2:0/1102124405 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470373343 0 0) 0x7ff7980cdd30 con 0x7ff798160ab0 2023-11-25T04:08:47.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff78f7fe640 1 -- 172.21.15.2:0/1102124405 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff780003520 con 0x7ff798160ab0 2023-11-25T04:08:47.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79d5ce640 1 -- 172.21.15.2:0/1102124405 >> v2:172.21.15.66:3300/0 conn(0x7ff7980b2450 msgr2=0x7ff7980cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:47.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79d5ce640 1 --2- 172.21.15.2:0/1102124405 >> v2:172.21.15.66:3300/0 conn(0x7ff7980b2450 0x7ff7980cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79d5ce640 1 -- 172.21.15.2:0/1102124405 >> v1:172.21.15.66:6789/0 conn(0x7ff798160ab0 legacy=0x7ff7980afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff79d5ce640 1 -- 172.21.15.2:0/1102124405 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7980d04d0 con 0x7ff7980d0030 2023-11-25T04:08:47.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.914+0000 7ff78ffff640 1 --2- 172.21.15.2:0/1102124405 >> v2:172.21.15.66:3300/0 conn(0x7ff7980b2450 0x7ff7980cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:47.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.915+0000 7ff79d5ce640 1 --2- 172.21.15.2:0/1102124405 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff7980d1450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff790009e50 tx=0x7ff79002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce715977adb205e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:47.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.915+0000 7ff78f7fe640 1 -- 172.21.15.2:0/1102124405 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79002ca70 con 0x7ff7980d0030 2023-11-25T04:08:47.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.915+0000 7ff78f7fe640 1 -- 172.21.15.2:0/1102124405 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79002cbd0 con 0x7ff7980d0030 2023-11-25T04:08:47.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.915+0000 7ff78f7fe640 1 -- 172.21.15.2:0/1102124405 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7900343f0 con 0x7ff7980d0030 2023-11-25T04:08:47.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.916+0000 7ff79f031640 1 -- 172.21.15.2:0/1102124405 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 msgr2=0x7ff7980d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.916+0000 7ff79f031640 1 --2- 172.21.15.2:0/1102124405 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff7980d1450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff790009e50 tx=0x7ff79002bed0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.916+0000 7ff79f031640 1 -- 172.21.15.2:0/1102124405 shutdown_connections 2023-11-25T04:08:47.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.916+0000 7ff79f031640 1 --2- 172.21.15.2:0/1102124405 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff7980d1450 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.916+0000 7ff79f031640 1 --2- 172.21.15.2:0/1102124405 >> v2:172.21.15.66:3300/0 conn(0x7ff7980b2450 0x7ff7980cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.916+0000 7ff79f031640 1 -- 172.21.15.2:0/1102124405 >> 172.21.15.2:0/1102124405 conn(0x7ff79809c450 msgr2=0x7ff7980d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:47.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.916+0000 7ff79f031640 1 -- 172.21.15.2:0/1102124405 shutdown_connections 2023-11-25T04:08:47.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.916+0000 7ff79f031640 1 -- 172.21.15.2:0/1102124405 wait complete. 2023-11-25T04:08:47.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.917+0000 7ff79f031640 1 Processor -- start 2023-11-25T04:08:47.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.917+0000 7ff79f031640 1 -- start start 2023-11-25T04:08:47.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79f031640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7980b2450 0x7ff798156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79f031640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff79815f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79f031640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff798160ab0 0x7ff79815fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79f031640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff798157250 con 0x7ff7980b2450 2023-11-25T04:08:47.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79f031640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7981f6e30 con 0x7ff798160ab0 2023-11-25T04:08:47.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79f031640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7981f7110 con 0x7ff7980d0030 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79cdcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7980b2450 0x7ff798156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79cdcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7980b2450 0x7ff798156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53594/0 (socket says 172.21.15.2:53594) 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79cdcd640 1 -- 172.21.15.2:0/3158618317 learned_addr learned my addr 172.21.15.2:0/3158618317 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff79d5ce640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff798160ab0 0x7ff79815fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.918+0000 7ff78ffff640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff79815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff79cdcd640 1 -- 172.21.15.2:0/3158618317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 msgr2=0x7ff79815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff79cdcd640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff79815f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff79cdcd640 1 -- 172.21.15.2:0/3158618317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff798160ab0 msgr2=0x7ff79815fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff79cdcd640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff798160ab0 0x7ff79815fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff79cdcd640 1 -- 172.21.15.2:0/3158618317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff788009400 con 0x7ff7980b2450 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff79cdcd640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7980b2450 0x7ff798156d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff79400c390 tx=0x7ff79400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:47.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff78d7fa640 1 -- 172.21.15.2:0/3158618317 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7940074e0 con 0x7ff7980b2450 2023-11-25T04:08:47.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff78d7fa640 1 -- 172.21.15.2:0/3158618317 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff794007660 con 0x7ff7980b2450 2023-11-25T04:08:47.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff78d7fa640 1 -- 172.21.15.2:0/3158618317 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff794004a20 con 0x7ff7980b2450 2023-11-25T04:08:47.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff790009b30 con 0x7ff7980b2450 2023-11-25T04:08:47.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.919+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7981f76d0 con 0x7ff7980b2450 2023-11-25T04:08:47.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.920+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7980b7010 con 0x7ff7980b2450 2023-11-25T04:08:47.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.920+0000 7ff78d7fa640 1 -- 172.21.15.2:0/3158618317 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff794004b80 con 0x7ff7980b2450 2023-11-25T04:08:47.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.921+0000 7ff78d7fa640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff78406ae40 0x7ff78406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:47.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.921+0000 7ff78d7fa640 1 -- 172.21.15.2:0/3158618317 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff794088fd0 con 0x7ff7980b2450 2023-11-25T04:08:47.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.921+0000 7ff78ffff640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff78406ae40 0x7ff78406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:47.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.921+0000 7ff78ffff640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff78406ae40 0x7ff78406d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff7981f7ef0 tx=0x7ff788009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:47.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:47.925+0000 7ff78d7fa640 1 -- 172.21.15.2:0/3158618317 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff7980b7010 con 0x7ff7980b2450 2023-11-25T04:08:48.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.136+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7980b7010 con 0x7ff7980b2450 2023-11-25T04:08:48.139 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.137+0000 7ff78d7fa640 1 -- 172.21.15.2:0/3158618317 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7ff794057b60 con 0x7ff7980b2450 2023-11-25T04:08:48.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:48.139 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1227253459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1227253459},{"type":"v1","addr":"172.21.15.66:6835","nonce":1227253459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3032459629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3032459629},{"type":"v1","addr":"172.21.15.2:6835","nonce":3032459629}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:08:35.512348+0000","modified":"2023-11-25T04:08:38.534749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/1650670057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1650670057},{"type":"v1","addr":"172.21.15.66:6833","nonce":1650670057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-25T04:08:48.139 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-25T04:08:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff78406ae40 msgr2=0x7ff78406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff78406ae40 0x7ff78406d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff7981f7ef0 tx=0x7ff788009190 comp rx=0 tx=0).stop 2023-11-25T04:08:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7980b2450 msgr2=0x7ff798156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7980b2450 0x7ff798156d10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff79400c390 tx=0x7ff79400c850 comp rx=0 tx=0).stop 2023-11-25T04:08:48.141 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 shutdown_connections 2023-11-25T04:08:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff78406ae40 0x7ff78406d300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff798160ab0 0x7ff79815fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7980d0030 0x7ff79815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 --2- 172.21.15.2:0/3158618317 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7980b2450 0x7ff798156d10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 >> 172.21.15.2:0/3158618317 conn(0x7ff79809c450 msgr2=0x7ff79806c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 shutdown_connections 2023-11-25T04:08:48.142 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.139+0000 7ff79f031640 1 -- 172.21.15.2:0/3158618317 wait complete. 2023-11-25T04:08:48.152 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:48.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.257+0000 7f4e95eee640 1 Processor -- start 2023-11-25T04:08:48.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.257+0000 7f4e95eee640 1 -- start start 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.258+0000 7f4e95eee640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4e9015d800 0x7f4e9006cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.258+0000 7f4e95eee640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9006e9e0 con 0x7f4e9006a8b0 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.258+0000 7f4e95eee640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9006de60 con 0x7f4e900b2690 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.258+0000 7f4e95eee640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9006d2e0 con 0x7f4e9015d800 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.258+0000 7f4e8ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4e9006a8b0 0x7f4e9006ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33110/0 (socket says 172.21.15.2:33110) 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.258+0000 7f4e8ffff640 1 -- 172.21.15.2:0/2571342554 learned_addr learned my addr 172.21.15.2:0/2571342554 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.258+0000 7f4e8effd640 1 --2- 172.21.15.2:0/2571342554 >> v2:172.21.15.66:3300/0 conn(0x7f4e9015d800 0x7f4e9006cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.258+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380032579 0 0) 0x7f4e9006e9e0 con 0x7f4e9006a8b0 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.258+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e78003520 con 0x7f4e9006a8b0 2023-11-25T04:08:48.263 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 903841837 0 0) 0x7f4e78003520 con 0x7f4e9006a8b0 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 >> v2:172.21.15.66:3300/0 conn(0x7f4e9015d800 msgr2=0x7f4e9006cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 --2- 172.21.15.2:0/2571342554 >> v2:172.21.15.66:3300/0 conn(0x7f4e9015d800 0x7f4e9006cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 >> v1:172.21.15.66:6789/0 conn(0x7f4e900b2690 legacy=0x7f4e900b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9006d5c0 con 0x7f4e9006a8b0 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f4e880019f0 con 0x7f4e9006a8b0 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 >> v1:172.21.15.2:6789/0 conn(0x7f4e9006a8b0 legacy=0x7f4e9006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e78003970 0x7f4e78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e780047c0 0x7f4e78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e78005180 0x7f4e7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9006d2e0 con 0x7f4e78005180 2023-11-25T04:08:48.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7800c120 con 0x7f4e78003970 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7800c2e0 con 0x7f4e780047c0 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8ffff640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e78005180 0x7f4e7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8effd640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e780047c0 0x7f4e78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8f7fe640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e78003970 0x7f4e78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8ffff640 1 -- 172.21.15.2:0/2571342554 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e780047c0 msgr2=0x7f4e78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8ffff640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e780047c0 0x7f4e78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8ffff640 1 -- 172.21.15.2:0/2571342554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e78003970 msgr2=0x7f4e78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8ffff640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e78003970 0x7f4e78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.259+0000 7f4e8ffff640 1 -- 172.21.15.2:0/2571342554 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e78003520 con 0x7f4e78005180 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.260+0000 7f4e8ffff640 1 -- 172.21.15.2:0/2571342554 reap_dead start 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.260+0000 7f4e8ffff640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e78005180 0x7f4e7800b980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800a830 tx=0x7f4e780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad688c71a0196c5f server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:48.265 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.260+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e880072d0 con 0x7f4e78005180 2023-11-25T04:08:48.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.260+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8802f070 con 0x7f4e78005180 2023-11-25T04:08:48.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.260+0000 7f4e8e7fc640 1 -- 172.21.15.2:0/2571342554 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e880076b0 con 0x7f4e78005180 2023-11-25T04:08:48.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.261+0000 7f4e95eee640 1 -- 172.21.15.2:0/2571342554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e78005180 msgr2=0x7f4e7800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.261+0000 7f4e95eee640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e78005180 0x7f4e7800b980 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4e8800a830 tx=0x7f4e780057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.261+0000 7f4e95eee640 1 -- 172.21.15.2:0/2571342554 shutdown_connections 2023-11-25T04:08:48.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.261+0000 7f4e95eee640 1 --2- 172.21.15.2:0/2571342554 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e78005180 0x7f4e7800b980 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.261+0000 7f4e95eee640 1 -- 172.21.15.2:0/2571342554 >> 172.21.15.2:0/2571342554 conn(0x7f4e900cf6a0 msgr2=0x7f4e900cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:48.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.261+0000 7f4e95eee640 1 -- 172.21.15.2:0/2571342554 shutdown_connections 2023-11-25T04:08:48.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.261+0000 7f4e95eee640 1 -- 172.21.15.2:0/2571342554 wait complete. 2023-11-25T04:08:48.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.262+0000 7f4e95eee640 1 Processor -- start 2023-11-25T04:08:48.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.262+0000 7f4e95eee640 1 -- start start 2023-11-25T04:08:48.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e95eee640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e78005180 0x7f4e90153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e95eee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e90155f80 0x7f4e90156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e95eee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e90153b40 0x7f4e90153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e95eee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90156940 con 0x7f4e90155f80 2023-11-25T04:08:48.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e95eee640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e90153790 con 0x7f4e90153b40 2023-11-25T04:08:48.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e95eee640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e901548c0 con 0x7f4e78005180 2023-11-25T04:08:48.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e90155f80 0x7f4e90156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e90155f80 0x7f4e90156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:53618/0 (socket says 172.21.15.2:53618) 2023-11-25T04:08:48.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8effd640 1 -- 172.21.15.2:0/1550813182 learned_addr learned my addr 172.21.15.2:0/1550813182 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:48.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8ffff640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e90153b40 0x7f4e90153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8f7fe640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e78005180 0x7f4e90153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8effd640 1 -- 172.21.15.2:0/1550813182 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e78005180 msgr2=0x7f4e90153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8effd640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e78005180 0x7f4e90153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8effd640 1 -- 172.21.15.2:0/1550813182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e90153b40 msgr2=0x7f4e90153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8effd640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e90153b40 0x7f4e90153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8effd640 1 -- 172.21.15.2:0/1550813182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e90154ba0 con 0x7f4e90155f80 2023-11-25T04:08:48.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e8effd640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e90155f80 0x7f4e90156400 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e840118e0 tx=0x7f4e84011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:48.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e77fff640 1 -- 172.21.15.2:0/1550813182 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8400faf0 con 0x7f4e90155f80 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e77fff640 1 -- 172.21.15.2:0/1550813182 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8400fc50 con 0x7f4e90155f80 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e90154e80 con 0x7f4e90155f80 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e77fff640 1 -- 172.21.15.2:0/1550813182 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e84014440 con 0x7f4e90155f80 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.263+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e90155440 con 0x7f4e90155f80 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.264+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e90067420 con 0x7f4e90155f80 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.265+0000 7f4e77fff640 1 -- 172.21.15.2:0/1550813182 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4e840145a0 con 0x7f4e90155f80 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.265+0000 7f4e77fff640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4e7c06ae70 0x7f4e7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.265+0000 7f4e77fff640 1 -- 172.21.15.2:0/1550813182 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e84089df0 con 0x7f4e90155f80 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.265+0000 7f4e8f7fe640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4e7c06ae70 0x7f4e7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.266+0000 7f4e8f7fe640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4e7c06ae70 0x7f4e7c06d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e80000c00 tx=0x7f4e80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:48.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.270+0000 7f4e77fff640 1 -- 172.21.15.2:0/1550813182 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4e84054f30 con 0x7f4e90155f80 2023-11-25T04:08:48.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.445+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e90073580 con 0x7f4e90155f80 2023-11-25T04:08:48.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.446+0000 7f4e77fff640 1 -- 172.21.15.2:0/1550813182 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f4e84058550 con 0x7f4e90155f80 2023-11-25T04:08:48.449 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:48.449 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4e7c06ae70 msgr2=0x7f4e7c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4e7c06ae70 0x7f4e7c06d330 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e80000c00 tx=0x7f4e80009040 comp rx=0 tx=0).stop 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e90155f80 msgr2=0x7f4e90156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e90155f80 0x7f4e90156400 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4e840118e0 tx=0x7f4e84011da0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 shutdown_connections 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4e7c06ae70 0x7f4e7c06d330 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e90153b40 0x7f4e90153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4e90155f80 0x7f4e90156400 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 --2- 172.21.15.2:0/1550813182 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e78005180 0x7f4e90153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 >> 172.21.15.2:0/1550813182 conn(0x7f4e900cf6a0 msgr2=0x7f4e900b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 shutdown_connections 2023-11-25T04:08:48.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.448+0000 7f4e95eee640 1 -- 172.21.15.2:0/1550813182 wait complete. 2023-11-25T04:08:48.461 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:08:48.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:08:48.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.569+0000 7f9e153c9640 1 Processor -- start 2023-11-25T04:08:48.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.569+0000 7f9e153c9640 1 -- start start 2023-11-25T04:08:48.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.569+0000 7f9e153c9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9e10144a50 0x7f9e1015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.569+0000 7f9e153c9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e100b2ee0 con 0x7f9e1006a4d0 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e153c9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e100b34a0 con 0x7f9e100b5d60 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e153c9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e10144e30 con 0x7f9e10144a50 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0e7fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9e1006a4d0 0x7f9e100cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:33124/0 (socket says 172.21.15.2:33124) 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0e7fc640 1 -- 172.21.15.2:0/1699471474 learned_addr learned my addr 172.21.15.2:0/1699471474 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0effd640 1 --2- 172.21.15.2:0/1699471474 >> v2:172.21.15.66:3300/0 conn(0x7f9e10144a50 0x7f9e1015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029089456 0 0) 0x7f9e100b2ee0 con 0x7f9e1006a4d0 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dfc003520 con 0x7f9e1006a4d0 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223287560 0 0) 0x7f9dfc003520 con 0x7f9e1006a4d0 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 >> v2:172.21.15.66:3300/0 conn(0x7f9e10144a50 msgr2=0x7f9e1015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:48.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 --2- 172.21.15.2:0/1699471474 >> v2:172.21.15.66:3300/0 conn(0x7f9e10144a50 0x7f9e1015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 >> v1:172.21.15.66:6789/0 conn(0x7f9e100b5d60 legacy=0x7f9e100d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1015fbc0 con 0x7f9e1006a4d0 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f9df8001670 con 0x7f9e1006a4d0 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 >> v1:172.21.15.2:6789/0 conn(0x7f9e1006a4d0 legacy=0x7f9e100cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9dfc003970 0x7f9dfc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dfc0047c0 0x7f9dfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc005180 0x7f9dfc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10144e30 con 0x7f9dfc005180 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc00c020 con 0x7f9dfc0047c0 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc00c1e0 con 0x7f9dfc003970 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0f7fe640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc005180 0x7f9dfc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.570+0000 7f9e0effd640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9dfc003970 0x7f9dfc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0e7fc640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dfc0047c0 0x7f9dfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0effd640 1 -- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dfc0047c0 msgr2=0x7f9dfc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0effd640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dfc0047c0 0x7f9dfc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0effd640 1 -- 172.21.15.2:0/1699471474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc005180 msgr2=0x7f9dfc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0effd640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc005180 0x7f9dfc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0effd640 1 -- 172.21.15.2:0/1699471474 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc003520 con 0x7f9dfc003970 2023-11-25T04:08:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0f7fe640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc005180 0x7f9dfc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0e7fc640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9dfc0047c0 0x7f9dfc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:48.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0f7fe640 1 -- 172.21.15.2:0/1699471474 reap_dead start 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.571+0000 7f9e0effd640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9dfc003970 0x7f9dfc003d90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009ac0 tx=0x7f9dfc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4f1bf9de2f2b900 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0802c6b0 con 0x7f9dfc003970 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0802c810 con 0x7f9dfc003970 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e0dffb640 1 -- 172.21.15.2:0/1699471474 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0802cba0 con 0x7f9dfc003970 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e153c9640 1 -- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9dfc003970 msgr2=0x7f9dfc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e153c9640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9dfc003970 0x7f9dfc003d90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009ac0 tx=0x7f9dfc0057f0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e153c9640 1 -- 172.21.15.2:0/1699471474 shutdown_connections 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e153c9640 1 --2- 172.21.15.2:0/1699471474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9dfc003970 0x7f9dfc003d90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e153c9640 1 -- 172.21.15.2:0/1699471474 >> 172.21.15.2:0/1699471474 conn(0x7f9e100cc930 msgr2=0x7f9e100ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e153c9640 1 -- 172.21.15.2:0/1699471474 shutdown_connections 2023-11-25T04:08:48.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.572+0000 7f9e153c9640 1 -- 172.21.15.2:0/1699471474 wait complete. 2023-11-25T04:08:48.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e153c9640 1 Processor -- start 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e153c9640 1 -- start start 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e153c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc003970 0x7f9e1015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e153c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100ce800 0x7f9e100cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e153c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e100adc90 0x7f9e100ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e153c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e100ae650 con 0x7f9dfc003970 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e153c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1015ab00 con 0x7f9e100ce800 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e153c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1015e100 con 0x7f9e100adc90 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc003970 0x7f9e1015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e0effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc003970 0x7f9e1015a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44584/0 (socket says 172.21.15.2:44584) 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.574+0000 7f9e0effd640 1 -- 172.21.15.2:0/776056551 learned_addr learned my addr 172.21.15.2:0/776056551 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:48.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e0f7fe640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e100adc90 0x7f9e100ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e0e7fc640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100ce800 0x7f9e100cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e0effd640 1 -- 172.21.15.2:0/776056551 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e100adc90 msgr2=0x7f9e100ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e0effd640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e100adc90 0x7f9e100ae110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e0effd640 1 -- 172.21.15.2:0/776056551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100ce800 msgr2=0x7f9e100cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e0effd640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100ce800 0x7f9e100cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e0effd640 1 -- 172.21.15.2:0/776056551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e1015d4f0 con 0x7f9dfc003970 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e0e7fc640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100ce800 0x7f9e100cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e0effd640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc003970 0x7f9e1015a5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009ac0 tx=0x7f9e08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e077fe640 1 -- 172.21.15.2:0/776056551 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08003810 con 0x7f9dfc003970 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e077fe640 1 -- 172.21.15.2:0/776056551 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e08003970 con 0x7f9dfc003970 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e1015d7d0 con 0x7f9dfc003970 2023-11-25T04:08:48.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e077fe640 1 -- 172.21.15.2:0/776056551 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e08003d00 con 0x7f9dfc003970 2023-11-25T04:08:48.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.575+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1015dd90 con 0x7f9dfc003970 2023-11-25T04:08:48.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.576+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1006e6a0 con 0x7f9dfc003970 2023-11-25T04:08:48.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.576+0000 7f9e077fe640 1 -- 172.21.15.2:0/776056551 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e08040450 con 0x7f9dfc003970 2023-11-25T04:08:48.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.577+0000 7f9e077fe640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9df006ae40 0x7f9df006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.577+0000 7f9e077fe640 1 -- 172.21.15.2:0/776056551 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e080aba20 con 0x7f9dfc003970 2023-11-25T04:08:48.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.577+0000 7f9e0e7fc640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9df006ae40 0x7f9df006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.577+0000 7f9e0e7fc640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9df006ae40 0x7f9df006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9df8000f60 tx=0x7f9df8000ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:48.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.581+0000 7f9e077fe640 1 -- 172.21.15.2:0/776056551 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e08076b50 con 0x7f9dfc003970 2023-11-25T04:08:48.758 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.756+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e1004e920 con 0x7f9dfc003970 2023-11-25T04:08:48.759 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.756+0000 7f9e077fe640 1 -- 172.21.15.2:0/776056551 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e08003e60 con 0x7f9dfc003970 2023-11-25T04:08:48.759 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:08:48.760 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9df006ae40 msgr2=0x7f9df006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9df006ae40 0x7f9df006d300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9df8000f60 tx=0x7f9df8000ef0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc003970 msgr2=0x7f9e1015a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc003970 0x7f9e1015a5c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009ac0 tx=0x7f9e08004730 comp rx=0 tx=0).stop 2023-11-25T04:08:48.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 shutdown_connections 2023-11-25T04:08:48.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e100adc90 0x7f9e100ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.761 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9df006ae40 0x7f9df006d300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e100ce800 0x7f9e100cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.762 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 --2- 172.21.15.2:0/776056551 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9dfc003970 0x7f9e1015a5c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 >> 172.21.15.2:0/776056551 conn(0x7f9e100cc930 msgr2=0x7f9e10071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 shutdown_connections 2023-11-25T04:08:48.763 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.758+0000 7f9e153c9640 1 -- 172.21.15.2:0/776056551 wait complete. 2023-11-25T04:08:48.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:08:48.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.879+0000 7f4b4491d640 1 Processor -- start 2023-11-25T04:08:48.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.879+0000 7f4b4491d640 1 -- start start 2023-11-25T04:08:48.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.879+0000 7f4b4491d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4b400b6b50 0x7f4b400cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b4491d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b4006bc50 0x7f4b4006c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b4491d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b400b3590 con 0x7f4b40099970 2023-11-25T04:08:48.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b4491d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4006b310 con 0x7f4b4006bc50 2023-11-25T04:08:48.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b4491d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b400cd3a0 con 0x7f4b400b6b50 2023-11-25T04:08:48.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b3ed9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b4006bc50 0x7f4b4006c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b3ed9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f4b4006bc50 0x7f4b4006c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44588/0 (socket says 172.21.15.2:44588) 2023-11-25T04:08:48.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/3948636262 learned_addr learned my addr 172.21.15.2:0/3948636262 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:48.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/3948636262 >> v2:172.21.15.66:3300/0 conn(0x7f4b400b6b50 0x7f4b400cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/3948636262 >> v2:172.21.15.66:3300/0 conn(0x7f4b400b6b50 msgr2=0x7f4b400cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:48.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/3948636262 >> v2:172.21.15.66:3300/0 conn(0x7f4b400b6b50 0x7f4b400cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/3948636262 >> v1:172.21.15.66:6789/0 conn(0x7f4b40099970 legacy=0x7f4b40099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:48.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.880+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/3948636262 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b400b37c0 con 0x7f4b4006bc50 2023-11-25T04:08:48.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/3948636262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b4006bc50 0x7f4b4006c100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b40071790 tx=0x7f4b3802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdbe67774811974 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:48.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b3dd9b640 1 -- 172.21.15.2:0/3948636262 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3802cb20 con 0x7f4b4006bc50 2023-11-25T04:08:48.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b3dd9b640 1 -- 172.21.15.2:0/3948636262 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3802cc80 con 0x7f4b4006bc50 2023-11-25T04:08:48.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b3dd9b640 1 -- 172.21.15.2:0/3948636262 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b380343f0 con 0x7f4b4006bc50 2023-11-25T04:08:48.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b4491d640 1 -- 172.21.15.2:0/3948636262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b4006bc50 msgr2=0x7f4b4006c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b4491d640 1 --2- 172.21.15.2:0/3948636262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b4006bc50 0x7f4b4006c100 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4b40071790 tx=0x7f4b3802bf80 comp rx=0 tx=0).stop 2023-11-25T04:08:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b4491d640 1 -- 172.21.15.2:0/3948636262 shutdown_connections 2023-11-25T04:08:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b4491d640 1 --2- 172.21.15.2:0/3948636262 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b4006bc50 0x7f4b4006c100 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b4491d640 1 --2- 172.21.15.2:0/3948636262 >> v2:172.21.15.66:3300/0 conn(0x7f4b400b6b50 0x7f4b400cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b4491d640 1 -- 172.21.15.2:0/3948636262 >> 172.21.15.2:0/3948636262 conn(0x7f4b400b2a70 msgr2=0x7f4b400b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b4491d640 1 -- 172.21.15.2:0/3948636262 shutdown_connections 2023-11-25T04:08:48.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.881+0000 7f4b4491d640 1 -- 172.21.15.2:0/3948636262 wait complete. 2023-11-25T04:08:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.883+0000 7f4b4491d640 1 Processor -- start 2023-11-25T04:08:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.883+0000 7f4b4491d640 1 -- start start 2023-11-25T04:08:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.883+0000 7f4b4491d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b4006bc50 0x7f4b400ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.883+0000 7f4b4491d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b40099970 0x7f4b4014efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.883+0000 7f4b4491d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b400b6b50 0x7f4b4014f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.883+0000 7f4b4491d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b401f42a0 con 0x7f4b400b6b50 2023-11-25T04:08:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.883+0000 7f4b4491d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b400b1a20 con 0x7f4b40099970 2023-11-25T04:08:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.883+0000 7f4b4491d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b400b1740 con 0x7f4b4006bc50 2023-11-25T04:08:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.883+0000 7f4b3ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b400b6b50 0x7f4b4014f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b400b6b50 0x7f4b4014f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44602/0 (socket says 172.21.15.2:44602) 2023-11-25T04:08:48.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/2007165060 learned_addr learned my addr 172.21.15.2:0/2007165060 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b4006bc50 msgr2=0x7f4b400ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b4006bc50 0x7f4b400ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b4006bc50 0x7f4b400ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b37fff640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b40099970 0x7f4b4014efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b40099970 msgr2=0x7f4b4014efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:48.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b40099970 0x7f4b4014efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3ed9d640 1 -- 172.21.15.2:0/2007165060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b38009b30 con 0x7f4b400b6b50 2023-11-25T04:08:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b4006bc50 0x7f4b400ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b37fff640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b40099970 0x7f4b4014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b3ed9d640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b400b6b50 0x7f4b4014f4f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b38036040 tx=0x7f4b38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b36ffd640 1 -- 172.21.15.2:0/2007165060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b38009510 con 0x7f4b400b6b50 2023-11-25T04:08:48.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b36ffd640 1 -- 172.21.15.2:0/2007165060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b38007e50 con 0x7f4b400b6b50 2023-11-25T04:08:48.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b4015f2f0 con 0x7f4b400b6b50 2023-11-25T04:08:48.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b36ffd640 1 -- 172.21.15.2:0/2007165060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3803e690 con 0x7f4b400b6b50 2023-11-25T04:08:48.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.884+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b4015f8b0 con 0x7f4b400b6b50 2023-11-25T04:08:48.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.885+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b4015faa0 con 0x7f4b400b6b50 2023-11-25T04:08:48.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.886+0000 7f4b36ffd640 1 -- 172.21.15.2:0/2007165060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4b3803e7f0 con 0x7f4b400b6b50 2023-11-25T04:08:48.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.886+0000 7f4b36ffd640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4b2006ae40 0x7f4b2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:48.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.886+0000 7f4b36ffd640 1 -- 172.21.15.2:0/2007165060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b380ac260 con 0x7f4b400b6b50 2023-11-25T04:08:48.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.886+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4b2006ae40 0x7f4b2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:48.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.886+0000 7f4b3e59c640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4b2006ae40 0x7f4b2006d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b30006fd0 tx=0x7f4b30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:48.900 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:48.890+0000 7f4b36ffd640 1 -- 172.21.15.2:0/2007165060 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4b38077310 con 0x7f4b400b6b50 2023-11-25T04:08:49.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.065+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b4009ef40 con 0x7f4b400b6b50 2023-11-25T04:08:49.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.065+0000 7f4b36ffd640 1 -- 172.21.15.2:0/2007165060 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b3807fe60 con 0x7f4b400b6b50 2023-11-25T04:08:49.067 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:08:49.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4b2006ae40 msgr2=0x7f4b2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4b2006ae40 0x7f4b2006d300 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4b30006fd0 tx=0x7f4b30008040 comp rx=0 tx=0).stop 2023-11-25T04:08:49.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b400b6b50 msgr2=0x7f4b4014f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b400b6b50 0x7f4b4014f4f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4b38036040 tx=0x7f4b38004a40 comp rx=0 tx=0).stop 2023-11-25T04:08:49.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 shutdown_connections 2023-11-25T04:08:49.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4b400b6b50 0x7f4b4014f4f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4b2006ae40 0x7f4b2006d300 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b40099970 0x7f4b4014efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 --2- 172.21.15.2:0/2007165060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b4006bc50 0x7f4b400ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 >> 172.21.15.2:0/2007165060 conn(0x7f4b400b2a70 msgr2=0x7f4b400b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:49.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 shutdown_connections 2023-11-25T04:08:49.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.067+0000 7f4b4491d640 1 -- 172.21.15.2:0/2007165060 wait complete. 2023-11-25T04:08:49.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:08:49.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.187+0000 7fe4012bb640 1 Processor -- start 2023-11-25T04:08:49.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.187+0000 7fe4012bb640 1 -- start start 2023-11-25T04:08:49.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe4012bb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc06ec60 0x7fe3fc15e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe4012bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe3fc15d690 0x7fe3fc06f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe4012bb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc09a720 con 0x7fe3fc06e460 2023-11-25T04:08:49.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe4012bb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc15e9d0 con 0x7fe3fc15d690 2023-11-25T04:08:49.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe4012bb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc06f580 con 0x7fe3fc06ec60 2023-11-25T04:08:49.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe3f27fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe3fc15d690 0x7fe3fc06f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe3fb7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe3fc06e460 0x7fe3fc160f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59526/0 (socket says 172.21.15.2:59526) 2023-11-25T04:08:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe3fb7fe640 1 -- 172.21.15.2:0/817618698 learned_addr learned my addr 172.21.15.2:0/817618698 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe3faffd640 1 --2- 172.21.15.2:0/817618698 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc06ec60 0x7fe3fc15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe3f27fc640 1 -- 172.21.15.2:0/817618698 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc06ec60 msgr2=0x7fe3fc15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe3f27fc640 1 --2- 172.21.15.2:0/817618698 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc06ec60 0x7fe3fc15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe3f27fc640 1 -- 172.21.15.2:0/817618698 >> v1:172.21.15.2:6789/0 conn(0x7fe3fc06e460 legacy=0x7fe3fc160f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe3f27fc640 1 -- 172.21.15.2:0/817618698 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc099b10 con 0x7fe3fc15d690 2023-11-25T04:08:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.188+0000 7fe3fa7fc640 1 -- 172.21.15.2:0/817618698 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847995201 0 0) 0x7fe3fc09a720 con 0x7fe3fc06e460 2023-11-25T04:08:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.189+0000 7fe3f27fc640 1 --2- 172.21.15.2:0/817618698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc15d690 0x7fe3fc06f040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40097a0 tx=0x7fe3e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3030289592b0f071 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.189+0000 7fe3fa7fc640 1 -- 172.21.15.2:0/817618698 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e402e070 con 0x7fe3fc15d690 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.189+0000 7fe3fa7fc640 1 -- 172.21.15.2:0/817618698 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e40315a0 con 0x7fe3fc15d690 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.189+0000 7fe3fa7fc640 1 -- 172.21.15.2:0/817618698 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4031930 con 0x7fe3fc15d690 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.189+0000 7fe4012bb640 1 -- 172.21.15.2:0/817618698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc15d690 msgr2=0x7fe3fc06f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.189+0000 7fe4012bb640 1 --2- 172.21.15.2:0/817618698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc15d690 0x7fe3fc06f040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe3e40097a0 tx=0x7fe3e402b840 comp rx=0 tx=0).stop 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.190+0000 7fe4012bb640 1 -- 172.21.15.2:0/817618698 shutdown_connections 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.190+0000 7fe4012bb640 1 --2- 172.21.15.2:0/817618698 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc15d690 0x7fe3fc06f040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.190+0000 7fe4012bb640 1 --2- 172.21.15.2:0/817618698 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc06ec60 0x7fe3fc15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.190+0000 7fe4012bb640 1 -- 172.21.15.2:0/817618698 >> 172.21.15.2:0/817618698 conn(0x7fe3fc0b2a20 msgr2=0x7fe3fc0b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.190+0000 7fe4012bb640 1 -- 172.21.15.2:0/817618698 shutdown_connections 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.190+0000 7fe4012bb640 1 -- 172.21.15.2:0/817618698 wait complete. 2023-11-25T04:08:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.191+0000 7fe4012bb640 1 Processor -- start 2023-11-25T04:08:49.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.191+0000 7fe4012bb640 1 -- start start 2023-11-25T04:08:49.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe4012bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3fc06e460 0x7fe3fc154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe4012bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc06ec60 0x7fe3fc15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe4012bb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc15f050 0x7fe3fc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe4012bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c59a0 con 0x7fe3fc06ec60 2023-11-25T04:08:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe4012bb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc161960 con 0x7fe3fc06e460 2023-11-25T04:08:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe4012bb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c4a40 con 0x7fe3fc15f050 2023-11-25T04:08:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc06ec60 0x7fe3fc15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f27fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc06ec60 0x7fe3fc15eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44620/0 (socket says 172.21.15.2:44620) 2023-11-25T04:08:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f27fc640 1 -- 172.21.15.2:0/2284966847 learned_addr learned my addr 172.21.15.2:0/2284966847 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3fb7fe640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc15f050 0x7fe3fc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f27fc640 1 -- 172.21.15.2:0/2284966847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc15f050 msgr2=0x7fe3fc15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f27fc640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc15f050 0x7fe3fc15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f27fc640 1 -- 172.21.15.2:0/2284966847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3fc06e460 msgr2=0x7fe3fc154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3faffd640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3fc06e460 0x7fe3fc154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f27fc640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3fc06e460 0x7fe3fc154fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f27fc640 1 -- 172.21.15.2:0/2284966847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e4009400 con 0x7fe3fc06ec60 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f27fc640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc06ec60 0x7fe3fc15eb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4034040 tx=0x7fe3e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f3fff640 1 -- 172.21.15.2:0/2284966847 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4032840 con 0x7fe3fc06ec60 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f3fff640 1 -- 172.21.15.2:0/2284966847 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e40329a0 con 0x7fe3fc06ec60 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc0c4d20 con 0x7fe3fc06ec60 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.192+0000 7fe3f3fff640 1 -- 172.21.15.2:0/2284966847 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e4032d50 con 0x7fe3fc06ec60 2023-11-25T04:08:49.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.193+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc0c52e0 con 0x7fe3fc06ec60 2023-11-25T04:08:49.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.193+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3fc0c5ae0 con 0x7fe3fc06ec60 2023-11-25T04:08:49.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.194+0000 7fe3f3fff640 1 -- 172.21.15.2:0/2284966847 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3e404e430 con 0x7fe3fc06ec60 2023-11-25T04:08:49.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.194+0000 7fe3f3fff640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3dc06ae40 0x7fe3dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.194+0000 7fe3faffd640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3dc06ae40 0x7fe3dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.194+0000 7fe3f3fff640 1 -- 172.21.15.2:0/2284966847 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3e40ab580 con 0x7fe3fc06ec60 2023-11-25T04:08:49.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.195+0000 7fe3faffd640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3dc06ae40 0x7fe3dc06d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec006fd0 tx=0x7fe3ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:49.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.198+0000 7fe3f3fff640 1 -- 172.21.15.2:0/2284966847 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3fc0c5ae0 con 0x7fe3fc06ec60 2023-11-25T04:08:49.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.373+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3fc0c5ae0 con 0x7fe3fc06ec60 2023-11-25T04:08:49.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.374+0000 7fe3f3fff640 1 -- 172.21.15.2:0/2284966847 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3fc0c5ae0 con 0x7fe3fc06ec60 2023-11-25T04:08:49.376 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:08:49.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3dc06ae40 msgr2=0x7fe3dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3dc06ae40 0x7fe3dc06d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec006fd0 tx=0x7fe3ec008040 comp rx=0 tx=0).stop 2023-11-25T04:08:49.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc06ec60 msgr2=0x7fe3fc15eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc06ec60 0x7fe3fc15eb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4034040 tx=0x7fe3e40046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 shutdown_connections 2023-11-25T04:08:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3fc15f050 0x7fe3fc15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe3fc06ec60 0x7fe3fc15eb10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3dc06ae40 0x7fe3dc06d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 --2- 172.21.15.2:0/2284966847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3fc06e460 0x7fe3fc154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 >> 172.21.15.2:0/2284966847 conn(0x7fe3fc0b2a20 msgr2=0x7fe3fc06cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 shutdown_connections 2023-11-25T04:08:49.379 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.376+0000 7fe4012bb640 1 -- 172.21.15.2:0/2284966847 wait complete. 2023-11-25T04:08:49.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:08:49.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.494+0000 7f622a23d640 1 Processor -- start 2023-11-25T04:08:49.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.494+0000 7f622a23d640 1 -- start start 2023-11-25T04:08:49.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f622a23d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6224160ab0 0x7f62240afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f622a23d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240cdd30 con 0x7f62240d1450 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f622a23d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62240ce2d0 con 0x7f62240b2450 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f622a23d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240d0a90 con 0x7f6224160ab0 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f6223fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f62240d1450 0x7f62240ce760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59528/0 (socket says 172.21.15.2:59528) 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f6223fff640 1 -- 172.21.15.2:0/2709912295 learned_addr learned my addr 172.21.15.2:0/2709912295 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f62237fe640 1 --2- 172.21.15.2:0/2709912295 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6224160ab0 0x7f62240afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f62227fc640 1 -- 172.21.15.2:0/2709912295 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117659459 0 0) 0x7f62240cdd30 con 0x7f62240d1450 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f62227fc640 1 -- 172.21.15.2:0/2709912295 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f620c003520 con 0x7f62240d1450 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f62237fe640 1 -- 172.21.15.2:0/2709912295 >> v1:172.21.15.66:6789/0 conn(0x7f62240b2450 legacy=0x7f62240cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f62237fe640 1 -- 172.21.15.2:0/2709912295 >> v1:172.21.15.2:6789/0 conn(0x7f62240d1450 legacy=0x7f62240ce760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.495+0000 7f62227fc640 1 -- 172.21.15.2:0/2709912295 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1575973330 0 0) 0x7f620c003520 con 0x7f62240d1450 2023-11-25T04:08:49.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.496+0000 7f62237fe640 1 -- 172.21.15.2:0/2709912295 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240b02f0 con 0x7f6224160ab0 2023-11-25T04:08:49.499 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.496+0000 7f62237fe640 1 --2- 172.21.15.2:0/2709912295 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6224160ab0 0x7f62240afdb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f62140097d0 tx=0x7f621402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf19498cadf53af8 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.496+0000 7f62227fc640 1 -- 172.21.15.2:0/2709912295 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c0019f0 con 0x7f6224160ab0 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.497+0000 7f62227fc640 1 -- 172.21.15.2:0/2709912295 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621402e050 con 0x7f6224160ab0 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.497+0000 7f62227fc640 1 -- 172.21.15.2:0/2709912295 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214030710 con 0x7f6224160ab0 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.497+0000 7f622a23d640 1 -- 172.21.15.2:0/2709912295 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6224160ab0 msgr2=0x7f62240afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.497+0000 7f622a23d640 1 --2- 172.21.15.2:0/2709912295 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6224160ab0 0x7f62240afdb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f62140097d0 tx=0x7f621402b770 comp rx=0 tx=0).stop 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.497+0000 7f622a23d640 1 -- 172.21.15.2:0/2709912295 shutdown_connections 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.497+0000 7f622a23d640 1 --2- 172.21.15.2:0/2709912295 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6224160ab0 0x7f62240afdb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.497+0000 7f622a23d640 1 -- 172.21.15.2:0/2709912295 >> 172.21.15.2:0/2709912295 conn(0x7f622409c450 msgr2=0x7f62240d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.497+0000 7f622a23d640 1 -- 172.21.15.2:0/2709912295 shutdown_connections 2023-11-25T04:08:49.500 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.497+0000 7f622a23d640 1 -- 172.21.15.2:0/2709912295 wait complete. 2023-11-25T04:08:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.498+0000 7f622a23d640 1 Processor -- start 2023-11-25T04:08:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f622a23d640 1 -- start start 2023-11-25T04:08:49.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f622a23d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62240b2450 0x7f62240ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f622a23d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62240d1450 0x7f6224156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f622a23d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6224160ab0 0x7f6224157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f622a23d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240cc8d0 con 0x7f6224160ab0 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f622a23d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62240cbcc0 con 0x7f62240d1450 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f622a23d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62240cbfa0 con 0x7f62240b2450 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f6223fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6224160ab0 0x7f6224157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f6223fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6224160ab0 0x7f6224157350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44632/0 (socket says 172.21.15.2:44632) 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f6223fff640 1 -- 172.21.15.2:0/3257605920 learned_addr learned my addr 172.21.15.2:0/3257605920 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f62237fe640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62240b2450 0x7f62240ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.499+0000 7f6222ffd640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62240d1450 0x7f6224156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f6223fff640 1 -- 172.21.15.2:0/3257605920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62240b2450 msgr2=0x7f62240ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f6223fff640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62240b2450 0x7f62240ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f6223fff640 1 -- 172.21.15.2:0/3257605920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62240d1450 msgr2=0x7f6224156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f6223fff640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62240d1450 0x7f6224156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f6223fff640 1 -- 172.21.15.2:0/3257605920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6214009400 con 0x7f6224160ab0 2023-11-25T04:08:49.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f6222ffd640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62240d1450 0x7f6224156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:49.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f6223fff640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6224160ab0 0x7f6224157350 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f621c001f70 tx=0x7f621c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:49.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f620bfff640 1 -- 172.21.15.2:0/3257605920 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c012400 con 0x7f6224160ab0 2023-11-25T04:08:49.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62240cc280 con 0x7f6224160ab0 2023-11-25T04:08:49.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f620bfff640 1 -- 172.21.15.2:0/3257605920 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c012560 con 0x7f6224160ab0 2023-11-25T04:08:49.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f620bfff640 1 -- 172.21.15.2:0/3257605920 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c012910 con 0x7f6224160ab0 2023-11-25T04:08:49.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.500+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62240cb7e0 con 0x7f6224160ab0 2023-11-25T04:08:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.501+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62240cca80 con 0x7f6224160ab0 2023-11-25T04:08:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.501+0000 7f620bfff640 1 -- 172.21.15.2:0/3257605920 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f621c012a70 con 0x7f6224160ab0 2023-11-25T04:08:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.502+0000 7f620bfff640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f621006ae40 0x7f621006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.502+0000 7f62237fe640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f621006ae40 0x7f621006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.502+0000 7f620bfff640 1 -- 172.21.15.2:0/3257605920 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f621c089db0 con 0x7f6224160ab0 2023-11-25T04:08:49.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.502+0000 7f62237fe640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f621006ae40 0x7f621006d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6214034000 tx=0x7f6214008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:49.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.506+0000 7f620bfff640 1 -- 172.21.15.2:0/3257605920 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f62240cca80 con 0x7f6224160ab0 2023-11-25T04:08:49.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.717+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62240cba60 con 0x7f6224160ab0 2023-11-25T04:08:49.720 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.718+0000 7f620bfff640 1 -- 172.21.15.2:0/3257605920 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f621c054de0 con 0x7f6224160ab0 2023-11-25T04:08:49.720 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:49.720 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1227253459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1227253459},{"type":"v1","addr":"172.21.15.66:6835","nonce":1227253459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3032459629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3032459629},{"type":"v1","addr":"172.21.15.2:6835","nonce":3032459629}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:08:35.512348+0000","modified":"2023-11-25T04:08:38.534749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/1650670057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1650670057},{"type":"v1","addr":"172.21.15.66:6833","nonce":1650670057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-25T04:08:49.720 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-25T04:08:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f621006ae40 msgr2=0x7f621006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f621006ae40 0x7f621006d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6214034000 tx=0x7f6214008030 comp rx=0 tx=0).stop 2023-11-25T04:08:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6224160ab0 msgr2=0x7f6224157350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6224160ab0 0x7f6224157350 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f621c001f70 tx=0x7f621c00a430 comp rx=0 tx=0).stop 2023-11-25T04:08:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 shutdown_connections 2023-11-25T04:08:49.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6224160ab0 0x7f6224157350 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f621006ae40 0x7f621006d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f62240d1450 0x7f6224156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 --2- 172.21.15.2:0/3257605920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f62240b2450 0x7f62240ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 >> 172.21.15.2:0/3257605920 conn(0x7f622409c450 msgr2=0x7f622406c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 shutdown_connections 2023-11-25T04:08:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.720+0000 7f622a23d640 1 -- 172.21.15.2:0/3257605920 wait complete. 2023-11-25T04:08:49.733 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:49.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.837+0000 7fd570283640 1 Processor -- start 2023-11-25T04:08:49.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.837+0000 7fd570283640 1 -- start start 2023-11-25T04:08:49.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd570283640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd568071f00 0x7fd5680b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd570283640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5680b3130 con 0x7fd568142d20 2023-11-25T04:08:49.840 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd570283640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd568072350 con 0x7fd56806dc30 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd570283640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5680b2330 con 0x7fd568071f00 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56e01f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd568142d20 0x7fd56806d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59530/0 (socket says 172.21.15.2:59530) 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56e01f640 1 -- 172.21.15.2:0/3851894388 learned_addr learned my addr 172.21.15.2:0/3851894388 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56e820640 1 --2- 172.21.15.2:0/3851894388 >> v2:172.21.15.66:3300/0 conn(0x7fd568071f00 0x7fd5680b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56d01d640 1 -- 172.21.15.2:0/3851894388 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994818173 0 0) 0x7fd5680b3130 con 0x7fd568142d20 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56d01d640 1 -- 172.21.15.2:0/3851894388 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd554003520 con 0x7fd568142d20 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56d01d640 1 -- 172.21.15.2:0/3851894388 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2754051869 0 0) 0x7fd568072350 con 0x7fd56806dc30 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56d01d640 1 -- 172.21.15.2:0/3851894388 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5680b3130 con 0x7fd56806dc30 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56d01d640 1 -- 172.21.15.2:0/3851894388 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2155744614 0 0) 0x7fd554003520 con 0x7fd568142d20 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56e820640 1 -- 172.21.15.2:0/3851894388 >> v1:172.21.15.66:6789/0 conn(0x7fd56806dc30 legacy=0x7fd5680cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56e820640 1 -- 172.21.15.2:0/3851894388 >> v1:172.21.15.2:6789/0 conn(0x7fd568142d20 legacy=0x7fd56806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.838+0000 7fd56e820640 1 -- 172.21.15.2:0/3851894388 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd568143100 con 0x7fd568071f00 2023-11-25T04:08:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.839+0000 7fd56e820640 1 --2- 172.21.15.2:0/3851894388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd568071f00 0x7fd5680b1df0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd560009d90 tx=0x7fd56002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2093389f40885fac server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.839+0000 7fd56d01d640 1 -- 172.21.15.2:0/3851894388 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd564001670 con 0x7fd568071f00 2023-11-25T04:08:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.839+0000 7fd56d01d640 1 -- 172.21.15.2:0/3851894388 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56002c940 con 0x7fd568071f00 2023-11-25T04:08:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.839+0000 7fd56d01d640 1 -- 172.21.15.2:0/3851894388 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56002ccd0 con 0x7fd568071f00 2023-11-25T04:08:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.840+0000 7fd570283640 1 -- 172.21.15.2:0/3851894388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd568071f00 msgr2=0x7fd5680b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.840+0000 7fd570283640 1 --2- 172.21.15.2:0/3851894388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd568071f00 0x7fd5680b1df0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd560009d90 tx=0x7fd56002be10 comp rx=0 tx=0).stop 2023-11-25T04:08:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.840+0000 7fd570283640 1 -- 172.21.15.2:0/3851894388 shutdown_connections 2023-11-25T04:08:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.840+0000 7fd570283640 1 --2- 172.21.15.2:0/3851894388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd568071f00 0x7fd5680b1df0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.840+0000 7fd570283640 1 -- 172.21.15.2:0/3851894388 >> 172.21.15.2:0/3851894388 conn(0x7fd5680b0af0 msgr2=0x7fd5680b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.840+0000 7fd570283640 1 -- 172.21.15.2:0/3851894388 shutdown_connections 2023-11-25T04:08:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.840+0000 7fd570283640 1 -- 172.21.15.2:0/3851894388 wait complete. 2023-11-25T04:08:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.841+0000 7fd570283640 1 Processor -- start 2023-11-25T04:08:49.844 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.841+0000 7fd570283640 1 -- start start 2023-11-25T04:08:49.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd570283640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd56806dc30 0x7fd56813d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd570283640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd568071f00 0x7fd5680a83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd570283640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd568142d20 0x7fd5681e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd570283640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56815d0e0 con 0x7fd568142d20 2023-11-25T04:08:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd570283640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56815c4d0 con 0x7fd568071f00 2023-11-25T04:08:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd570283640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56815c7b0 con 0x7fd56806dc30 2023-11-25T04:08:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e820640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd568142d20 0x7fd5681e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e820640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd568142d20 0x7fd5681e6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44644/0 (socket says 172.21.15.2:44644) 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e820640 1 -- 172.21.15.2:0/2326925330 learned_addr learned my addr 172.21.15.2:0/2326925330 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e01f640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd56806dc30 0x7fd56813d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56d81e640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd568071f00 0x7fd5680a83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e820640 1 -- 172.21.15.2:0/2326925330 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd56806dc30 msgr2=0x7fd56813d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e820640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd56806dc30 0x7fd56813d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e820640 1 -- 172.21.15.2:0/2326925330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd568071f00 msgr2=0x7fd5680a83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e820640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd568071f00 0x7fd5680a83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e820640 1 -- 172.21.15.2:0/2326925330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560009a70 con 0x7fd568142d20 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.842+0000 7fd56e820640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd568142d20 0x7fd5681e6bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd560009eb0 tx=0x7fd560004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.843+0000 7fd55effd640 1 -- 172.21.15.2:0/2326925330 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560035e60 con 0x7fd568142d20 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.843+0000 7fd55effd640 1 -- 172.21.15.2:0/2326925330 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560009450 con 0x7fd568142d20 2023-11-25T04:08:49.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.843+0000 7fd55effd640 1 -- 172.21.15.2:0/2326925330 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56003e650 con 0x7fd568142d20 2023-11-25T04:08:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.843+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56815ca90 con 0x7fd568142d20 2023-11-25T04:08:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.843+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5680a8910 con 0x7fd568142d20 2023-11-25T04:08:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.844+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56815d290 con 0x7fd568142d20 2023-11-25T04:08:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.844+0000 7fd55effd640 1 -- 172.21.15.2:0/2326925330 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd56003b050 con 0x7fd568142d20 2023-11-25T04:08:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.844+0000 7fd55effd640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd54c06ae40 0x7fd54c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.845+0000 7fd56e01f640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd54c06ae40 0x7fd54c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.845+0000 7fd55effd640 1 -- 172.21.15.2:0/2326925330 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5600ab4f0 con 0x7fd568142d20 2023-11-25T04:08:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.845+0000 7fd56e01f640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd54c06ae40 0x7fd54c06d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5640011e0 tx=0x7fd564001cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:49.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:49.849+0000 7fd55effd640 1 -- 172.21.15.2:0/2326925330 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd56815d290 con 0x7fd568142d20 2023-11-25T04:08:50.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.028+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd568067420 con 0x7fd568142d20 2023-11-25T04:08:50.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.029+0000 7fd55effd640 1 -- 172.21.15.2:0/2326925330 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fd560076650 con 0x7fd568142d20 2023-11-25T04:08:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:50.031 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:50.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd54c06ae40 msgr2=0x7fd54c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd54c06ae40 0x7fd54c06d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd5640011e0 tx=0x7fd564001cb0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd568142d20 msgr2=0x7fd5681e6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd568142d20 0x7fd5681e6bb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd560009eb0 tx=0x7fd560004a40 comp rx=0 tx=0).stop 2023-11-25T04:08:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 shutdown_connections 2023-11-25T04:08:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd568142d20 0x7fd5681e6bb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd54c06ae40 0x7fd54c06d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd568071f00 0x7fd5680a83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 --2- 172.21.15.2:0/2326925330 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd56806dc30 0x7fd56813d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 >> 172.21.15.2:0/2326925330 conn(0x7fd5680b0af0 msgr2=0x7fd568141f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 shutdown_connections 2023-11-25T04:08:50.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.031+0000 7fd570283640 1 -- 172.21.15.2:0/2326925330 wait complete. 2023-11-25T04:08:50.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:08:50.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.149+0000 7f80ef0d3640 1 Processor -- start 2023-11-25T04:08:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.150+0000 7f80ef0d3640 1 -- start start 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.150+0000 7f80ef0d3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80d1720 0x7f80e80d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.150+0000 7f80ef0d3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80e80b3db0 0x7f80e80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.150+0000 7f80ef0d3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e80b5f90 con 0x7f80e815d3e0 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.150+0000 7f80ef0d3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80d20a0 con 0x7f80e80b3db0 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.150+0000 7f80ef0d3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80b61e0 con 0x7f80e80d1720 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.150+0000 7f80ed670640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f80e80b3db0 0x7f80e80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.151+0000 7f80ece6f640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f80e815d3e0 0x7f80e80ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59534/0 (socket says 172.21.15.2:59534) 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.151+0000 7f80ece6f640 1 -- 172.21.15.2:0/3134249002 learned_addr learned my addr 172.21.15.2:0/3134249002 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.151+0000 7f80e7fff640 1 --2- 172.21.15.2:0/3134249002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80d1720 0x7f80e80d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.151+0000 7f80ed670640 1 -- 172.21.15.2:0/3134249002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80d1720 msgr2=0x7f80e80d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.151+0000 7f80ed670640 1 --2- 172.21.15.2:0/3134249002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80d1720 0x7f80e80d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.151+0000 7f80ed670640 1 -- 172.21.15.2:0/3134249002 >> v1:172.21.15.2:6789/0 conn(0x7f80e815d3e0 legacy=0x7f80e80ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.151+0000 7f80ed670640 1 -- 172.21.15.2:0/3134249002 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80b64c0 con 0x7f80e80b3db0 2023-11-25T04:08:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80ed670640 1 --2- 172.21.15.2:0/3134249002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e80b3db0 0x7f80e80b4240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80d80097a0 tx=0x7f80d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d36071c5774eaa server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80e77fe640 1 -- 172.21.15.2:0/3134249002 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8031830 con 0x7f80e80b3db0 2023-11-25T04:08:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80e77fe640 1 -- 172.21.15.2:0/3134249002 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8031990 con 0x7f80e80b3db0 2023-11-25T04:08:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80e77fe640 1 -- 172.21.15.2:0/3134249002 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8031d20 con 0x7f80e80b3db0 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80ef0d3640 1 -- 172.21.15.2:0/3134249002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e80b3db0 msgr2=0x7f80e80b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80ef0d3640 1 --2- 172.21.15.2:0/3134249002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e80b3db0 0x7f80e80b4240 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f80d80097a0 tx=0x7f80d802b8d0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80ef0d3640 1 -- 172.21.15.2:0/3134249002 shutdown_connections 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80ef0d3640 1 --2- 172.21.15.2:0/3134249002 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e80b3db0 0x7f80e80b4240 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80ef0d3640 1 --2- 172.21.15.2:0/3134249002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80d1720 0x7f80e80d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80ef0d3640 1 -- 172.21.15.2:0/3134249002 >> 172.21.15.2:0/3134249002 conn(0x7f80e809c480 msgr2=0x7f80e80d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80ef0d3640 1 -- 172.21.15.2:0/3134249002 shutdown_connections 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.152+0000 7f80ef0d3640 1 -- 172.21.15.2:0/3134249002 wait complete. 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.153+0000 7f80ef0d3640 1 Processor -- start 2023-11-25T04:08:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.153+0000 7f80ef0d3640 1 -- start start 2023-11-25T04:08:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.154+0000 7f80ef0d3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80b3db0 0x7f80e8152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.154+0000 7f80ef0d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80e80d1720 0x7f80e80b2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.154+0000 7f80ef0d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e815d3e0 0x7f80e81f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.154+0000 7f80ef0d3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81526b0 con 0x7f80e815d3e0 2023-11-25T04:08:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.154+0000 7f80ef0d3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e815e3b0 con 0x7f80e80d1720 2023-11-25T04:08:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.154+0000 7f80ef0d3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e815e650 con 0x7f80e80b3db0 2023-11-25T04:08:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.154+0000 7f80ed670640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e815d3e0 0x7f80e81f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.154+0000 7f80ed670640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e815d3e0 0x7f80e81f1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44654/0 (socket says 172.21.15.2:44654) 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.154+0000 7f80ed670640 1 -- 172.21.15.2:0/2063270117 learned_addr learned my addr 172.21.15.2:0/2063270117 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80ece6f640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80b3db0 0x7f80e8152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80e7fff640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80e80d1720 0x7f80e80b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80ed670640 1 -- 172.21.15.2:0/2063270117 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80b3db0 msgr2=0x7f80e8152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80ed670640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80b3db0 0x7f80e8152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80ed670640 1 -- 172.21.15.2:0/2063270117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80e80d1720 msgr2=0x7f80e80b2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80ed670640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80e80d1720 0x7f80e80b2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80ed670640 1 -- 172.21.15.2:0/2063270117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d8009400 con 0x7f80e815d3e0 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80ed670640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e815d3e0 0x7f80e81f1df0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f80d80098c0 tx=0x7f80d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80e57fa640 1 -- 172.21.15.2:0/2063270117 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d803b9f0 con 0x7f80e815d3e0 2023-11-25T04:08:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80e57fa640 1 -- 172.21.15.2:0/2063270117 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d803bb50 con 0x7f80e815d3e0 2023-11-25T04:08:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e815e930 con 0x7f80e815d3e0 2023-11-25T04:08:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80e57fa640 1 -- 172.21.15.2:0/2063270117 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80453f0 con 0x7f80e815d3e0 2023-11-25T04:08:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.155+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e815eef0 con 0x7f80e815d3e0 2023-11-25T04:08:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.156+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e8067420 con 0x7f80e815d3e0 2023-11-25T04:08:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.156+0000 7f80e57fa640 1 -- 172.21.15.2:0/2063270117 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f80d8045550 con 0x7f80e815d3e0 2023-11-25T04:08:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.157+0000 7f80e57fa640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f80c806ae70 0x7f80c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.157+0000 7f80e57fa640 1 -- 172.21.15.2:0/2063270117 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80d80ab970 con 0x7f80e815d3e0 2023-11-25T04:08:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.157+0000 7f80ece6f640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f80c806ae70 0x7f80c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.157+0000 7f80ece6f640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f80c806ae70 0x7f80c806d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80e0005c00 tx=0x7f80e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.161+0000 7f80e57fa640 1 -- 172.21.15.2:0/2063270117 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f80d8076b40 con 0x7f80e815d3e0 2023-11-25T04:08:50.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.373+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80e80d1500 con 0x7f80e815d3e0 2023-11-25T04:08:50.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.373+0000 7f80e57fa640 1 -- 172.21.15.2:0/2063270117 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f80d8035020 con 0x7f80e815d3e0 2023-11-25T04:08:50.375 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:50.376 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1227253459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1227253459},{"type":"v1","addr":"172.21.15.66:6835","nonce":1227253459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3032459629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3032459629},{"type":"v1","addr":"172.21.15.2:6835","nonce":3032459629}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:08:35.512348+0000","modified":"2023-11-25T04:08:38.534749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/1650670057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1650670057},{"type":"v1","addr":"172.21.15.66:6833","nonce":1650670057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-25T04:08:50.376 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-25T04:08:50.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f80c806ae70 msgr2=0x7f80c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f80c806ae70 0x7f80c806d330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f80e0005c00 tx=0x7f80e0009040 comp rx=0 tx=0).stop 2023-11-25T04:08:50.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e815d3e0 msgr2=0x7f80e81f1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e815d3e0 0x7f80e81f1df0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f80d80098c0 tx=0x7f80d80046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 shutdown_connections 2023-11-25T04:08:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f80e815d3e0 0x7f80e81f1df0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f80c806ae70 0x7f80c806d330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80e80d1720 0x7f80e80b2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 --2- 172.21.15.2:0/2063270117 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f80e80b3db0 0x7f80e8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 >> 172.21.15.2:0/2063270117 conn(0x7f80e809c480 msgr2=0x7f80e80b4190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 shutdown_connections 2023-11-25T04:08:50.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.375+0000 7f80ef0d3640 1 -- 172.21.15.2:0/2063270117 wait complete. 2023-11-25T04:08:50.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-25T04:08:35.512348+0000', 'modified': '2023-11-25T04:08:38.534749+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/1650670057', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 1650670057}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 1650670057}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-25T04:08:50.790 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-25T04:08:50.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-25T04:08:50.905 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.903+0000 7f00ae353640 1 Processor -- start 2023-11-25T04:08:50.906 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.903+0000 7f00ae353640 1 -- start start 2023-11-25T04:08:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.904+0000 7f00ae353640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f00a815d4c0 0x7f00a80ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.904+0000 7f00ae353640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00a80cf730 0x7f00a80d1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.904+0000 7f00ae353640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a80d2090 con 0x7f00a80d1c40 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.904+0000 7f00ae353640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a80d08b0 con 0x7f00a80cf730 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.904+0000 7f00ae353640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a80cfc30 con 0x7f00a815d4c0 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.904+0000 7f00a77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00a80cf730 0x7f00a80d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.904+0000 7f00a77fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f00a80cf730 0x7f00a80d1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44668/0 (socket says 172.21.15.2:44668) 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.904+0000 7f00a77fe640 1 -- 172.21.15.2:0/1828499265 learned_addr learned my addr 172.21.15.2:0/1828499265 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.904+0000 7f00a7fff640 1 --2- 172.21.15.2:0/1828499265 >> v2:172.21.15.66:3300/0 conn(0x7f00a815d4c0 0x7f00a80ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.905+0000 7f00a77fe640 1 -- 172.21.15.2:0/1828499265 >> v2:172.21.15.66:3300/0 conn(0x7f00a815d4c0 msgr2=0x7f00a80ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.905+0000 7f00a77fe640 1 --2- 172.21.15.2:0/1828499265 >> v2:172.21.15.66:3300/0 conn(0x7f00a815d4c0 0x7f00a80ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.905+0000 7f00a77fe640 1 -- 172.21.15.2:0/1828499265 >> v1:172.21.15.66:6789/0 conn(0x7f00a80d1c40 legacy=0x7f00a8161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.905+0000 7f00a77fe640 1 -- 172.21.15.2:0/1828499265 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a80cff10 con 0x7f00a80cf730 2023-11-25T04:08:50.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.905+0000 7f00a7fff640 1 --2- 172.21.15.2:0/1828499265 >> v2:172.21.15.66:3300/0 conn(0x7f00a815d4c0 0x7f00a80ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:08:50.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.905+0000 7f00a77fe640 1 --2- 172.21.15.2:0/1828499265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80cf730 0x7f00a80d1700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00a8073d20 tx=0x7f009802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebfba9fbfec95ea server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00a6ffd640 1 -- 172.21.15.2:0/1828499265 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098030860 con 0x7f00a80cf730 2023-11-25T04:08:50.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00a6ffd640 1 -- 172.21.15.2:0/1828499265 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00980309c0 con 0x7f00a80cf730 2023-11-25T04:08:50.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00a6ffd640 1 -- 172.21.15.2:0/1828499265 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098030d50 con 0x7f00a80cf730 2023-11-25T04:08:50.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00ae353640 1 -- 172.21.15.2:0/1828499265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80cf730 msgr2=0x7f00a80d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.911 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00ae353640 1 --2- 172.21.15.2:0/1828499265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80cf730 0x7f00a80d1700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00a8073d20 tx=0x7f009802b9a0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00ae353640 1 -- 172.21.15.2:0/1828499265 shutdown_connections 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00ae353640 1 --2- 172.21.15.2:0/1828499265 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80cf730 0x7f00a80d1700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00ae353640 1 --2- 172.21.15.2:0/1828499265 >> v2:172.21.15.66:3300/0 conn(0x7f00a815d4c0 0x7f00a80ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00ae353640 1 -- 172.21.15.2:0/1828499265 >> 172.21.15.2:0/1828499265 conn(0x7f00a809c460 msgr2=0x7f00a80d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00ae353640 1 -- 172.21.15.2:0/1828499265 shutdown_connections 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.906+0000 7f00ae353640 1 -- 172.21.15.2:0/1828499265 wait complete. 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.907+0000 7f00ae353640 1 Processor -- start 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00ae353640 1 -- start start 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00ae353640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00a80cf730 0x7f00a80c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00ae353640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80d1c40 0x7f00a80b6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00ae353640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a815d4c0 0x7f00a815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00ae353640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80b8800 con 0x7f00a80d1c40 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00ae353640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a8157930 con 0x7f00a815d4c0 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00ae353640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a80c9b70 con 0x7f00a80cf730 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80d1c40 0x7f00a80b6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80d1c40 0x7f00a80b6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44684/0 (socket says 172.21.15.2:44684) 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00a77fe640 1 -- 172.21.15.2:0/3763456083 learned_addr learned my addr 172.21.15.2:0/3763456083 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.908+0000 7f00a7fff640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00a80cf730 0x7f00a80c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00ac8f0640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a815d4c0 0x7f00a815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00a77fe640 1 -- 172.21.15.2:0/3763456083 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00a80cf730 msgr2=0x7f00a80c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00a77fe640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00a80cf730 0x7f00a80c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00a77fe640 1 -- 172.21.15.2:0/3763456083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a815d4c0 msgr2=0x7f00a815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00a77fe640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a815d4c0 0x7f00a815f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00a77fe640 1 -- 172.21.15.2:0/3763456083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00980094d0 con 0x7f00a80d1c40 2023-11-25T04:08:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00a77fe640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80d1c40 0x7f00a80b6720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0098009960 tx=0x7f0098004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00a4ff9640 1 -- 172.21.15.2:0/3763456083 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098039d60 con 0x7f00a80d1c40 2023-11-25T04:08:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00a4ff9640 1 -- 172.21.15.2:0/3763456083 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0098044480 con 0x7f00a80d1c40 2023-11-25T04:08:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00a4ff9640 1 -- 172.21.15.2:0/3763456083 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098044830 con 0x7f00a80d1c40 2023-11-25T04:08:50.914 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00ae353640 1 -- 172.21.15.2:0/3763456083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a80b6c60 con 0x7f00a80d1c40 2023-11-25T04:08:50.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.909+0000 7f00ae353640 1 -- 172.21.15.2:0/3763456083 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a80b7e60 con 0x7f00a80d1c40 2023-11-25T04:08:50.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.911+0000 7f00a4ff9640 1 -- 172.21.15.2:0/3763456083 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f009804d3b0 con 0x7f00a80d1c40 2023-11-25T04:08:50.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.911+0000 7f00a4ff9640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f009406ae40 0x7f009406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.911+0000 7f00a4ff9640 1 -- 172.21.15.2:0/3763456083 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f009803e070 con 0x7f00a80d1c40 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.911+0000 7f00a7fff640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f009406ae40 0x7f009406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.912+0000 7f00a7fff640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f009406ae40 0x7f009406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f009c006fd0 tx=0x7f009c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.912+0000 7f00b0fca740 1 Processor -- start 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.912+0000 7f00b0fca740 1 -- start start 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748d9c50 0x560e748acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 0x560e748dc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748ad130 0x560e748dcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00b0fca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7486d980 con 0x560e748d9c50 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00b0fca740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e7481fb90 con 0x560e748da030 2023-11-25T04:08:50.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00b0fca740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e7481d280 con 0x560e748ad130 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748d9c50 0x560e748acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748d9c50 0x560e748acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44688/0 (socket says 172.21.15.2:44688) 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a7fff640 1 -- 172.21.15.2:0/1944578924 learned_addr learned my addr 172.21.15.2:0/1944578924 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00ac8f0640 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748ad130 0x560e748dcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a77fe640 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 0x560e748dc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a7fff640 1 -- 172.21.15.2:0/1944578924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748ad130 msgr2=0x560e748dcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a7fff640 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748ad130 0x560e748dcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a7fff640 1 -- 172.21.15.2:0/1944578924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 msgr2=0x560e748dc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a7fff640 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 0x560e748dc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a7fff640 1 -- 172.21.15.2:0/1944578924 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e747de500 con 0x560e748d9c50 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a77fe640 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 0x560e748dc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f00a7fff640 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748d9c50 0x560e748acbf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f009c00b950 tx=0x7f009c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4d09692e1615bb server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f008dffb640 1 -- 172.21.15.2:0/1944578924 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c016c10 con 0x560e748d9c50 2023-11-25T04:08:50.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f008dffb640 1 -- 172.21.15.2:0/1944578924 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009c01a070 con 0x560e748d9c50 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.913+0000 7f008dffb640 1 -- 172.21.15.2:0/1944578924 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009c021440 con 0x560e748d9c50 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.914+0000 7f00b0fca740 1 -- 172.21.15.2:0/1944578924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748d9c50 msgr2=0x560e748acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.914+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748d9c50 0x560e748acbf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f009c00b950 tx=0x7f009c004610 comp rx=0 tx=0).stop 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.914+0000 7f00b0fca740 1 -- 172.21.15.2:0/1944578924 shutdown_connections 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.914+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748ad130 0x560e748dcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.914+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 0x560e748dc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.914+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1944578924 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748d9c50 0x560e748acbf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.914+0000 7f00b0fca740 1 -- 172.21.15.2:0/1944578924 >> 172.21.15.2:0/1944578924 conn(0x560e748aee60 msgr2=0x560e748f79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.914+0000 7f00b0fca740 1 -- 172.21.15.2:0/1944578924 shutdown_connections 2023-11-25T04:08:50.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.914+0000 7f00b0fca740 1 -- 172.21.15.2:0/1944578924 wait complete. 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.915+0000 7f00b0fca740 1 -- start start 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.915+0000 7f00b0fca740 1 Processor -- start 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 0x560e748f2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748da030 0x560e748ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e74818b70 con 0x560e748f1b50 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e747d2e00 con 0x560e748d9c50 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e747d2aa0 con 0x560e748da030 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 10 client.0 _ll_register_callbacks cb 0x560e7452aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00ac8f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00ac8f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44694/0 (socket says 172.21.15.2:44694) 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00ac8f0640 1 -- 172.21.15.2:0/4061923203 learned_addr learned my addr 172.21.15.2:0/4061923203 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00a7fff640 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 0x560e748f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00a77fe640 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748da030 0x560e748ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00ac8f0640 1 -- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748da030 msgr2=0x560e748ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00ac8f0640 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748da030 0x560e748ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00ac8f0640 1 -- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 msgr2=0x560e748f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00ac8f0640 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 0x560e748f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00ac8f0640 1 -- 172.21.15.2:0/4061923203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c00e040 con 0x560e748f1b50 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00ac8f0640 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748cab40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f00a00056a0 tx=0x7f00a0001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6bedaeddd6b21f server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f0086ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f0086ffd640 1 -- 172.21.15.2:0/4061923203 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0013600 con 0x560e748f1b50 2023-11-25T04:08:50.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f0086ffd640 1 -- 172.21.15.2:0/4061923203 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00a0013760 con 0x560e748f1b50 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 1 -- 172.21.15.2:0/4061923203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e74811b50 con 0x560e748f1b50 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f0086ffd640 1 -- 172.21.15.2:0/4061923203 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00a0013920 con 0x560e748f1b50 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 10 client.4638 fetch_fsmap learned FSMap version 8 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.916+0000 7f00b0fca740 1 -- 172.21.15.2:0/4061923203 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x560e748171f0 con 0x560e748f1b50 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f0086ffd640 1 -- 172.21.15.2:0/4061923203 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560e74811b50 con 0x560e748f1b50 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f0086ffd640 1 -- 172.21.15.2:0/4061923203 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f00a0013a80 con 0x560e748f1b50 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f00b0fca740 10 client.4638 fetch_fsmap finished waiting for FSMap version 8 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f00b0fca740 10 client.4638 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f00b0fca740 20 client.4638 populate_metadata read hostname 'smithi002' 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f00b0fca740 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] conn(0x560e74907b00 0x560e74907ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f00b0fca740 4 client.4638 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-25T04:08:50.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f00b0fca740 1 -- 172.21.15.2:0/4061923203 --> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e74811870 con 0x560e74907b00 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f00a7fff640 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] conn(0x560e74907b00 0x560e74907ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f0086ffd640 10 client.4638 ms_handle_connect on v2:172.21.15.66:6832/1650670057 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.917+0000 7f00a7fff640 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] conn(0x560e74907b00 0x560e74907ee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8bef53d1eefe71 server_cookie=10e8bcd7fbe9716f in_seq=0 out_seq=0 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f0086ffd640 1 -- 172.21.15.2:0/4061923203 <== mds.0 v2:172.21.15.66:6832/1650670057 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560e74811870 con 0x560e74907b00 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f0086ffd640 10 client.4638 handle_command_reply: tid=0 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 client.4638 shutdown 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 -- 172.21.15.2:0/4061923203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 msgr2=0x560e748cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748cab40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f00a00056a0 tx=0x7f00a0001cf0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 -- 172.21.15.2:0/4061923203 shutdown_connections 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748cab40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748da030 0x560e748ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] conn(0x560e74907b00 0x560e74907ee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 --2- 172.21.15.2:0/4061923203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 0x560e748f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f0086ffd640 0 client.4638 ms_handle_reset on v2:172.21.15.66:6832/1650670057 2023-11-25T04:08:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 -- 172.21.15.2:0/4061923203 >> 172.21.15.2:0/4061923203 conn(0x560e748ad130 msgr2=0x560e748b0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 -- 172.21.15.2:0/4061923203 shutdown_connections 2023-11-25T04:08:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.918+0000 7f00b0fca740 1 -- 172.21.15.2:0/4061923203 wait complete. 2023-11-25T04:08:50.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.919+0000 7f00b0fca740 20 client.4638 trim_cache size 0 max 16384 2023-11-25T04:08:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.934+0000 7f00b0fca740 1 Processor -- start 2023-11-25T04:08:50.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.934+0000 7f00b0fca740 1 -- start start 2023-11-25T04:08:50.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748d9c50 0x560e74908080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 0x560e748b0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748de9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00b0fca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e74798270 con 0x560e748f1b50 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00b0fca740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e748af630 con 0x560e748da030 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00b0fca740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e7491acb0 con 0x560e748d9c50 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00ac8f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748de9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00ac8f0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748de9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44696/0 (socket says 172.21.15.2:44696) 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00ac8f0640 1 -- 172.21.15.2:0/1099243340 learned_addr learned my addr 172.21.15.2:0/1099243340 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00ac8f0640 1 -- 172.21.15.2:0/1099243340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748d9c50 msgr2=0x560e74908080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00a7fff640 1 --2- 172.21.15.2:0/1099243340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748d9c50 0x560e74908080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00a77fe640 1 --2- 172.21.15.2:0/1099243340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 0x560e748b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00ac8f0640 1 --2- 172.21.15.2:0/1099243340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748d9c50 0x560e74908080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00ac8f0640 1 -- 172.21.15.2:0/1099243340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 msgr2=0x560e748b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00ac8f0640 1 --2- 172.21.15.2:0/1099243340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 0x560e748b0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.935+0000 7f00ac8f0640 1 -- 172.21.15.2:0/1099243340 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e747b4d00 con 0x560e748f1b50 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00ac8f0640 1 --2- 172.21.15.2:0/1099243340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748de9e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00a0001700 tx=0x7f00a000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec84b002448b9f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f008e7fc640 1 -- 172.21.15.2:0/1099243340 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0006d50 con 0x560e748f1b50 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f008e7fc640 1 -- 172.21.15.2:0/1099243340 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a0005790 con 0x560e748f1b50 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f008e7fc640 1 -- 172.21.15.2:0/1099243340 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0013800 con 0x560e748f1b50 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00b0fca740 1 -- 172.21.15.2:0/1099243340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 msgr2=0x560e748de9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1099243340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748de9e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f00a0001700 tx=0x7f00a000f000 comp rx=0 tx=0).stop 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00b0fca740 1 -- 172.21.15.2:0/1099243340 shutdown_connections 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1099243340 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748f1b50 0x560e748de9e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1099243340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748da030 0x560e748b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1099243340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748d9c50 0x560e74908080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00b0fca740 1 -- 172.21.15.2:0/1099243340 >> 172.21.15.2:0/1099243340 conn(0x560e748ad130 msgr2=0x560e748d9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00b0fca740 1 -- 172.21.15.2:0/1099243340 shutdown_connections 2023-11-25T04:08:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.936+0000 7f00b0fca740 1 -- 172.21.15.2:0/1099243340 wait complete. 2023-11-25T04:08:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.937+0000 7f00b0fca740 1 -- start start 2023-11-25T04:08:50.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.937+0000 7f00b0fca740 1 Processor -- start 2023-11-25T04:08:50.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 0x560e748ed370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748da030 0x560e74962980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00b0fca740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748f1b50 0x560e749070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00b0fca740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e748ce810 con 0x560e748da030 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00b0fca740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e748dc420 con 0x560e748d9c50 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00b0fca740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e748dc880 con 0x560e748f1b50 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00b0fca740 10 client.0 _ll_register_callbacks cb 0x7f009c004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748da030 0x560e74962980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748da030 0x560e74962980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44710/0 (socket says 172.21.15.2:44710) 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a77fe640 1 -- 172.21.15.2:0/1246042629 learned_addr learned my addr 172.21.15.2:0/1246042629 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a7fff640 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 0x560e748ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00ac8f0640 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748f1b50 0x560e749070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a77fe640 1 -- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748f1b50 msgr2=0x560e749070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a77fe640 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748f1b50 0x560e749070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a77fe640 1 -- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 msgr2=0x560e748ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a77fe640 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 0x560e748ed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a77fe640 1 -- 172.21.15.2:0/1246042629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e748171f0 con 0x560e748da030 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00a77fe640 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748da030 0x560e74962980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f009802bfb0 tx=0x7f00980ac170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa7700354bb5fd server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f0086ffd640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f0086ffd640 1 -- 172.21.15.2:0/1246042629 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0098083300 con 0x560e748da030 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f0086ffd640 1 -- 172.21.15.2:0/1246042629 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f009807a510 con 0x560e748da030 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.938+0000 7f00b0fca740 1 -- 172.21.15.2:0/1246042629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e745196c0 con 0x560e748da030 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f0086ffd640 1 -- 172.21.15.2:0/1246042629 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f009807a6d0 con 0x560e748da030 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00b0fca740 10 client.4644 fetch_fsmap learned FSMap version 8 2023-11-25T04:08:50.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00b0fca740 1 -- 172.21.15.2:0/1246042629 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x560e747da4f0 con 0x560e748da030 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f0086ffd640 1 -- 172.21.15.2:0/1246042629 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560e745196c0 con 0x560e748da030 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f0086ffd640 1 -- 172.21.15.2:0/1246042629 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0098082e70 con 0x560e748da030 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00b0fca740 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00b0fca740 10 client.4644 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00b0fca740 20 client.4644 populate_metadata read hostname 'smithi002' 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] conn(0x560e748c9cc0 0x560e748ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00b0fca740 4 client.4644 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00b0fca740 1 -- 172.21.15.2:0/1246042629 --> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560e7456cd10 con 0x560e748c9cc0 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00a7fff640 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] conn(0x560e748c9cc0 0x560e748ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f0086ffd640 10 client.4644 ms_handle_connect on v2:172.21.15.66:6832/1650670057 2023-11-25T04:08:50.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.939+0000 7f00a7fff640 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] conn(0x560e748c9cc0 0x560e748ca0a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c5249c62b8c00b6 server_cookie=6fb3dab6d2ea98b9 in_seq=0 out_seq=0 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f0086ffd640 1 -- 172.21.15.2:0/1246042629 <== mds.0 v2:172.21.15.66:6832/1650670057 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x560e7456cd10 con 0x560e748c9cc0 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f0086ffd640 10 client.4644 handle_command_reply: tid=0 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 client.4644 shutdown 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 -- 172.21.15.2:0/1246042629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748da030 msgr2=0x560e74962980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748da030 0x560e74962980 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f009802bfb0 tx=0x7f00980ac170 comp rx=0 tx=0).stop 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 -- 172.21.15.2:0/1246042629 shutdown_connections 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560e748f1b50 0x560e749070d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560e748da030 0x560e74962980 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:6832/1650670057,v1:172.21.15.66:6833/1650670057] conn(0x560e748c9cc0 0x560e748ca0a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 --2- 172.21.15.2:0/1246042629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560e748d9c50 0x560e748ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f0086ffd640 0 client.4644 ms_handle_reset on v2:172.21.15.66:6832/1650670057 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 -- 172.21.15.2:0/1246042629 >> 172.21.15.2:0/1246042629 conn(0x560e748ad130 msgr2=0x560e748d9010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:50.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 -- 172.21.15.2:0/1246042629 shutdown_connections 2023-11-25T04:08:50.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 1 -- 172.21.15.2:0/1246042629 wait complete. 2023-11-25T04:08:50.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00b0fca740 20 client.4644 trim_cache size 0 max 16384 2023-11-25T04:08:50.950 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-25T04:08:50.950 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "490edb11-4d53-4272-8bbb-d46dd29c1240", 2023-11-25T04:08:50.950 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-25T04:08:50.950 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4288, 2023-11-25T04:08:50.950 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-25T04:08:50.950 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-25T04:08:50.950 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-25T04:08:50.951 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 14.771851085, 2023-11-25T04:08:50.951 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 8, 2023-11-25T04:08:50.951 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 20, 2023-11-25T04:08:50.951 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 20, 2023-11-25T04:08:50.951 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 21.854863621 2023-11-25T04:08:50.951 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-25T04:08:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00ae353640 1 -- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f009406ae40 msgr2=0x7f009406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00ae353640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f009406ae40 0x7f009406d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f009c006fd0 tx=0x7f009c008040 comp rx=0 tx=0).stop 2023-11-25T04:08:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00ae353640 1 -- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80d1c40 msgr2=0x7f00a80b6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.940+0000 7f00ae353640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80d1c40 0x7f00a80b6720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0098009960 tx=0x7f0098004730 comp rx=0 tx=0).stop 2023-11-25T04:08:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.941+0000 7f00ae353640 1 -- 172.21.15.2:0/3763456083 shutdown_connections 2023-11-25T04:08:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.941+0000 7f00ae353640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f009406ae40 0x7f009406d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.941+0000 7f00ae353640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00a815d4c0 0x7f00a815f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.952 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.941+0000 7f00ae353640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f00a80d1c40 0x7f00a80b6720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.941+0000 7f00ae353640 1 --2- 172.21.15.2:0/3763456083 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00a80cf730 0x7f00a80c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:50.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.941+0000 7f00ae353640 1 -- 172.21.15.2:0/3763456083 >> 172.21.15.2:0/3763456083 conn(0x7f00a809c460 msgr2=0x7f00a806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:50.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.941+0000 7f00ae353640 1 -- 172.21.15.2:0/3763456083 shutdown_connections 2023-11-25T04:08:50.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:50.941+0000 7f00ae353640 1 -- 172.21.15.2:0/3763456083 wait complete. 2023-11-25T04:08:50.954 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-11-25T04:08:50.977 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-11-25T04:08:50.977 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-25T04:08:50.978 INFO:tasks.ceph_fuse:client.0 config is {} 2023-11-25T04:08:50.978 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-25T04:08:50.978 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-25T04:08:50.978 INFO:tasks.ceph_fuse:client.2 config is {} 2023-11-25T04:08:50.978 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-25T04:08:50.978 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-25T04:08:50.978 INFO:tasks.ceph_fuse:client.1 config is {} 2023-11-25T04:08:50.978 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-25T04:08:50.978 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-25T04:08:50.979 INFO:tasks.ceph_fuse:client.3 config is {} 2023-11-25T04:08:50.979 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-25T04:08:50.979 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-25T04:08:50.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:50.979 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2023-11-25T04:08:50.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:50.999 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2023-11-25T04:08:51.078 INFO:teuthology.orchestra.run.smithi066.stderr:Cannot find device "ceph-brx" 2023-11-25T04:08:51.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T04:08:51.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:51.082 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-25T04:08:51.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:51.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link delete ceph-brx 2023-11-25T04:08:51.172 INFO:teuthology.orchestra.run.smithi002.stderr:Cannot find device "ceph-brx" 2023-11-25T04:08:51.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T04:08:51.174 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-11-25T04:08:51.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-25T04:08:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.319+0000 7f156adce640 1 Processor -- start 2023-11-25T04:08:51.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.319+0000 7f156adce640 1 -- start start 2023-11-25T04:08:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.320+0000 7f156adce640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f156415d900 0x7f1564099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:51.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.320+0000 7f156adce640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15640b0660 con 0x7f15640b1de0 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.320+0000 7f156adce640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15640cfca0 con 0x7f15640b2610 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.320+0000 7f156adce640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f156406c900 con 0x7f156415d900 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.320+0000 7f156936b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f15640b1de0 0x7f15640cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59536/0 (socket says 172.21.15.2:59536) 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.320+0000 7f156936b640 1 -- 172.21.15.2:0/343289717 learned_addr learned my addr 172.21.15.2:0/343289717 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.320+0000 7f1568b6a640 1 --2- 172.21.15.2:0/343289717 >> v2:172.21.15.66:3300/0 conn(0x7f156415d900 0x7f1564099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.320+0000 7f15637fe640 1 -- 172.21.15.2:0/343289717 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405865011 0 0) 0x7f15640b0660 con 0x7f15640b1de0 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.320+0000 7f15637fe640 1 -- 172.21.15.2:0/343289717 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1550003520 con 0x7f15640b1de0 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.321+0000 7f1568b6a640 1 -- 172.21.15.2:0/343289717 >> v1:172.21.15.66:6789/0 conn(0x7f15640b2610 legacy=0x7f15640cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.321+0000 7f1568b6a640 1 -- 172.21.15.2:0/343289717 >> v1:172.21.15.2:6789/0 conn(0x7f15640b1de0 legacy=0x7f15640cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:51.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.321+0000 7f1568b6a640 1 -- 172.21.15.2:0/343289717 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156406cbe0 con 0x7f156415d900 2023-11-25T04:08:51.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.321+0000 7f1568b6a640 1 --2- 172.21.15.2:0/343289717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f156415d900 0x7f1564099970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f155c0097a0 tx=0x7f155c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d65ac026e692eca3 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.321+0000 7f15637fe640 1 -- 172.21.15.2:0/343289717 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c030610 con 0x7f156415d900 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.322+0000 7f15637fe640 1 -- 172.21.15.2:0/343289717 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c030770 con 0x7f156415d900 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.322+0000 7f15637fe640 1 -- 172.21.15.2:0/343289717 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c030b00 con 0x7f156415d900 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.322+0000 7f156adce640 1 -- 172.21.15.2:0/343289717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f156415d900 msgr2=0x7f1564099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.322+0000 7f156adce640 1 --2- 172.21.15.2:0/343289717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f156415d900 0x7f1564099970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f155c0097a0 tx=0x7f155c02b960 comp rx=0 tx=0).stop 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.322+0000 7f156adce640 1 -- 172.21.15.2:0/343289717 shutdown_connections 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.322+0000 7f156adce640 1 --2- 172.21.15.2:0/343289717 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f156415d900 0x7f1564099970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.322+0000 7f156adce640 1 -- 172.21.15.2:0/343289717 >> 172.21.15.2:0/343289717 conn(0x7f15640b2a70 msgr2=0x7f15640b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.322+0000 7f156adce640 1 -- 172.21.15.2:0/343289717 shutdown_connections 2023-11-25T04:08:51.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.322+0000 7f156adce640 1 -- 172.21.15.2:0/343289717 wait complete. 2023-11-25T04:08:51.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.323+0000 7f156adce640 1 Processor -- start 2023-11-25T04:08:51.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.323+0000 7f156adce640 1 -- start start 2023-11-25T04:08:51.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.324+0000 7f156adce640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15640b1de0 0x7f15641f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:51.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.324+0000 7f156adce640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15640b2610 0x7f15640ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.324+0000 7f156adce640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f156415d900 0x7f15640b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.324+0000 7f156adce640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156415c6f0 con 0x7f15640b1de0 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.324+0000 7f156adce640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156415c130 con 0x7f15640b2610 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.324+0000 7f156adce640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156415c410 con 0x7f156415d900 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.324+0000 7f1568b6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15640b1de0 0x7f15641f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.324+0000 7f1568b6a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15640b1de0 0x7f15641f2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44722/0 (socket says 172.21.15.2:44722) 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.324+0000 7f1568b6a640 1 -- 172.21.15.2:0/3525206651 learned_addr learned my addr 172.21.15.2:0/3525206651 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f156936b640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f156415d900 0x7f15640b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f1563fff640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15640b2610 0x7f15640ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f1568b6a640 1 -- 172.21.15.2:0/3525206651 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f156415d900 msgr2=0x7f15640b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f1568b6a640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f156415d900 0x7f15640b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f1568b6a640 1 -- 172.21.15.2:0/3525206651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15640b2610 msgr2=0x7f15640ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:51.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f1568b6a640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15640b2610 0x7f15640ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:51.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f1568b6a640 1 -- 172.21.15.2:0/3525206651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c009400 con 0x7f15640b1de0 2023-11-25T04:08:51.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f1568b6a640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15640b1de0 0x7f15641f2900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f155c000c00 tx=0x7f155c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:51.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f15617fa640 1 -- 172.21.15.2:0/3525206651 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c03f070 con 0x7f15640b1de0 2023-11-25T04:08:51.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f15617fa640 1 -- 172.21.15.2:0/3525206651 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155c030e30 con 0x7f15640b1de0 2023-11-25T04:08:51.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15640c8180 con 0x7f15640b1de0 2023-11-25T04:08:51.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f15617fa640 1 -- 172.21.15.2:0/3525206651 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155c004270 con 0x7f15640b1de0 2023-11-25T04:08:51.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.325+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15640b3cf0 con 0x7f15640b1de0 2023-11-25T04:08:51.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.326+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1564067420 con 0x7f15640b1de0 2023-11-25T04:08:51.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.326+0000 7f15617fa640 1 -- 172.21.15.2:0/3525206651 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f155c043070 con 0x7f15640b1de0 2023-11-25T04:08:51.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.327+0000 7f15617fa640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f154406ae40 0x7f154406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:51.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.327+0000 7f15617fa640 1 -- 172.21.15.2:0/3525206651 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f155c0ab250 con 0x7f15640b1de0 2023-11-25T04:08:51.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.327+0000 7f1563fff640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f154406ae40 0x7f154406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:51.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.327+0000 7f1563fff640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f154406ae40 0x7f154406d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f156415cc80 tx=0x7f1554009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:51.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.331+0000 7f15617fa640 1 -- 172.21.15.2:0/3525206651 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f155c0764b0 con 0x7f15640b1de0 2023-11-25T04:08:51.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.542+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f15640cbc50 con 0x7f15640b1de0 2023-11-25T04:08:51.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.543+0000 7f15617fa640 1 -- 172.21.15.2:0/3525206651 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f155c079ad0 con 0x7f15640b1de0 2023-11-25T04:08:51.545 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f154406ae40 msgr2=0x7f154406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f154406ae40 0x7f154406d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f156415cc80 tx=0x7f1554009040 comp rx=0 tx=0).stop 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15640b1de0 msgr2=0x7f15641f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15640b1de0 0x7f15641f2900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f155c000c00 tx=0x7f155c0046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 shutdown_connections 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f156415d900 0x7f15640b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f154406ae40 0x7f154406d300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15640b2610 0x7f15640ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 --2- 172.21.15.2:0/3525206651 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f15640b1de0 0x7f15641f2900 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:51.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 >> 172.21.15.2:0/3525206651 conn(0x7f15640b2a70 msgr2=0x7f1564099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:51.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 shutdown_connections 2023-11-25T04:08:51.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:51.545+0000 7f156adce640 1 -- 172.21.15.2:0/3525206651 wait complete. 2023-11-25T04:08:51.557 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-25T04:08:51.558 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-25T04:08:51.558 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-25T04:08:51.558 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-25T04:08:51.558 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-25T04:08:51.558 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-25T04:08:51.558 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-25T04:08:51.558 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-25T04:08:51.558 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-25T04:08:51.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:51.559 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-25T04:08:51.574 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-25T04:08:51.574 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-25T04:08:51.574 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-25T04:08:51.574 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:51.574 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42621sec preferred_lft 42621sec 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-25T04:08:51.575 INFO:teuthology.orchestra.run.smithi002.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:51.576 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:51.576 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-25T04:08:51.576 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:51.576 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:51.576 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-25T04:08:51.576 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-25T04:08:51.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:51.577 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:08:51.577 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:08:51.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add name ceph-brx type bridge 2023-11-25T04:08:51.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr flush dev ceph-brx 2023-11-25T04:08:51.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set ceph-brx up 2023-11-25T04:08:51.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-25T04:08:51.577 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:08:51.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:51.776 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-25T04:08:51.806 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-25T04:08:51.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:51.808 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-25T04:08:51.881 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-25T04:08:51.881 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-25T04:08:51.881 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-25T04:08:51.882 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-25T04:08:51.882 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-25T04:08:51.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:51.883 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:08:51.883 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:08:51.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-25T04:08:51.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-25T04:08:51.883 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-25T04:08:51.883 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:08:52.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:52.140 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-25T04:08:52.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:52.158 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2023-11-25T04:08:52.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:52.213 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:08:52.213 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:08:52.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:52.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-25T04:08:52.214 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:08:52.304 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-25T04:08:52.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:52.304 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:08:52.305 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:08:52.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-25T04:08:52.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-25T04:08:52.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-25T04:08:52.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-25T04:08:52.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-25T04:08:52.305 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:08:52.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:52.419 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:08:52.419 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:08:52.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-25T04:08:52.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.0 master ceph-brx 2023-11-25T04:08:52.419 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:08:52.468 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-25T04:08:52.468 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:08:52.468 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-25T04:08:52.485 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-25T04:08:52.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:08:52.486 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-25T04:08:52.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2023-11-25T04:08:52.617 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-25T04:08:52.673 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:08:52.674 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:52.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:52.676 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-25T04:08:52.728 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-25T04:08:52.728 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-25T04:08:52.770 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2023-11-25T04:08:52.801 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:08:52.856 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-25T04:08:52.857 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:08:52.858 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:52.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:52.860 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-25T04:08:52.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-25T04:08:52.886+0000 7f3c9e560480 -1 init, newargv = 0x560ee7276310 newargc=15 2023-11-25T04:08:52.888 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[97334]: starting ceph client 2023-11-25T04:08:52.893 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[97334]: starting fuse 2023-11-25T04:08:52.904 INFO:teuthology.orchestra.run.smithi002.stdout:43 2023-11-25T04:08:52.904 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-25T04:08:52.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-25T04:08:52.904 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-25T04:08:52.905 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-25T04:08:52.906 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-25T04:08:53.028 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.97334.asok 2023-11-25T04:08:53.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-25T04:08:53.040 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.97334.asok 2023-11-25T04:08:53.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.97334.asok status 2023-11-25T04:08:53.183 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-25T04:08:53.183 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-25T04:08:53.183 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "ec928368edcc5fc71884a56fd9fd821b148f4e30", 2023-11-25T04:08:53.183 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7506-gec928368 (ec928368edcc5fc71884a56fd9fd821b148f4e30) reef (dev)", 2023-11-25T04:08:53.183 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-25T04:08:53.183 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-25T04:08:53.183 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-25T04:08:53.183 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "97334", 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4656, 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 4656 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-25T04:08:53.184 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 928096850 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 928096850 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.4656 192.168.0.1:0/928096850", 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/928096850", 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-25T04:08:53.185 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 8, 2023-11-25T04:08:53.186 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 20, 2023-11-25T04:08:53.186 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-25T04:08:53.186 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-25T04:08:53.186 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-25T04:08:53.186 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-25T04:08:53.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-25T04:08:53.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.297+0000 7f97352c9640 1 Processor -- start 2023-11-25T04:08:53.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.297+0000 7f97352c9640 1 -- start start 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f97352c9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f97300b2610 0x7f97300b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f97352c9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97300b0660 con 0x7f973009a080 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f97352c9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973006c900 con 0x7f973015d900 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f97352c9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973006cbe0 con 0x7f97300b2610 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f972e7fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f973009a080 0x7f97300b0dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59544/0 (socket says 172.21.15.2:59544) 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f972e7fc640 1 -- 172.21.15.2:0/1603181487 learned_addr learned my addr 172.21.15.2:0/1603181487 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f972f7fe640 1 --2- 172.21.15.2:0/1603181487 >> v2:172.21.15.66:3300/0 conn(0x7f97300b2610 0x7f97300b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f972dffb640 1 -- 172.21.15.2:0/1603181487 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482059528 0 0) 0x7f97300b0660 con 0x7f973009a080 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f972dffb640 1 -- 172.21.15.2:0/1603181487 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9718003520 con 0x7f973009a080 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f972dffb640 1 -- 172.21.15.2:0/1603181487 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4067040321 0 0) 0x7f9718003520 con 0x7f973009a080 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f972f7fe640 1 -- 172.21.15.2:0/1603181487 >> v1:172.21.15.66:6789/0 conn(0x7f973015d900 legacy=0x7f9730099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:53.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.298+0000 7f972f7fe640 1 -- 172.21.15.2:0/1603181487 >> v1:172.21.15.2:6789/0 conn(0x7f973009a080 legacy=0x7f97300b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:53.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.299+0000 7f972f7fe640 1 -- 172.21.15.2:0/1603181487 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973006cec0 con 0x7f97300b2610 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.299+0000 7f972f7fe640 1 --2- 172.21.15.2:0/1603181487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97300b2610 0x7f97300b14e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f97280097a0 tx=0x7f972802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bdb8132a0923909 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.299+0000 7f972dffb640 1 -- 172.21.15.2:0/1603181487 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972802f050 con 0x7f97300b2610 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.300+0000 7f972dffb640 1 -- 172.21.15.2:0/1603181487 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728031500 con 0x7f97300b2610 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.300+0000 7f972dffb640 1 -- 172.21.15.2:0/1603181487 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724001670 con 0x7f97300b2610 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.300+0000 7f97352c9640 1 -- 172.21.15.2:0/1603181487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97300b2610 msgr2=0x7f97300b14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.300+0000 7f97352c9640 1 --2- 172.21.15.2:0/1603181487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97300b2610 0x7f97300b14e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f97280097a0 tx=0x7f972802b820 comp rx=0 tx=0).stop 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.300+0000 7f97352c9640 1 -- 172.21.15.2:0/1603181487 shutdown_connections 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.300+0000 7f97352c9640 1 --2- 172.21.15.2:0/1603181487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97300b2610 0x7f97300b14e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.300+0000 7f97352c9640 1 -- 172.21.15.2:0/1603181487 >> 172.21.15.2:0/1603181487 conn(0x7f97300b2a70 msgr2=0x7f97300b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.300+0000 7f97352c9640 1 -- 172.21.15.2:0/1603181487 shutdown_connections 2023-11-25T04:08:53.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.300+0000 7f97352c9640 1 -- 172.21.15.2:0/1603181487 wait complete. 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.301+0000 7f97352c9640 1 Processor -- start 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.301+0000 7f97352c9640 1 -- start start 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f97352c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f973009a080 0x7f9730153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f97352c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97300b2610 0x7f97300aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f97352c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f973015d900 0x7f97300af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f97352c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300c7b60 con 0x7f973015d900 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f97352c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97300c75a0 con 0x7f97300b2610 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f97352c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97300c7880 con 0x7f973009a080 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f972f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f973015d900 0x7f97300af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f972f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f973015d900 0x7f97300af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44726/0 (socket says 172.21.15.2:44726) 2023-11-25T04:08:53.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f972f7fe640 1 -- 172.21.15.2:0/3195703790 learned_addr learned my addr 172.21.15.2:0/3195703790 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f972e7fc640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97300b2610 0x7f97300aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.302+0000 7f972effd640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f973009a080 0x7f9730153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f972f7fe640 1 -- 172.21.15.2:0/3195703790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f973009a080 msgr2=0x7f9730153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f972f7fe640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f973009a080 0x7f9730153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f972f7fe640 1 -- 172.21.15.2:0/3195703790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97300b2610 msgr2=0x7f97300aec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f972f7fe640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97300b2610 0x7f97300aec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f972f7fe640 1 -- 172.21.15.2:0/3195703790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728009400 con 0x7f973015d900 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f972f7fe640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f973015d900 0x7f97300af150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f972802b860 tx=0x7f97280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f97177fe640 1 -- 172.21.15.2:0/3195703790 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728033900 con 0x7f973015d900 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f97177fe640 1 -- 172.21.15.2:0/3195703790 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9728033a60 con 0x7f973015d900 2023-11-25T04:08:53.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97300b3c50 con 0x7f973015d900 2023-11-25T04:08:53.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f97177fe640 1 -- 172.21.15.2:0/3195703790 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728033e10 con 0x7f973015d900 2023-11-25T04:08:53.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.303+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9730153f60 con 0x7f973015d900 2023-11-25T04:08:53.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.304+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97300b4170 con 0x7f973015d900 2023-11-25T04:08:53.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.305+0000 7f97177fe640 1 -- 172.21.15.2:0/3195703790 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f972803a040 con 0x7f973015d900 2023-11-25T04:08:53.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.305+0000 7f97177fe640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f971c06ae70 0x7f971c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:53.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.305+0000 7f972effd640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f971c06ae70 0x7f971c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:53.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.305+0000 7f97177fe640 1 -- 172.21.15.2:0/3195703790 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97280ab1c0 con 0x7f973015d900 2023-11-25T04:08:53.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.306+0000 7f972effd640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f971c06ae70 0x7f971c06d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f97200012e0 tx=0x7f9720009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:53.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.309+0000 7f97177fe640 1 -- 172.21.15.2:0/3195703790 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f97300b4170 con 0x7f973015d900 2023-11-25T04:08:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.523+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f97300b4170 con 0x7f973015d900 2023-11-25T04:08:53.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.523+0000 7f97177fe640 1 -- 172.21.15.2:0/3195703790 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f97300b4170 con 0x7f973015d900 2023-11-25T04:08:53.526 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-25T04:08:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f971c06ae70 msgr2=0x7f971c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f971c06ae70 0x7f971c06d330 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f97200012e0 tx=0x7f9720009040 comp rx=0 tx=0).stop 2023-11-25T04:08:53.527 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f973015d900 msgr2=0x7f97300af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f973015d900 0x7f97300af150 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f972802b860 tx=0x7f97280046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 shutdown_connections 2023-11-25T04:08:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f973015d900 0x7f97300af150 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f971c06ae70 0x7f971c06d330 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97300b2610 0x7f97300aec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 --2- 172.21.15.2:0/3195703790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f973009a080 0x7f9730153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 >> 172.21.15.2:0/3195703790 conn(0x7f97300b2a70 msgr2=0x7f973006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 shutdown_connections 2023-11-25T04:08:53.528 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:53.525+0000 7f97352c9640 1 -- 172.21.15.2:0/3195703790 wait complete. 2023-11-25T04:08:53.538 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-25T04:08:53.539 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-25T04:08:53.539 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-25T04:08:53.539 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-25T04:08:53.539 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-25T04:08:53.539 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-25T04:08:53.539 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-25T04:08:53.539 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-25T04:08:53.539 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-25T04:08:53.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.540 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-25T04:08:53.556 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-25T04:08:53.556 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-25T04:08:53.556 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-25T04:08:53.556 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.556 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-25T04:08:53.556 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.556 INFO:teuthology.orchestra.run.smithi002.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-25T04:08:53.556 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:53.556 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42619sec preferred_lft 42619sec 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-25T04:08:53.557 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:53.558 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:53.558 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-25T04:08:53.558 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-25T04:08:53.558 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether e2:74:e3:b4:5a:1a brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:53.558 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-25T04:08:53.558 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.559 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::4c59:a5ff:fe3e:2425/64 scope link 2023-11-25T04:08:53.559 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.559 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-25T04:08:53.559 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether e2:74:e3:b4:5a:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:53.559 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::e074:e3ff:feb4:5a1a/64 scope link tentative 2023-11-25T04:08:53.559 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.560 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-25T04:08:53.625 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-25T04:08:53.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.627 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-25T04:08:53.684 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-25T04:08:53.684 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-25T04:08:53.684 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-25T04:08:53.684 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-25T04:08:53.684 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-25T04:08:53.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.685 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:08:53.685 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:08:53.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-25T04:08:53.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-25T04:08:53.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-25T04:08:53.685 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:08:53.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.790 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-25T04:08:53.805 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-25T04:08:53.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.806 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list-id 2023-11-25T04:08:53.861 INFO:teuthology.orchestra.run.smithi002.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-25T04:08:53.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.861 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:08:53.861 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:08:53.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:08:53.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-25T04:08:53.861 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:08:53.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.950 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-25T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-25T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-25T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-25T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-25T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.980 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-25T04:08:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether b2:f2:18:1e:e3:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-25T04:08:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-25T04:08:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::b0f2:18ff:fe1e:e378/64 scope link 2023-11-25T04:08:53.981 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:53.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:53.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-25T04:08:54.052 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-25T04:08:54.052 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-25T04:08:54.052 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-25T04:08:54.052 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-25T04:08:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:54.053 INFO:teuthology.orchestra.run.smithi002.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-25T04:08:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether b2:f2:18:1e:e3:78 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-25T04:08:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-25T04:08:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::b0f2:18ff:fe1e:e378/64 scope link 2023-11-25T04:08:54.053 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:54.054 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-25T04:08:54.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:54.055 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:08:54.055 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:08:54.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-25T04:08:54.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-25T04:08:54.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-25T04:08:54.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-25T04:08:54.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-25T04:08:54.055 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:08:54.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:54.197 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:08:54.197 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:08:54.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.1 up 2023-11-25T04:08:54.197 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set dev brx.1 master ceph-brx 2023-11-25T04:08:54.198 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:08:54.247 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-11-25T04:08:54.248 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:08:54.248 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-25T04:08:54.262 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-25T04:08:54.263 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:08:54.263 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-25T04:08:54.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2023-11-25T04:08:54.391 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:08:54.447 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-25T04:08:54.447 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-25T04:08:54.447 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-25T04:08:54.447 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:08:54.448 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-25T04:08:54.449 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:08:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:08:54.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:54.451 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-25T04:08:54.504 INFO:teuthology.orchestra.run.smithi002.stdout:43 2023-11-25T04:08:54.504 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-11-25T04:08:54.504 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-11-25T04:08:54.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2023-11-25T04:08:54.576 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:08:54.633 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-25T04:08:54.633 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-25T04:08:54.633 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-25T04:08:54.633 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-25T04:08:54.634 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-25T04:08:54.635 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-25T04:08:54.635 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-25T04:08:54.635 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-25T04:08:54.635 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-25T04:08:54.635 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:08:54.635 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:08:54.635 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:08:54.635 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/mnt.0 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:08:54.636 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:08:54.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:54.637 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-25T04:08:54.639 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:2023-11-25T04:08:54.637+0000 7ffbf9c3c480 -1 init, newargv = 0x55d9bcfe5680 newargc=15 2023-11-25T04:08:54.639 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:ceph-fuse[97810]: starting ceph client 2023-11-25T04:08:54.644 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi002.stderr:ceph-fuse[97810]: starting fuse 2023-11-25T04:08:54.654 INFO:teuthology.orchestra.run.smithi002.stdout:43 2023-11-25T04:08:54.654 INFO:teuthology.orchestra.run.smithi002.stdout:44 2023-11-25T04:08:54.655 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-11-25T04:08:54.655 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-25T04:08:54.655 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-25T04:08:54.655 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-25T04:08:54.655 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-25T04:08:54.655 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-25T04:08:54.655 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:08:54.655 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-25T04:08:54.655 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-25T04:08:54.656 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-25T04:08:54.657 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-25T04:08:54.657 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-25T04:08:54.657 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-25T04:08:54.657 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:08:54.657 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.2")) 2023-11-25T04:08:54.657 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-25T04:08:54.779 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.2.97810.asok 2023-11-25T04:08:54.782 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-25T04:08:54.791 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.97810.asok 2023-11-25T04:08:54.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:54.791 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.97810.asok status 2023-11-25T04:08:54.933 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-25T04:08:54.934 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-25T04:08:54.934 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "ec928368edcc5fc71884a56fd9fd821b148f4e30", 2023-11-25T04:08:54.934 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7506-gec928368 (ec928368edcc5fc71884a56fd9fd821b148f4e30) reef (dev)", 2023-11-25T04:08:54.934 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "2", 2023-11-25T04:08:54.934 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-25T04:08:54.935 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-11-25T04:08:54.935 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "97810", 2023-11-25T04:08:54.935 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-25T04:08:54.935 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:08:54.935 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-25T04:08:54.936 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-25T04:08:54.936 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 4668, 2023-11-25T04:08:54.936 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-25T04:08:54.936 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-25T04:08:54.936 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-25T04:08:54.937 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 4668 2023-11-25T04:08:54.937 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:08:54.937 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-25T04:08:54.937 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-25T04:08:54.937 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.2:0", 2023-11-25T04:08:54.938 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2956304535 2023-11-25T04:08:54.938 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:08:54.938 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:08:54.938 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-25T04:08:54.939 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-25T04:08:54.939 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.2:0", 2023-11-25T04:08:54.939 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 2956304535 2023-11-25T04:08:54.939 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:08:54.940 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.4668 192.168.0.2:0/2956304535", 2023-11-25T04:08:54.940 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.2:0/2956304535", 2023-11-25T04:08:54.940 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-25T04:08:54.940 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 8, 2023-11-25T04:08:54.940 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 20, 2023-11-25T04:08:54.941 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-25T04:08:54.941 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-25T04:08:54.941 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-25T04:08:54.941 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-25T04:08:54.943 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-25T04:08:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.047+0000 7f285a3b0640 1 Processor -- start 2023-11-25T04:08:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.047+0000 7f285a3b0640 1 -- start start 2023-11-25T04:08:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.048+0000 7f285a3b0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f285415b1f0 0x7f28540ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.048+0000 7f285a3b0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f285406a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.048+0000 7f285a3b0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28540ce760 con 0x7f2854141370 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.048+0000 7f285a3b0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28540cea40 con 0x7f285415b1f0 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.048+0000 7f285a3b0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28540ced20 con 0x7f28540cc7c0 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.048+0000 7f285894d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f285406a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.048+0000 7f2853fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f285415b1f0 0x7f28540ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.048+0000 7f285894d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f285406a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:43096/0 (socket says 172.21.15.2:43096) 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.048+0000 7f285894d640 1 -- 172.21.15.2:0/224981740 learned_addr learned my addr 172.21.15.2:0/224981740 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.049+0000 7f285894d640 1 -- 172.21.15.2:0/224981740 >> v2:172.21.15.66:3300/0 conn(0x7f285415b1f0 msgr2=0x7f28540ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.049+0000 7f285894d640 1 --2- 172.21.15.2:0/224981740 >> v2:172.21.15.66:3300/0 conn(0x7f285415b1f0 0x7f28540ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.049+0000 7f285894d640 1 -- 172.21.15.2:0/224981740 >> v1:172.21.15.66:6789/0 conn(0x7f2854141370 legacy=0x7f28540cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:55.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.049+0000 7f285894d640 1 -- 172.21.15.2:0/224981740 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28540cf000 con 0x7f28540cc7c0 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.049+0000 7f285894d640 1 --2- 172.21.15.2:0/224981740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f285406a6d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f284c009e50 tx=0x7f284c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b32da35125c66d65 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f2852ffd640 1 -- 172.21.15.2:0/224981740 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c02cb00 con 0x7f28540cc7c0 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f2852ffd640 1 -- 172.21.15.2:0/224981740 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c02cc60 con 0x7f28540cc7c0 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f2852ffd640 1 -- 172.21.15.2:0/224981740 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c0343f0 con 0x7f28540cc7c0 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f285a3b0640 1 -- 172.21.15.2:0/224981740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 msgr2=0x7f285406a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f285a3b0640 1 --2- 172.21.15.2:0/224981740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f285406a6d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f284c009e50 tx=0x7f284c02bf60 comp rx=0 tx=0).stop 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f285a3b0640 1 -- 172.21.15.2:0/224981740 shutdown_connections 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f285a3b0640 1 --2- 172.21.15.2:0/224981740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f285406a6d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f285a3b0640 1 --2- 172.21.15.2:0/224981740 >> v2:172.21.15.66:3300/0 conn(0x7f285415b1f0 0x7f28540ce0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:55.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f285a3b0640 1 -- 172.21.15.2:0/224981740 >> 172.21.15.2:0/224981740 conn(0x7f28540cf6a0 msgr2=0x7f28540cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:55.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f285a3b0640 1 -- 172.21.15.2:0/224981740 shutdown_connections 2023-11-25T04:08:55.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.050+0000 7f285a3b0640 1 -- 172.21.15.2:0/224981740 wait complete. 2023-11-25T04:08:55.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.051+0000 7f285a3b0640 1 Processor -- start 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.052+0000 7f285a3b0640 1 -- start start 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.052+0000 7f285a3b0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f2854138f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.052+0000 7f285a3b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2854141370 0x7f285413f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.052+0000 7f285a3b0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f285415b1f0 0x7f2854139c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.052+0000 7f285a3b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28541401b0 con 0x7f2854141370 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.052+0000 7f285a3b0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285415be90 con 0x7f285415b1f0 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.052+0000 7f285a3b0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285415c170 con 0x7f28540cc7c0 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.052+0000 7f28537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2854141370 0x7f285413f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f28537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2854141370 0x7f285413f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44738/0 (socket says 172.21.15.2:44738) 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f28537fe640 1 -- 172.21.15.2:0/347911350 learned_addr learned my addr 172.21.15.2:0/347911350 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:55.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f2853fff640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f2854138f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f285894d640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f285415b1f0 0x7f2854139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f28537fe640 1 -- 172.21.15.2:0/347911350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 msgr2=0x7f2854138f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f28537fe640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f2854138f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f28537fe640 1 -- 172.21.15.2:0/347911350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f285415b1f0 msgr2=0x7f2854139c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f28537fe640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f285415b1f0 0x7f2854139c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f28537fe640 1 -- 172.21.15.2:0/347911350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c009b30 con 0x7f2854141370 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f28537fe640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2854141370 0x7f285413f750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f284400c450 tx=0x7f284400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f2850ff9640 1 -- 172.21.15.2:0/347911350 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440052d0 con 0x7f2854141370 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f2850ff9640 1 -- 172.21.15.2:0/347911350 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844005430 con 0x7f2854141370 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285415c450 con 0x7f2854141370 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f2850ff9640 1 -- 172.21.15.2:0/347911350 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844012870 con 0x7f2854141370 2023-11-25T04:08:55.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.053+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2854139470 con 0x7f2854141370 2023-11-25T04:08:55.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.054+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28540cd770 con 0x7f2854141370 2023-11-25T04:08:55.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.055+0000 7f2850ff9640 1 -- 172.21.15.2:0/347911350 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28440129d0 con 0x7f2854141370 2023-11-25T04:08:55.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.055+0000 7f2850ff9640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f284006ae40 0x7f284006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:55.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.055+0000 7f2850ff9640 1 -- 172.21.15.2:0/347911350 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2844088fd0 con 0x7f2854141370 2023-11-25T04:08:55.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.055+0000 7f2853fff640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f284006ae40 0x7f284006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:55.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.056+0000 7f2853fff640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f284006ae40 0x7f284006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2848009aa0 tx=0x7f2848009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:55.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.059+0000 7f2850ff9640 1 -- 172.21.15.2:0/347911350 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2844054120 con 0x7f2854141370 2023-11-25T04:08:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.271+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2854067420 con 0x7f2854141370 2023-11-25T04:08:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.272+0000 7f2850ff9640 1 -- 172.21.15.2:0/347911350 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2844057740 con 0x7f2854141370 2023-11-25T04:08:55.274 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-25T04:08:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f284006ae40 msgr2=0x7f284006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f284006ae40 0x7f284006d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2848009aa0 tx=0x7f2848009190 comp rx=0 tx=0).stop 2023-11-25T04:08:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2854141370 msgr2=0x7f285413f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2854141370 0x7f285413f750 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f284400c450 tx=0x7f284400c910 comp rx=0 tx=0).stop 2023-11-25T04:08:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 shutdown_connections 2023-11-25T04:08:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f284006ae40 0x7f284006d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f285415b1f0 0x7f2854139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2854141370 0x7f285413f750 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 --2- 172.21.15.2:0/347911350 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28540cc7c0 0x7f2854138f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.273+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 >> 172.21.15.2:0/347911350 conn(0x7f28540cf6a0 msgr2=0x7f28540b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.274+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 shutdown_connections 2023-11-25T04:08:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:55.274+0000 7f285a3b0640 1 -- 172.21.15.2:0/347911350 wait complete. 2023-11-25T04:08:55.286 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-25T04:08:55.286 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-25T04:08:55.286 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2023-11-25T04:08:55.287 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-25T04:08:55.287 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-25T04:08:55.287 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-25T04:08:55.287 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-25T04:08:55.287 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-25T04:08:55.287 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-25T04:08:55.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:55.287 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2023-11-25T04:08:55.307 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42648sec preferred_lft 42648sec 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2023-11-25T04:08:55.308 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:55.308 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-25T04:08:55.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:55.309 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-11-25T04:08:55.309 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-11-25T04:08:55.309 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add name ceph-brx type bridge 2023-11-25T04:08:55.309 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr flush dev ceph-brx 2023-11-25T04:08:55.309 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set ceph-brx up 2023-11-25T04:08:55.309 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-25T04:08:55.309 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-11-25T04:08:55.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:55.507 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-25T04:08:55.538 INFO:teuthology.orchestra.run.smithi066.stdout:1 2023-11-25T04:08:55.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:55.540 DEBUG:teuthology.orchestra.run.smithi066:> route 2023-11-25T04:08:55.607 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2023-11-25T04:08:55.608 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-25T04:08:55.608 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-25T04:08:55.608 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-25T04:08:55.608 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-25T04:08:55.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:55.609 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-11-25T04:08:55.609 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-11-25T04:08:55.609 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-25T04:08:55.609 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-25T04:08:55.610 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-25T04:08:55.610 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-11-25T04:08:55.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:55.900 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2023-11-25T04:08:55.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:55.915 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2023-11-25T04:08:55.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:55.970 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-11-25T04:08:55.970 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-11-25T04:08:55.970 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:55.970 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-25T04:08:55.970 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-11-25T04:08:56.060 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-25T04:08:56.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:56.060 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-11-25T04:08:56.060 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-11-25T04:08:56.060 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-25T04:08:56.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-25T04:08:56.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-25T04:08:56.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-25T04:08:56.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-25T04:08:56.061 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-11-25T04:08:56.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:56.176 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-11-25T04:08:56.176 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-11-25T04:08:56.176 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2023-11-25T04:08:56.176 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.0 master ceph-brx 2023-11-25T04:08:56.176 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-11-25T04:08:56.225 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-11-25T04:08:56.225 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:08:56.225 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-25T04:08:56.240 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-25T04:08:56.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:08:56.241 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-25T04:08:56.297 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2023-11-25T04:08:56.368 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:08:56.424 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2023-11-25T04:08:56.424 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2023-11-25T04:08:56.424 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2023-11-25T04:08:56.424 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2023-11-25T04:08:56.424 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2023-11-25T04:08:56.424 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2023-11-25T04:08:56.424 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:08:56.425 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-4 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-5 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-6 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-7 2023-11-25T04:08:56.426 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2023-11-25T04:08:56.427 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:56.427 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:56.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:56.427 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2023-11-25T04:08:56.480 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-25T04:08:56.480 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-11-25T04:08:56.522 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2023-11-25T04:08:56.552 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2023-11-25T04:08:56.609 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:08:56.610 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-4 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-5 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-6 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-7 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:56.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:56.612 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2023-11-25T04:08:56.657 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi066.stderr:2023-11-25T04:08:56.656+0000 7f5253a45480 -1 init, newargv = 0x5646cde1d5f0 newargc=15 2023-11-25T04:08:56.657 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi066.stderr:ceph-fuse[95626]: starting ceph client 2023-11-25T04:08:56.662 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi066.stderr:ceph-fuse[95626]: starting fuse 2023-11-25T04:08:56.666 INFO:teuthology.orchestra.run.smithi066.stdout:41 2023-11-25T04:08:56.666 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-11-25T04:08:56.666 DEBUG:teuthology.orchestra.run.smithi066:> sudo stdin-killer -- python3 -c ' 2023-11-25T04:08:56.666 DEBUG:teuthology.orchestra.run.smithi066:> import glob 2023-11-25T04:08:56.666 DEBUG:teuthology.orchestra.run.smithi066:> import re 2023-11-25T04:08:56.666 DEBUG:teuthology.orchestra.run.smithi066:> import os 2023-11-25T04:08:56.666 DEBUG:teuthology.orchestra.run.smithi066:> import subprocess 2023-11-25T04:08:56.666 DEBUG:teuthology.orchestra.run.smithi066:> 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> def _find_admin_socket(client_name): 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> files = glob.glob(asok_path) 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> # Given a non-glob path, it better be there 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> if "*" not in asok_path: 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> assert(len(files) == 1) 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> return files[0] 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> for f in files: 2023-11-25T04:08:56.667 DEBUG:teuthology.orchestra.run.smithi066:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-25T04:08:56.668 DEBUG:teuthology.orchestra.run.smithi066:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-25T04:08:56.668 DEBUG:teuthology.orchestra.run.smithi066:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-25T04:08:56.668 DEBUG:teuthology.orchestra.run.smithi066:> contents = proc_f.read() 2023-11-25T04:08:56.668 DEBUG:teuthology.orchestra.run.smithi066:> if mountpoint in contents: 2023-11-25T04:08:56.668 DEBUG:teuthology.orchestra.run.smithi066:> return f 2023-11-25T04:08:56.668 DEBUG:teuthology.orchestra.run.smithi066:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-25T04:08:56.668 DEBUG:teuthology.orchestra.run.smithi066:> 2023-11-25T04:08:56.668 DEBUG:teuthology.orchestra.run.smithi066:> print(_find_admin_socket("client.1")) 2023-11-25T04:08:56.668 DEBUG:teuthology.orchestra.run.smithi066:> ' 2023-11-25T04:08:56.791 INFO:teuthology.orchestra.run.smithi066.stdout:/var/run/ceph/ceph-client.1.95626.asok 2023-11-25T04:08:56.795 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-25T04:08:56.802 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.95626.asok 2023-11-25T04:08:56.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:56.802 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.95626.asok status 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: "metadata": { 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_sha1": "ec928368edcc5fc71884a56fd9fd821b148f4e30", 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 18.0.0-7506-gec928368 (ec928368edcc5fc71884a56fd9fd821b148f4e30) reef (dev)", 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: "entity_id": "1", 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: "hostname": "smithi066", 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: "pid": "95626", 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: "root": "/" 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2023-11-25T04:08:56.945 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_count": 0, 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_pinned_count": 0, 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 4684, 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "inst": { 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "name": { 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "client", 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "num": 4684 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.1:0", 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2194205721 2023-11-25T04:08:56.946 INFO:teuthology.orchestra.run.smithi066.stdout: } 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.1:0", 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 2194205721 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "inst_str": "client.4684 192.168.0.1:0/2194205721", 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "addr_str": "192.168.0.1:0/2194205721", 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "inode_count": 1, 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_epoch": 8, 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch": 20, 2023-11-25T04:08:56.947 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch_barrier": 0, 2023-11-25T04:08:56.948 INFO:teuthology.orchestra.run.smithi066.stdout: "blocklisted": false, 2023-11-25T04:08:56.948 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs" 2023-11-25T04:08:56.948 INFO:teuthology.orchestra.run.smithi066.stdout:} 2023-11-25T04:08:56.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-25T04:08:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.070+0000 7ff7fc636640 1 Processor -- start 2023-11-25T04:08:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.070+0000 7ff7fc636640 1 -- start start 2023-11-25T04:08:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.071+0000 7ff7fc636640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40cce70 0x7ff7f4099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.071+0000 7ff7fc636640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff7f40d1c50 0x7ff7f4099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.071+0000 7ff7fc636640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40d03a0 con 0x7ff7f40d0ab0 2023-11-25T04:08:57.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.071+0000 7ff7fc636640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f406bfa0 con 0x7ff7f40d1c50 2023-11-25T04:08:57.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.071+0000 7ff7fc636640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f406f9d0 con 0x7ff7f40cce70 2023-11-25T04:08:57.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.071+0000 7ff7f9bd1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff7f40d0ab0 0x7ff7f406e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:59548/0 (socket says 172.21.15.2:59548) 2023-11-25T04:08:57.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.071+0000 7ff7f9bd1640 1 -- 172.21.15.2:0/2551656839 learned_addr learned my addr 172.21.15.2:0/2551656839 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:57.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.071+0000 7ff7fabd3640 1 --2- 172.21.15.2:0/2551656839 >> v2:172.21.15.2:3300/0 conn(0x7ff7f40d1c50 0x7ff7f4099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:57.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.071+0000 7ff7fa3d2640 1 --2- 172.21.15.2:0/2551656839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40cce70 0x7ff7f4099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:57.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.072+0000 7ff7fabd3640 1 -- 172.21.15.2:0/2551656839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40cce70 msgr2=0x7ff7f4099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:57.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.072+0000 7ff7fabd3640 1 --2- 172.21.15.2:0/2551656839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40cce70 0x7ff7f4099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.072+0000 7ff7fabd3640 1 -- 172.21.15.2:0/2551656839 >> v1:172.21.15.2:6789/0 conn(0x7ff7f40d0ab0 legacy=0x7ff7f406e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.072+0000 7ff7f93d0640 1 -- 172.21.15.2:0/2551656839 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816957530 0 0) 0x7ff7f40d03a0 con 0x7ff7f40d0ab0 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.072+0000 7ff7fabd3640 1 -- 172.21.15.2:0/2551656839 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f406c190 con 0x7ff7f40d1c50 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.072+0000 7ff7fabd3640 1 --2- 172.21.15.2:0/2551656839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40d1c50 0x7ff7f4099eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009d90 tx=0x7ff7ec02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921a0f9f1189425e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7f93d0640 1 -- 172.21.15.2:0/2551656839 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec02cc50 con 0x7ff7f40d1c50 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7f93d0640 1 -- 172.21.15.2:0/2551656839 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec02cdb0 con 0x7ff7f40d1c50 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7f93d0640 1 -- 172.21.15.2:0/2551656839 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec034660 con 0x7ff7f40d1c50 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7fc636640 1 -- 172.21.15.2:0/2551656839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40d1c50 msgr2=0x7ff7f4099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7fc636640 1 --2- 172.21.15.2:0/2551656839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40d1c50 0x7ff7f4099eb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec009d90 tx=0x7ff7ec02bea0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7fc636640 1 -- 172.21.15.2:0/2551656839 shutdown_connections 2023-11-25T04:08:57.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7fc636640 1 --2- 172.21.15.2:0/2551656839 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40d1c50 0x7ff7f4099eb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7fc636640 1 --2- 172.21.15.2:0/2551656839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40cce70 0x7ff7f4099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7fc636640 1 -- 172.21.15.2:0/2551656839 >> 172.21.15.2:0/2551656839 conn(0x7ff7f40d0f20 msgr2=0x7ff7f40d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7fc636640 1 -- 172.21.15.2:0/2551656839 shutdown_connections 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.073+0000 7ff7fc636640 1 -- 172.21.15.2:0/2551656839 wait complete. 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.074+0000 7ff7fc636640 1 Processor -- start 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fc636640 1 -- start start 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fc636640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40cce70 0x7ff7f414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fc636640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7f40d0ab0 0x7ff7f40c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fc636640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40d1c50 0x7ff7f40c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fc636640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40c63f0 con 0x7ff7f40cce70 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fc636640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40c5350 con 0x7ff7f40d0ab0 2023-11-25T04:08:57.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fc636640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40c5630 con 0x7ff7f40d1c50 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fa3d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40cce70 0x7ff7f414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fa3d2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40cce70 0x7ff7f414f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:44756/0 (socket says 172.21.15.2:44756) 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fa3d2640 1 -- 172.21.15.2:0/2032356402 learned_addr learned my addr 172.21.15.2:0/2032356402 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7fabd3640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40d1c50 0x7ff7f40c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.075+0000 7ff7f9bd1640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7f40d0ab0 0x7ff7f40c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7fa3d2640 1 -- 172.21.15.2:0/2032356402 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40d1c50 msgr2=0x7ff7f40c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7fa3d2640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40d1c50 0x7ff7f40c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7fa3d2640 1 -- 172.21.15.2:0/2032356402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7f40d0ab0 msgr2=0x7ff7f40c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7fa3d2640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7f40d0ab0 0x7ff7f40c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7fa3d2640 1 -- 172.21.15.2:0/2032356402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec009a70 con 0x7ff7f40cce70 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7fa3d2640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40cce70 0x7ff7f414f1e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000e9b0 tx=0x7ff7f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7eaffd640 1 -- 172.21.15.2:0/2032356402 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0009670 con 0x7ff7f40cce70 2023-11-25T04:08:57.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7eaffd640 1 -- 172.21.15.2:0/2032356402 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f000c9a0 con 0x7ff7f40cce70 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f40c5910 con 0x7ff7f40cce70 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7eaffd640 1 -- 172.21.15.2:0/2032356402 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f000cd50 con 0x7ff7f40cce70 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.076+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f40c5ed0 con 0x7ff7f40cce70 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.077+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f406e2f0 con 0x7ff7f40cce70 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.078+0000 7ff7eaffd640 1 -- 172.21.15.2:0/2032356402 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7f0013470 con 0x7ff7f40cce70 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.078+0000 7ff7eaffd640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff7d806ae40 0x7ff7d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.078+0000 7ff7eaffd640 1 -- 172.21.15.2:0/2032356402 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7f0089810 con 0x7ff7f40cce70 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.078+0000 7ff7f9bd1640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff7d806ae40 0x7ff7d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.079+0000 7ff7f9bd1640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff7d806ae40 0x7ff7d806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40b14b0 tx=0x7ff7e4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:57.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.083+0000 7ff7eaffd640 1 -- 172.21.15.2:0/2032356402 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff7f0054970 con 0x7ff7f40cce70 2023-11-25T04:08:57.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.304+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff7f4067420 con 0x7ff7f40cce70 2023-11-25T04:08:57.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.304+0000 7ff7eaffd640 1 -- 172.21.15.2:0/2032356402 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff7f0017070 con 0x7ff7f40cce70 2023-11-25T04:08:57.306 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-25T04:08:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff7d806ae40 msgr2=0x7ff7d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff7d806ae40 0x7ff7d806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40b14b0 tx=0x7ff7e4007d50 comp rx=0 tx=0).stop 2023-11-25T04:08:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40cce70 msgr2=0x7ff7f414f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40cce70 0x7ff7f414f1e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000e9b0 tx=0x7ff7f000ee70 comp rx=0 tx=0).stop 2023-11-25T04:08:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 shutdown_connections 2023-11-25T04:08:57.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7f40d1c50 0x7ff7f40c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff7d806ae40 0x7ff7d806d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7f40d0ab0 0x7ff7f40c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 --2- 172.21.15.2:0/2032356402 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff7f40cce70 0x7ff7f414f1e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 >> 172.21.15.2:0/2032356402 conn(0x7ff7f40d0f20 msgr2=0x7ff7f40d1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 shutdown_connections 2023-11-25T04:08:57.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:57.306+0000 7ff7fc636640 1 -- 172.21.15.2:0/2032356402 wait complete. 2023-11-25T04:08:57.319 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-25T04:08:57.319 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-25T04:08:57.319 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2023-11-25T04:08:57.319 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-25T04:08:57.319 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-25T04:08:57.319 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-25T04:08:57.319 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-25T04:08:57.319 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-25T04:08:57.319 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-25T04:08:57.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.320 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2023-11-25T04:08:57.336 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-25T04:08:57.336 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-25T04:08:57.336 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2023-11-25T04:08:57.336 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.336 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2023-11-25T04:08:57.336 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-25T04:08:57.337 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42646sec preferred_lft 42646sec 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 7e:76:63:3a:6c:b6 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::881:31ff:fee4:5849/64 scope link 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 7e:76:63:3a:6c:b6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::7c76:63ff:fe3a:6cb6/64 scope link tentative 2023-11-25T04:08:57.338 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.339 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-25T04:08:57.406 INFO:teuthology.orchestra.run.smithi066.stdout:1 2023-11-25T04:08:57.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.408 DEBUG:teuthology.orchestra.run.smithi066:> route 2023-11-25T04:08:57.465 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2023-11-25T04:08:57.465 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-25T04:08:57.465 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-25T04:08:57.465 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-25T04:08:57.465 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-25T04:08:57.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.466 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-11-25T04:08:57.466 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-11-25T04:08:57.466 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-25T04:08:57.466 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-25T04:08:57.466 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-25T04:08:57.466 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-11-25T04:08:57.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.572 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2023-11-25T04:08:57.587 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-25T04:08:57.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.587 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2023-11-25T04:08:57.643 INFO:teuthology.orchestra.run.smithi066.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-25T04:08:57.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.643 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-11-25T04:08:57.644 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-11-25T04:08:57.644 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-25T04:08:57.644 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-25T04:08:57.644 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-11-25T04:08:57.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-25T04:08:57.763 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-25T04:08:57.763 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:82:c1:e0:52:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c82:c1ff:fee0:5290/64 scope link tentative 2023-11-25T04:08:57.764 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.765 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-25T04:08:57.836 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-25T04:08:57.837 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-25T04:08:57.837 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2023-11-25T04:08:57.837 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.837 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2023-11-25T04:08:57.837 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.837 INFO:teuthology.orchestra.run.smithi066.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-25T04:08:57.837 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0e:82:c1:e0:52:90 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-25T04:08:57.837 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-25T04:08:57.837 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.838 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::c82:c1ff:fee0:5290/64 scope link 2023-11-25T04:08:57.838 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:08:57.839 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-25T04:08:57.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.839 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-11-25T04:08:57.839 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-11-25T04:08:57.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-25T04:08:57.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-25T04:08:57.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-25T04:08:57.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-25T04:08:57.840 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-25T04:08:57.840 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-11-25T04:08:57.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:57.981 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-11-25T04:08:57.981 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-11-25T04:08:57.981 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.1 up 2023-11-25T04:08:57.981 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.1 master ceph-brx 2023-11-25T04:08:57.981 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-11-25T04:08:58.030 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-11-25T04:08:58.030 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:08:58.030 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-25T04:08:58.044 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-25T04:08:58.045 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:08:58.045 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-25T04:08:58.100 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2023-11-25T04:08:58.171 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:08:58.227 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2023-11-25T04:08:58.227 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2023-11-25T04:08:58.227 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2023-11-25T04:08:58.227 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2023-11-25T04:08:58.228 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-4 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-5 2023-11-25T04:08:58.229 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-6 2023-11-25T04:08:58.230 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-7 2023-11-25T04:08:58.230 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2023-11-25T04:08:58.230 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:58.230 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:58.230 INFO:teuthology.orchestra.run.smithi066.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-25T04:08:58.230 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-25T04:08:58.230 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-25T04:08:58.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:58.230 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2023-11-25T04:08:58.284 INFO:teuthology.orchestra.run.smithi066.stdout:41 2023-11-25T04:08:58.284 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-11-25T04:08:58.285 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-11-25T04:08:58.327 DEBUG:teuthology.orchestra.run.smithi066:> sudo modprobe fuse 2023-11-25T04:08:58.359 DEBUG:teuthology.orchestra.run.smithi066:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:08:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:/proc 2023-11-25T04:08:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:/sys 2023-11-25T04:08:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:/dev 2023-11-25T04:08:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/security 2023-11-25T04:08:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/shm 2023-11-25T04:08:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/pts 2023-11-25T04:08:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:/run 2023-11-25T04:08:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/cgroup 2023-11-25T04:08:58.415 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/pstore 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/bpf 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/ 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/selinux 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/hugepages 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/mqueue 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/debug 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/tracing 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/fs/fuse/connections 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/sys/kernel/config 2023-11-25T04:08:58.416 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/run/user/1000 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-4 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-5 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-6 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/var/lib/ceph/osd/ceph-7 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/home/ubuntu/cephtest/mnt.1 2023-11-25T04:08:58.417 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-25T04:08:58.418 INFO:teuthology.orchestra.run.smithi066.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-25T04:08:58.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:58.418 DEBUG:teuthology.orchestra.run.smithi066:> ls /sys/fs/fuse/connections 2023-11-25T04:08:58.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi066.stderr:2023-11-25T04:08:58.419+0000 7f4118a39480 -1 init, newargv = 0x55747b5fa9d0 newargc=15 2023-11-25T04:08:58.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi066.stderr:ceph-fuse[96060]: starting ceph client 2023-11-25T04:08:58.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi066.stderr:ceph-fuse[96060]: starting fuse 2023-11-25T04:08:58.435 INFO:teuthology.orchestra.run.smithi066.stdout:41 2023-11-25T04:08:58.436 INFO:teuthology.orchestra.run.smithi066.stdout:44 2023-11-25T04:08:58.436 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-11-25T04:08:58.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo stdin-killer -- python3 -c ' 2023-11-25T04:08:58.436 DEBUG:teuthology.orchestra.run.smithi066:> import glob 2023-11-25T04:08:58.436 DEBUG:teuthology.orchestra.run.smithi066:> import re 2023-11-25T04:08:58.436 DEBUG:teuthology.orchestra.run.smithi066:> import os 2023-11-25T04:08:58.436 DEBUG:teuthology.orchestra.run.smithi066:> import subprocess 2023-11-25T04:08:58.436 DEBUG:teuthology.orchestra.run.smithi066:> 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> def _find_admin_socket(client_name): 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> files = glob.glob(asok_path) 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> # Given a non-glob path, it better be there 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> if "*" not in asok_path: 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> assert(len(files) == 1) 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> return files[0] 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> for f in files: 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-25T04:08:58.437 DEBUG:teuthology.orchestra.run.smithi066:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-25T04:08:58.438 DEBUG:teuthology.orchestra.run.smithi066:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-25T04:08:58.438 DEBUG:teuthology.orchestra.run.smithi066:> contents = proc_f.read() 2023-11-25T04:08:58.438 DEBUG:teuthology.orchestra.run.smithi066:> if mountpoint in contents: 2023-11-25T04:08:58.438 DEBUG:teuthology.orchestra.run.smithi066:> return f 2023-11-25T04:08:58.438 DEBUG:teuthology.orchestra.run.smithi066:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-25T04:08:58.438 DEBUG:teuthology.orchestra.run.smithi066:> 2023-11-25T04:08:58.438 DEBUG:teuthology.orchestra.run.smithi066:> print(_find_admin_socket("client.3")) 2023-11-25T04:08:58.440 DEBUG:teuthology.orchestra.run.smithi066:> ' 2023-11-25T04:08:58.561 INFO:teuthology.orchestra.run.smithi066.stdout:/var/run/ceph/ceph-client.3.96060.asok 2023-11-25T04:08:58.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-11-25T04:08:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-25T04:08:58.571 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.96060.asok 2023-11-25T04:08:58.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:58.571 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.96060.asok status 2023-11-25T04:08:58.713 INFO:teuthology.orchestra.run.smithi066.stdout:{ 2023-11-25T04:08:58.713 INFO:teuthology.orchestra.run.smithi066.stdout: "metadata": { 2023-11-25T04:08:58.713 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_sha1": "ec928368edcc5fc71884a56fd9fd821b148f4e30", 2023-11-25T04:08:58.713 INFO:teuthology.orchestra.run.smithi066.stdout: "ceph_version": "ceph version 18.0.0-7506-gec928368 (ec928368edcc5fc71884a56fd9fd821b148f4e30) reef (dev)", 2023-11-25T04:08:58.713 INFO:teuthology.orchestra.run.smithi066.stdout: "entity_id": "3", 2023-11-25T04:08:58.713 INFO:teuthology.orchestra.run.smithi066.stdout: "hostname": "smithi066", 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "pid": "96060", 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "root": "/" 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_count": 0, 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "dentry_pinned_count": 0, 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "id": 4693, 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "inst": { 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "name": { 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "client", 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: "num": 4693 2023-11-25T04:08:58.714 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.2:0", 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1539740763 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: } 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": { 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: "type": "v1", 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: "addr": "192.168.0.2:0", 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: "nonce": 1539740763 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: }, 2023-11-25T04:08:58.715 INFO:teuthology.orchestra.run.smithi066.stdout: "inst_str": "client.4693 192.168.0.2:0/1539740763", 2023-11-25T04:08:58.716 INFO:teuthology.orchestra.run.smithi066.stdout: "addr_str": "192.168.0.2:0/1539740763", 2023-11-25T04:08:58.716 INFO:teuthology.orchestra.run.smithi066.stdout: "inode_count": 1, 2023-11-25T04:08:58.716 INFO:teuthology.orchestra.run.smithi066.stdout: "mds_epoch": 8, 2023-11-25T04:08:58.716 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch": 20, 2023-11-25T04:08:58.716 INFO:teuthology.orchestra.run.smithi066.stdout: "osd_epoch_barrier": 0, 2023-11-25T04:08:58.716 INFO:teuthology.orchestra.run.smithi066.stdout: "blocklisted": false, 2023-11-25T04:08:58.716 INFO:teuthology.orchestra.run.smithi066.stdout: "fs_name": "cephfs" 2023-11-25T04:08:58.716 INFO:teuthology.orchestra.run.smithi066.stdout:} 2023-11-25T04:08:58.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:58.721 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2023-11-25T04:08:58.721 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-25T04:08:58.741 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-25T04:08:58.741 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-25T04:08:58.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:58.742 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-25T04:08:58.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:58.820 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2023-11-25T04:08:58.820 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.2 2023-11-25T04:08:58.878 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-25T04:08:58.878 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-11-25T04:08:58.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:58.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-25T04:08:58.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:58.956 DEBUG:teuthology.orchestra.run.smithi066:> stat --file-system '--printf=%T 2023-11-25T04:08:58.956 DEBUG:teuthology.orchestra.run.smithi066:> ' -- /home/ubuntu/cephtest/mnt.1 2023-11-25T04:08:58.973 INFO:teuthology.orchestra.run.smithi066.stdout:fuseblk 2023-11-25T04:08:58.974 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-11-25T04:08:58.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:58.974 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-25T04:08:59.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:59.045 DEBUG:teuthology.orchestra.run.smithi066:> stat --file-system '--printf=%T 2023-11-25T04:08:59.045 DEBUG:teuthology.orchestra.run.smithi066:> ' -- /home/ubuntu/cephtest/mnt.3 2023-11-25T04:08:59.101 INFO:teuthology.orchestra.run.smithi066.stdout:fuseblk 2023-11-25T04:08:59.101 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-11-25T04:08:59.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:08:59.101 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-25T04:08:59.173 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-25T04:08:59.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:08:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.305+0000 7fa33fd8a640 1 Processor -- start 2023-11-25T04:08:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.305+0000 7fa33fd8a640 1 -- start start 2023-11-25T04:08:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33fd8a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa3380b2690 0x7fa33815d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33fd8a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa33806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33fd8a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33806e9e0 con 0x7fa33806cc50 2023-11-25T04:08:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33fd8a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33806d0d0 con 0x7fa3380b2690 2023-11-25T04:08:59.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33fd8a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33806d2e0 con 0x7fa33806a8b0 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33d325640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fa33806cc50 0x7fa3380b2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50584/0 (socket says 172.21.15.2:50584) 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33d325640 1 -- 172.21.15.2:0/786181886 learned_addr learned my addr 172.21.15.2:0/786181886 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33db26640 1 --2- 172.21.15.2:0/786181886 >> v2:172.21.15.66:3300/0 conn(0x7fa3380b2690 0x7fa33815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33e327640 1 --2- 172.21.15.2:0/786181886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa33806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33cb24640 1 -- 172.21.15.2:0/786181886 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238175626 0 0) 0x7fa33806e9e0 con 0x7fa33806cc50 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33cb24640 1 -- 172.21.15.2:0/786181886 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa324003520 con 0x7fa33806cc50 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33db26640 1 -- 172.21.15.2:0/786181886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 msgr2=0x7fa33806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33db26640 1 --2- 172.21.15.2:0/786181886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa33806ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33db26640 1 -- 172.21.15.2:0/786181886 >> v1:172.21.15.2:6789/0 conn(0x7fa33806cc50 legacy=0x7fa3380b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.310 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33db26640 1 -- 172.21.15.2:0/786181886 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33806de60 con 0x7fa3380b2690 2023-11-25T04:08:59.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.306+0000 7fa33e327640 1 --2- 172.21.15.2:0/786181886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa33806ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:08:59.313 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.307+0000 7fa33db26640 1 --2- 172.21.15.2:0/786181886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3380b2690 0x7fa33815d800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3340097a0 tx=0x7fa33402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abc46507a67ac80c server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.307+0000 7fa33cb24640 1 -- 172.21.15.2:0/786181886 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33402e070 con 0x7fa3380b2690 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.307+0000 7fa33cb24640 1 -- 172.21.15.2:0/786181886 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3340315a0 con 0x7fa3380b2690 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.308+0000 7fa33cb24640 1 -- 172.21.15.2:0/786181886 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa334031930 con 0x7fa3380b2690 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.308+0000 7fa33fd8a640 1 -- 172.21.15.2:0/786181886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3380b2690 msgr2=0x7fa33815d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.308+0000 7fa33fd8a640 1 --2- 172.21.15.2:0/786181886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3380b2690 0x7fa33815d800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa3340097a0 tx=0x7fa33402b840 comp rx=0 tx=0).stop 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.308+0000 7fa33fd8a640 1 -- 172.21.15.2:0/786181886 shutdown_connections 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.308+0000 7fa33fd8a640 1 --2- 172.21.15.2:0/786181886 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa33806ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.308+0000 7fa33fd8a640 1 --2- 172.21.15.2:0/786181886 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3380b2690 0x7fa33815d800 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.308+0000 7fa33fd8a640 1 -- 172.21.15.2:0/786181886 >> 172.21.15.2:0/786181886 conn(0x7fa3380cf6a0 msgr2=0x7fa3380cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.308+0000 7fa33fd8a640 1 -- 172.21.15.2:0/786181886 shutdown_connections 2023-11-25T04:08:59.314 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.308+0000 7fa33fd8a640 1 -- 172.21.15.2:0/786181886 wait complete. 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.309+0000 7fa33fd8a640 1 Processor -- start 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.309+0000 7fa33fd8a640 1 -- start start 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33fd8a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa3380cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33fd8a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa33806cc50 0x7fa3381547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33fd8a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3380b2690 0x7fa338147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33fd8a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338153740 con 0x7fa3380b2690 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33fd8a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338153a00 con 0x7fa33806cc50 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33fd8a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa338153ce0 con 0x7fa33806a8b0 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33e327640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3380b2690 0x7fa338147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33e327640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3380b2690 0x7fa338147010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35188/0 (socket says 172.21.15.2:35188) 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33e327640 1 -- 172.21.15.2:0/970790813 learned_addr learned my addr 172.21.15.2:0/970790813 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:59.315 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33db26640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa3380cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.310+0000 7fa33d325640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa33806cc50 0x7fa3381547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33e327640 1 -- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 msgr2=0x7fa3380cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33e327640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa3380cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33e327640 1 -- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa33806cc50 msgr2=0x7fa3381547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33e327640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa33806cc50 0x7fa3381547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33e327640 1 -- 172.21.15.2:0/970790813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330009a70 con 0x7fa3380b2690 2023-11-25T04:08:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33db26640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa3380cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33d325640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa33806cc50 0x7fa3381547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:59.316 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33e327640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3380b2690 0x7fa338147010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa33000efc0 tx=0x7fa330009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa32e7fc640 1 -- 172.21.15.2:0/970790813 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330009d70 con 0x7fa3380b2690 2023-11-25T04:08:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa32e7fc640 1 -- 172.21.15.2:0/970790813 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33000f040 con 0x7fa3380b2690 2023-11-25T04:08:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa334009400 con 0x7fa3380b2690 2023-11-25T04:08:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa32e7fc640 1 -- 172.21.15.2:0/970790813 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330003990 con 0x7fa3380b2690 2023-11-25T04:08:59.317 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.311+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3381542a0 con 0x7fa3380b2690 2023-11-25T04:08:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.312+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3381544c0 con 0x7fa3380b2690 2023-11-25T04:08:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.312+0000 7fa32e7fc640 1 -- 172.21.15.2:0/970790813 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3300144a0 con 0x7fa3380b2690 2023-11-25T04:08:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.313+0000 7fa32e7fc640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa31c06ae40 0x7fa31c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.313+0000 7fa33db26640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa31c06ae40 0x7fa31c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.313+0000 7fa32e7fc640 1 -- 172.21.15.2:0/970790813 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa33008a280 con 0x7fa3380b2690 2023-11-25T04:08:59.318 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.314+0000 7fa33db26640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa31c06ae40 0x7fa31c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa334036000 tx=0x7fa33403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:59.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.317+0000 7fa32e7fc640 1 -- 172.21.15.2:0/970790813 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa330055330 con 0x7fa3380b2690 2023-11-25T04:08:59.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.495+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa338067420 con 0x7fa3380b2690 2023-11-25T04:08:59.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.496+0000 7fa32e7fc640 1 -- 172.21.15.2:0/970790813 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fa330058950 con 0x7fa3380b2690 2023-11-25T04:08:59.499 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:08:59.499 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:08:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa31c06ae40 msgr2=0x7fa31c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa31c06ae40 0x7fa31c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa334036000 tx=0x7fa33403d040 comp rx=0 tx=0).stop 2023-11-25T04:08:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3380b2690 msgr2=0x7fa338147010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3380b2690 0x7fa338147010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa33000efc0 tx=0x7fa330009f90 comp rx=0 tx=0).stop 2023-11-25T04:08:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 shutdown_connections 2023-11-25T04:08:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa3380b2690 0x7fa338147010 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa31c06ae40 0x7fa31c06d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.501 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa33806cc50 0x7fa3381547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 --2- 172.21.15.2:0/970790813 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa33806a8b0 0x7fa3380cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.498+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 >> 172.21.15.2:0/970790813 conn(0x7fa3380cf6a0 msgr2=0x7fa3380b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.499+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 shutdown_connections 2023-11-25T04:08:59.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.499+0000 7fa33fd8a640 1 -- 172.21.15.2:0/970790813 wait complete. 2023-11-25T04:08:59.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:08:59.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:08:59.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f968af0f640 1 Processor -- start 2023-11-25T04:08:59.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f968af0f640 1 -- start start 2023-11-25T04:08:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f968af0f640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f968406efd0 0x7f96840ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f968af0f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96840b3610 0x7f9684160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f968af0f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968406b4e0 con 0x7f9684161370 2023-11-25T04:08:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f968af0f640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9684161820 con 0x7f968406efd0 2023-11-25T04:08:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f968af0f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96840b3aa0 con 0x7f96840b3610 2023-11-25T04:08:59.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f9688cab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f968406efd0 0x7f96840ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f9688cab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f968406efd0 0x7f96840ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35194/0 (socket says 172.21.15.2:35194) 2023-11-25T04:08:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f9688cab640 1 -- 172.21.15.2:0/528368089 learned_addr learned my addr 172.21.15.2:0/528368089 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f9683fff640 1 --2- 172.21.15.2:0/528368089 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96840b3610 0x7f9684160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f9688cab640 1 -- 172.21.15.2:0/528368089 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96840b3610 msgr2=0x7f9684160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f9688cab640 1 --2- 172.21.15.2:0/528368089 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96840b3610 0x7f9684160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f9688cab640 1 -- 172.21.15.2:0/528368089 >> v1:172.21.15.66:6789/0 conn(0x7f9684161370 legacy=0x7f968415d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:59.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f9688cab640 1 -- 172.21.15.2:0/528368089 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840b3d80 con 0x7f968406efd0 2023-11-25T04:08:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.621+0000 7f9683fff640 1 --2- 172.21.15.2:0/528368089 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96840b3610 0x7f9684160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f9688cab640 1 --2- 172.21.15.2:0/528368089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 0x7f96840ad690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9678009870 tx=0x7f967802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=493d0c1968d7dd98 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f96837fe640 1 -- 172.21.15.2:0/528368089 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678031640 con 0x7f968406efd0 2023-11-25T04:08:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f96837fe640 1 -- 172.21.15.2:0/528368089 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96780317a0 con 0x7f968406efd0 2023-11-25T04:08:59.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f96837fe640 1 -- 172.21.15.2:0/528368089 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678031b30 con 0x7f968406efd0 2023-11-25T04:08:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f968af0f640 1 -- 172.21.15.2:0/528368089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 msgr2=0x7f96840ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f968af0f640 1 --2- 172.21.15.2:0/528368089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 0x7f96840ad690 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9678009870 tx=0x7f967802b8f0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f968af0f640 1 -- 172.21.15.2:0/528368089 shutdown_connections 2023-11-25T04:08:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f968af0f640 1 --2- 172.21.15.2:0/528368089 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96840b3610 0x7f9684160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f968af0f640 1 --2- 172.21.15.2:0/528368089 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 0x7f96840ad690 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.622+0000 7f968af0f640 1 -- 172.21.15.2:0/528368089 >> 172.21.15.2:0/528368089 conn(0x7f96840b1670 msgr2=0x7f96840b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.623+0000 7f968af0f640 1 -- 172.21.15.2:0/528368089 shutdown_connections 2023-11-25T04:08:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.623+0000 7f968af0f640 1 -- 172.21.15.2:0/528368089 wait complete. 2023-11-25T04:08:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.624+0000 7f968af0f640 1 Processor -- start 2023-11-25T04:08:59.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.624+0000 7f968af0f640 1 -- start start 2023-11-25T04:08:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.624+0000 7f968af0f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 0x7f9684146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f968af0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684161370 0x7f9684155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f968af0f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9684150120 0x7f9684155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f968af0f640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96841f3320 con 0x7f968406efd0 2023-11-25T04:08:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f968af0f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96841466c0 con 0x7f9684161370 2023-11-25T04:08:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f968af0f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968415bc30 con 0x7f9684150120 2023-11-25T04:08:59.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9688cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 0x7f9684146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9688cab640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 0x7f9684146180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35196/0 (socket says 172.21.15.2:35196) 2023-11-25T04:08:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9688cab640 1 -- 172.21.15.2:0/3420484173 learned_addr learned my addr 172.21.15.2:0/3420484173 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f96894ac640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9684150120 0x7f9684155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9683fff640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684161370 0x7f9684155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9688cab640 1 -- 172.21.15.2:0/3420484173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9684150120 msgr2=0x7f9684155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9688cab640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9684150120 0x7f9684155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9688cab640 1 -- 172.21.15.2:0/3420484173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684161370 msgr2=0x7f9684155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9688cab640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684161370 0x7f9684155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9688cab640 1 -- 172.21.15.2:0/3420484173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96780094d0 con 0x7f968406efd0 2023-11-25T04:08:59.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9683fff640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684161370 0x7f9684155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:59.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f9688cab640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 0x7f9684146180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9678009870 tx=0x7f96780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:59.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f96817fa640 1 -- 172.21.15.2:0/3420484173 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967803ac60 con 0x7f968406efd0 2023-11-25T04:08:59.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f96817fa640 1 -- 172.21.15.2:0/3420484173 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967803ade0 con 0x7f968406efd0 2023-11-25T04:08:59.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9684157690 con 0x7f968406efd0 2023-11-25T04:08:59.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f96817fa640 1 -- 172.21.15.2:0/3420484173 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678044630 con 0x7f968406efd0 2023-11-25T04:08:59.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.625+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968415b8c0 con 0x7f968406efd0 2023-11-25T04:08:59.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.626+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968415ba80 con 0x7f968406efd0 2023-11-25T04:08:59.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.627+0000 7f96817fa640 1 -- 172.21.15.2:0/3420484173 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f967802f050 con 0x7f968406efd0 2023-11-25T04:08:59.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.627+0000 7f96817fa640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f966806ae40 0x7f966806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.627+0000 7f96817fa640 1 -- 172.21.15.2:0/3420484173 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96780ab810 con 0x7f968406efd0 2023-11-25T04:08:59.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.627+0000 7f9683fff640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f966806ae40 0x7f966806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.628+0000 7f9683fff640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f966806ae40 0x7f966806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9670006fd0 tx=0x7f9670008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:59.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.632+0000 7f96817fa640 1 -- 172.21.15.2:0/3420484173 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96780768f0 con 0x7f968406efd0 2023-11-25T04:08:59.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.805+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9684073590 con 0x7f968406efd0 2023-11-25T04:08:59.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.806+0000 7f96817fa640 1 -- 172.21.15.2:0/3420484173 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f96780350a0 con 0x7f968406efd0 2023-11-25T04:08:59.807 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:08:59.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f966806ae40 msgr2=0x7f966806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f966806ae40 0x7f966806d300 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9670006fd0 tx=0x7f9670008040 comp rx=0 tx=0).stop 2023-11-25T04:08:59.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 msgr2=0x7f9684146180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 0x7f9684146180 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9678009870 tx=0x7f96780046c0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 shutdown_connections 2023-11-25T04:08:59.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9684150120 0x7f9684155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f966806ae40 0x7f966806d300 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9684161370 0x7f9684155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 --2- 172.21.15.2:0/3420484173 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f968406efd0 0x7f9684146180 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 >> 172.21.15.2:0/3420484173 conn(0x7f96840b1670 msgr2=0x7f96840b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:59.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 shutdown_connections 2023-11-25T04:08:59.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.808+0000 7f968af0f640 1 -- 172.21.15.2:0/3420484173 wait complete. 2023-11-25T04:08:59.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:08:59.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.928+0000 7f880a768640 1 Processor -- start 2023-11-25T04:08:59.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.929+0000 7f880a768640 1 -- start start 2023-11-25T04:08:59.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.929+0000 7f880a768640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88040b6b50 0x7f88040cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.929+0000 7f880a768640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 0x7f880406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.929+0000 7f880a768640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88040b3590 con 0x7f8804099970 2023-11-25T04:08:59.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.929+0000 7f880a768640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f880406b310 con 0x7f88040b6b50 2023-11-25T04:08:59.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.929+0000 7f880a768640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88040cd3a0 con 0x7f880406bc50 2023-11-25T04:08:59.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.929+0000 7f8803fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88040b6b50 0x7f88040cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.930+0000 7f8803fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f88040b6b50 0x7f88040cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35212/0 (socket says 172.21.15.2:35212) 2023-11-25T04:08:59.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.930+0000 7f8803fff640 1 -- 172.21.15.2:0/644119072 learned_addr learned my addr 172.21.15.2:0/644119072 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:59.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.930+0000 7f8808d05640 1 --2- 172.21.15.2:0/644119072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 0x7f880406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.930+0000 7f8803fff640 1 -- 172.21.15.2:0/644119072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 msgr2=0x7f880406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:59.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.930+0000 7f8803fff640 1 --2- 172.21.15.2:0/644119072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 0x7f880406c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.930+0000 7f8803fff640 1 -- 172.21.15.2:0/644119072 >> v1:172.21.15.66:6789/0 conn(0x7f8804099970 legacy=0x7f8804099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:08:59.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.930+0000 7f8803fff640 1 -- 172.21.15.2:0/644119072 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88040b37c0 con 0x7f88040b6b50 2023-11-25T04:08:59.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.930+0000 7f8808d05640 1 --2- 172.21.15.2:0/644119072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 0x7f880406c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:08:59.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f8803fff640 1 --2- 172.21.15.2:0/644119072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 0x7f88040cfd40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009870 tx=0x7f87f402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cadfc1b524e581d server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:59.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f8802ffd640 1 -- 172.21.15.2:0/644119072 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f402f840 con 0x7f88040b6b50 2023-11-25T04:08:59.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f8802ffd640 1 -- 172.21.15.2:0/644119072 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f402f9a0 con 0x7f88040b6b50 2023-11-25T04:08:59.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f8802ffd640 1 -- 172.21.15.2:0/644119072 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f402fd30 con 0x7f88040b6b50 2023-11-25T04:08:59.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f880a768640 1 -- 172.21.15.2:0/644119072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 msgr2=0x7f88040cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f880a768640 1 --2- 172.21.15.2:0/644119072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 0x7f88040cfd40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f87f4009870 tx=0x7f87f402ba20 comp rx=0 tx=0).stop 2023-11-25T04:08:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f880a768640 1 -- 172.21.15.2:0/644119072 shutdown_connections 2023-11-25T04:08:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f880a768640 1 --2- 172.21.15.2:0/644119072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 0x7f880406c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f880a768640 1 --2- 172.21.15.2:0/644119072 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 0x7f88040cfd40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f880a768640 1 -- 172.21.15.2:0/644119072 >> 172.21.15.2:0/644119072 conn(0x7f88040b2a70 msgr2=0x7f88040b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:08:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f880a768640 1 -- 172.21.15.2:0/644119072 shutdown_connections 2023-11-25T04:08:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.931+0000 7f880a768640 1 -- 172.21.15.2:0/644119072 wait complete. 2023-11-25T04:08:59.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.933+0000 7f880a768640 1 Processor -- start 2023-11-25T04:08:59.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.933+0000 7f880a768640 1 -- start start 2023-11-25T04:08:59.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.933+0000 7f880a768640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 0x7f88040caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.933+0000 7f880a768640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8804099970 0x7f88040c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f880a768640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 0x7f880415c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f880a768640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88040c8f50 con 0x7f88040b6b50 2023-11-25T04:08:59.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f880a768640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880415c970 con 0x7f8804099970 2023-11-25T04:08:59.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f880a768640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88041f3120 con 0x7f880406bc50 2023-11-25T04:08:59.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8808d05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 0x7f880415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8808d05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 0x7f880415c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35222/0 (socket says 172.21.15.2:35222) 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8808d05640 1 -- 172.21.15.2:0/2903508060 learned_addr learned my addr 172.21.15.2:0/2903508060 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8803fff640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 0x7f88040caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f88037fe640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8804099970 0x7f88040c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8808d05640 1 -- 172.21.15.2:0/2903508060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 msgr2=0x7f88040caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8808d05640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 0x7f88040caba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8808d05640 1 -- 172.21.15.2:0/2903508060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8804099970 msgr2=0x7f88040c8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8808d05640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8804099970 0x7f88040c8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8808d05640 1 -- 172.21.15.2:0/2903508060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40094d0 con 0x7f88040b6b50 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8808d05640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 0x7f880415c430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00cef0 tx=0x7f87fc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8800ff9640 1 -- 172.21.15.2:0/2903508060 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00d840 con 0x7f88040b6b50 2023-11-25T04:08:59.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8800ff9640 1 -- 172.21.15.2:0/2903508060 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87fc00d9c0 con 0x7f88040b6b50 2023-11-25T04:08:59.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f8800ff9640 1 -- 172.21.15.2:0/2903508060 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87fc00dd70 con 0x7f88040b6b50 2023-11-25T04:08:59.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.934+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88040c9160 con 0x7f88040b6b50 2023-11-25T04:08:59.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.935+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88040c9720 con 0x7f88040b6b50 2023-11-25T04:08:59.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.935+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88041f3340 con 0x7f88040b6b50 2023-11-25T04:08:59.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.936+0000 7f8800ff9640 1 -- 172.21.15.2:0/2903508060 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87fc01e3b0 con 0x7f88040b6b50 2023-11-25T04:08:59.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.936+0000 7f8800ff9640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f87f006ae40 0x7f87f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:08:59.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.936+0000 7f8800ff9640 1 -- 172.21.15.2:0/2903508060 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87fc08a0a0 con 0x7f88040b6b50 2023-11-25T04:08:59.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.936+0000 7f8803fff640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f87f006ae40 0x7f87f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:08:59.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.937+0000 7f8803fff640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f87f006ae40 0x7f87f006d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f87f4036000 tx=0x7f87f4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:08:59.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:08:59.940+0000 7f8800ff9640 1 -- 172.21.15.2:0/2903508060 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88041f3340 con 0x7f88040b6b50 2023-11-25T04:09:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.118+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f88041f3340 con 0x7f88040b6b50 2023-11-25T04:09:00.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.118+0000 7f8800ff9640 1 -- 172.21.15.2:0/2903508060 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88041f3340 con 0x7f88040b6b50 2023-11-25T04:09:00.119 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f87f006ae40 msgr2=0x7f87f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f87f006ae40 0x7f87f006d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f87f4036000 tx=0x7f87f4008030 comp rx=0 tx=0).stop 2023-11-25T04:09:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 msgr2=0x7f880415c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 0x7f880415c430 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00cef0 tx=0x7f87fc00a710 comp rx=0 tx=0).stop 2023-11-25T04:09:00.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 shutdown_connections 2023-11-25T04:09:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88040b6b50 0x7f880415c430 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f87f006ae40 0x7f87f006d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8804099970 0x7f88040c8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 --2- 172.21.15.2:0/2903508060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f880406bc50 0x7f88040caba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 >> 172.21.15.2:0/2903508060 conn(0x7f88040b2a70 msgr2=0x7f880406cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 shutdown_connections 2023-11-25T04:09:00.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.120+0000 7f880a768640 1 -- 172.21.15.2:0/2903508060 wait complete. 2023-11-25T04:09:00.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:00.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.241+0000 7fdbf0cb4640 1 Processor -- start 2023-11-25T04:09:00.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.241+0000 7fdbf0cb4640 1 -- start start 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.242+0000 7fdbf0cb4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbec160b70 0x7fdbec0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.242+0000 7fdbf0cb4640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbec0ce360 con 0x7fdbec0cef00 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.242+0000 7fdbf0cb4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbec0b2f20 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.242+0000 7fdbf0cb4640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbec0cdd50 con 0x7fdbec160b70 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.242+0000 7fdbea59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fdbec160b70 0x7fdbec0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.242+0000 7fdbead9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fdbec0cef00 0x7fdbec161230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50594/0 (socket says 172.21.15.2:50594) 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.242+0000 7fdbead9d640 1 -- 172.21.15.2:0/522044618 learned_addr learned my addr 172.21.15.2:0/522044618 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.243+0000 7fdbea59c640 1 -- 172.21.15.2:0/522044618 >> v1:172.21.15.66:6789/0 conn(0x7fdbec0b2aa0 legacy=0x7fdbec0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.243+0000 7fdbea59c640 1 -- 172.21.15.2:0/522044618 >> v1:172.21.15.2:6789/0 conn(0x7fdbec0cef00 legacy=0x7fdbec161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.243+0000 7fdbea59c640 1 -- 172.21.15.2:0/522044618 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec0d1c70 con 0x7fdbec160b70 2023-11-25T04:09:00.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.243+0000 7fdbe9d9b640 1 -- 172.21.15.2:0/522044618 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3091921216 0 0) 0x7fdbec0ce360 con 0x7fdbec0cef00 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.243+0000 7fdbea59c640 1 --2- 172.21.15.2:0/522044618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec160b70 0x7fdbec0d1570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0097a0 tx=0x7fdbdc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beda38ab5616f508 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbe9d9b640 1 -- 172.21.15.2:0/522044618 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc030610 con 0x7fdbec160b70 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbe9d9b640 1 -- 172.21.15.2:0/522044618 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc030770 con 0x7fdbec160b70 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbe9d9b640 1 -- 172.21.15.2:0/522044618 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc030b00 con 0x7fdbec160b70 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/522044618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec160b70 msgr2=0x7fdbec0d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbf0cb4640 1 --2- 172.21.15.2:0/522044618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec160b70 0x7fdbec0d1570 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc0097a0 tx=0x7fdbdc02b960 comp rx=0 tx=0).stop 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/522044618 shutdown_connections 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbf0cb4640 1 --2- 172.21.15.2:0/522044618 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec160b70 0x7fdbec0d1570 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/522044618 >> 172.21.15.2:0/522044618 conn(0x7fdbec09c470 msgr2=0x7fdbec0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/522044618 shutdown_connections 2023-11-25T04:09:00.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.244+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/522044618 wait complete. 2023-11-25T04:09:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.246+0000 7fdbf0cb4640 1 Processor -- start 2023-11-25T04:09:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.246+0000 7fdbf0cb4640 1 -- start start 2023-11-25T04:09:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.246+0000 7fdbf0cb4640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0b2aa0 0x7fdbec155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.246+0000 7fdbf0cb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbec0cef00 0x7fdbec159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.246+0000 7fdbf0cb4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbec160b70 0x7fdbec0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.246+0000 7fdbf0cb4640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec1564b0 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.246+0000 7fdbf0cb4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0cbb40 con 0x7fdbec0cef00 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.246+0000 7fdbf0cb4640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec0cbe20 con 0x7fdbec160b70 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.246+0000 7fdbea59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0b2aa0 0x7fdbec155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbea59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0b2aa0 0x7fdbec155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35234/0 (socket says 172.21.15.2:35234) 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbea59c640 1 -- 172.21.15.2:0/2637152497 learned_addr learned my addr 172.21.15.2:0/2637152497 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbead9d640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbec160b70 0x7fdbec0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbe1d9b640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbec0cef00 0x7fdbec159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbea59c640 1 -- 172.21.15.2:0/2637152497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbec160b70 msgr2=0x7fdbec0ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbea59c640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbec160b70 0x7fdbec0ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbea59c640 1 -- 172.21.15.2:0/2637152497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbec0cef00 msgr2=0x7fdbec159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbea59c640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbec0cef00 0x7fdbec159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbea59c640 1 -- 172.21.15.2:0/2637152497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc009400 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.247+0000 7fdbea59c640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0b2aa0 0x7fdbec155f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc000c00 tx=0x7fdbdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:00.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.249+0000 7fdbe37fe640 1 -- 172.21.15.2:0/2637152497 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc039c90 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.249+0000 7fdbe37fe640 1 -- 172.21.15.2:0/2637152497 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc03f040 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.249+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec0cc100 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.249+0000 7fdbe37fe640 1 -- 172.21.15.2:0/2637152497 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc004030 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.249+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec0cc6c0 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.250+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec0a1150 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.251+0000 7fdbe37fe640 1 -- 172.21.15.2:0/2637152497 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdbdc004190 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.251+0000 7fdbe37fe640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fdbcc06ae40 0x7fdbcc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.251+0000 7fdbe37fe640 1 -- 172.21.15.2:0/2637152497 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbdc0ab570 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.251+0000 7fdbe1d9b640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fdbcc06ae40 0x7fdbcc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.252+0000 7fdbe1d9b640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fdbcc06ae40 0x7fdbcc06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0b0b30 tx=0x7fdbd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:00.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.257+0000 7fdbe37fe640 1 -- 172.21.15.2:0/2637152497 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdbdc076760 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.432+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdbec0b22d0 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.433+0000 7fdbe37fe640 1 -- 172.21.15.2:0/2637152497 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdbdc079d80 con 0x7fdbec0b2aa0 2023-11-25T04:09:00.434 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fdbcc06ae40 msgr2=0x7fdbcc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fdbcc06ae40 0x7fdbcc06d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0b0b30 tx=0x7fdbd4009040 comp rx=0 tx=0).stop 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0b2aa0 msgr2=0x7fdbec155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0b2aa0 0x7fdbec155f70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc000c00 tx=0x7fdbdc0046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 shutdown_connections 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbec160b70 0x7fdbec0ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fdbcc06ae40 0x7fdbcc06d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbec0cef00 0x7fdbec159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 --2- 172.21.15.2:0/2637152497 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fdbec0b2aa0 0x7fdbec155f70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 >> 172.21.15.2:0/2637152497 conn(0x7fdbec09c470 msgr2=0x7fdbec06c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:00.436 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 shutdown_connections 2023-11-25T04:09:00.437 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.435+0000 7fdbf0cb4640 1 -- 172.21.15.2:0/2637152497 wait complete. 2023-11-25T04:09:00.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.552+0000 7fd18ca15640 1 Processor -- start 2023-11-25T04:09:00.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.552+0000 7fd18ca15640 1 -- start start 2023-11-25T04:09:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd18ca15640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd188160ab0 0x7fd1880afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd18ca15640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1880cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd18ca15640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1880cdd30 con 0x7fd1880d0030 2023-11-25T04:09:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd18ca15640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1880ce2d0 con 0x7fd188160ab0 2023-11-25T04:09:00.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd18ca15640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880d0a90 con 0x7fd1880b2450 2023-11-25T04:09:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd185d9b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1880cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd18659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd188160ab0 0x7fd1880afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd185d9b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1880cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:51296/0 (socket says 172.21.15.2:51296) 2023-11-25T04:09:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd186d9d640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd1880d0030 0x7fd1880d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:55338/0 (socket says 172.21.15.2:55338) 2023-11-25T04:09:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd18659c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd188160ab0 0x7fd1880afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:60472/0 (socket says 172.21.15.2:60472) 2023-11-25T04:09:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.553+0000 7fd185d9b640 1 -- 172.21.15.2:0/4168601284 learned_addr learned my addr 172.21.15.2:0/4168601284 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:00.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.554+0000 7fd18659c640 1 -- 172.21.15.2:0/4168601284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 msgr2=0x7fd1880cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.554+0000 7fd18659c640 1 --2- 172.21.15.2:0/4168601284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1880cfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.554+0000 7fd18659c640 1 -- 172.21.15.2:0/4168601284 >> v1:172.21.15.66:6789/0 conn(0x7fd1880d0030 legacy=0x7fd1880d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.554+0000 7fd18659c640 1 -- 172.21.15.2:0/4168601284 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1880b02f0 con 0x7fd188160ab0 2023-11-25T04:09:00.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.554+0000 7fd185d9b640 1 --2- 172.21.15.2:0/4168601284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1880cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:09:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18659c640 1 --2- 172.21.15.2:0/4168601284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd188160ab0 0x7fd1880afdb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1800097a0 tx=0x7fd18002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a69264bf0ff594e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18559a640 1 -- 172.21.15.2:0/4168601284 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18002e070 con 0x7fd188160ab0 2023-11-25T04:09:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18559a640 1 -- 172.21.15.2:0/4168601284 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1800315a0 con 0x7fd188160ab0 2023-11-25T04:09:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18559a640 1 -- 172.21.15.2:0/4168601284 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180031930 con 0x7fd188160ab0 2023-11-25T04:09:00.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18ca15640 1 -- 172.21.15.2:0/4168601284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd188160ab0 msgr2=0x7fd1880afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18ca15640 1 --2- 172.21.15.2:0/4168601284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd188160ab0 0x7fd1880afdb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd1800097a0 tx=0x7fd18002b840 comp rx=0 tx=0).stop 2023-11-25T04:09:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18ca15640 1 -- 172.21.15.2:0/4168601284 shutdown_connections 2023-11-25T04:09:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18ca15640 1 --2- 172.21.15.2:0/4168601284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1880cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18ca15640 1 --2- 172.21.15.2:0/4168601284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd188160ab0 0x7fd1880afdb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18ca15640 1 -- 172.21.15.2:0/4168601284 >> 172.21.15.2:0/4168601284 conn(0x7fd18809c450 msgr2=0x7fd1880d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18ca15640 1 -- 172.21.15.2:0/4168601284 shutdown_connections 2023-11-25T04:09:00.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.555+0000 7fd18ca15640 1 -- 172.21.15.2:0/4168601284 wait complete. 2023-11-25T04:09:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.557+0000 7fd18ca15640 1 Processor -- start 2023-11-25T04:09:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.557+0000 7fd18ca15640 1 -- start start 2023-11-25T04:09:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.557+0000 7fd18ca15640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1881f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.557+0000 7fd18ca15640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1880d0030 0x7fd18815f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.557+0000 7fd18ca15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd188160ab0 0x7fd18815d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.557+0000 7fd18ca15640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880b8c40 con 0x7fd188160ab0 2023-11-25T04:09:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.557+0000 7fd18ca15640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18815e520 con 0x7fd1880d0030 2023-11-25T04:09:00.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.557+0000 7fd18ca15640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1880b5e00 con 0x7fd1880b2450 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd188160ab0 0x7fd18815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd186d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd188160ab0 0x7fd18815d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35240/0 (socket says 172.21.15.2:35240) 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd186d9d640 1 -- 172.21.15.2:0/913165143 learned_addr learned my addr 172.21.15.2:0/913165143 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd185d9b640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1880d0030 0x7fd18815f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd18659c640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1881f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd186d9d640 1 -- 172.21.15.2:0/913165143 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 msgr2=0x7fd1881f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd186d9d640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1881f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd186d9d640 1 -- 172.21.15.2:0/913165143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1880d0030 msgr2=0x7fd18815f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd186d9d640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1880d0030 0x7fd18815f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd186d9d640 1 -- 172.21.15.2:0/913165143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1700094d0 con 0x7fd188160ab0 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd186d9d640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd188160ab0 0x7fd18815d910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd17800c7a0 tx=0x7fd17800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd17effd640 1 -- 172.21.15.2:0/913165143 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17800a640 con 0x7fd188160ab0 2023-11-25T04:09:00.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd17effd640 1 -- 172.21.15.2:0/913165143 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17800a7a0 con 0x7fd188160ab0 2023-11-25T04:09:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd180009400 con 0x7fd188160ab0 2023-11-25T04:09:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd17effd640 1 -- 172.21.15.2:0/913165143 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17800ab10 con 0x7fd188160ab0 2023-11-25T04:09:00.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.558+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1880b63c0 con 0x7fd188160ab0 2023-11-25T04:09:00.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.559+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd188067420 con 0x7fd188160ab0 2023-11-25T04:09:00.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.560+0000 7fd17effd640 1 -- 172.21.15.2:0/913165143 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd17800ac70 con 0x7fd188160ab0 2023-11-25T04:09:00.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.560+0000 7fd17effd640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd16806ae40 0x7fd16806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.560+0000 7fd17effd640 1 -- 172.21.15.2:0/913165143 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd178088d70 con 0x7fd188160ab0 2023-11-25T04:09:00.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.560+0000 7fd18659c640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd16806ae40 0x7fd16806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.561+0000 7fd18659c640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd16806ae40 0x7fd16806d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd180036000 tx=0x7fd18003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:00.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.565+0000 7fd17effd640 1 -- 172.21.15.2:0/913165143 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd178053ed0 con 0x7fd188160ab0 2023-11-25T04:09:00.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.742+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd18815cce0 con 0x7fd188160ab0 2023-11-25T04:09:00.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.743+0000 7fd17effd640 1 -- 172.21.15.2:0/913165143 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fd178017020 con 0x7fd188160ab0 2023-11-25T04:09:00.745 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:00.745 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd16806ae40 msgr2=0x7fd16806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd16806ae40 0x7fd16806d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd180036000 tx=0x7fd18003d040 comp rx=0 tx=0).stop 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd188160ab0 msgr2=0x7fd18815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd188160ab0 0x7fd18815d910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd17800c7a0 tx=0x7fd17800cc60 comp rx=0 tx=0).stop 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 shutdown_connections 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd188160ab0 0x7fd18815d910 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd16806ae40 0x7fd16806d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1880d0030 0x7fd18815f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 --2- 172.21.15.2:0/913165143 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1880b2450 0x7fd1881f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 >> 172.21.15.2:0/913165143 conn(0x7fd18809c450 msgr2=0x7fd18806bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 shutdown_connections 2023-11-25T04:09:00.747 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.745+0000 7fd18ca15640 1 -- 172.21.15.2:0/913165143 wait complete. 2023-11-25T04:09:00.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:00.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.866+0000 7f302abdc640 1 Processor -- start 2023-11-25T04:09:00.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.866+0000 7f302abdc640 1 -- start start 2023-11-25T04:09:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.866+0000 7f302abdc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f302413f750 0x7f302415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.866+0000 7f302abdc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f302413fb30 0x7f30240cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f302abdc640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30240ce060 con 0x7f302415db40 2023-11-25T04:09:00.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f302abdc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30240cec70 con 0x7f302413fb30 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f302abdc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30240ce340 con 0x7f302413f750 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3023fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f302413fb30 0x7f30240cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3029179640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f302415db40 0x7f302415dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50610/0 (socket says 172.21.15.2:50610) 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3023fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f302413fb30 0x7f30240cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35244/0 (socket says 172.21.15.2:35244) 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3029179640 1 -- 172.21.15.2:0/3788932694 learned_addr learned my addr 172.21.15.2:0/3788932694 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3028978640 1 --2- 172.21.15.2:0/3788932694 >> v2:172.21.15.66:3300/0 conn(0x7f302413f750 0x7f302415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3023fff640 1 -- 172.21.15.2:0/3788932694 >> v2:172.21.15.66:3300/0 conn(0x7f302413f750 msgr2=0x7f302415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3023fff640 1 --2- 172.21.15.2:0/3788932694 >> v2:172.21.15.66:3300/0 conn(0x7f302413f750 0x7f302415b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3023fff640 1 -- 172.21.15.2:0/3788932694 >> v1:172.21.15.2:6789/0 conn(0x7f302415db40 legacy=0x7f302415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f30237fe640 1 -- 172.21.15.2:0/3788932694 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103605917 0 0) 0x7f30240ce060 con 0x7f302415db40 2023-11-25T04:09:00.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3023fff640 1 -- 172.21.15.2:0/3788932694 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240ce620 con 0x7f302413fb30 2023-11-25T04:09:00.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.867+0000 7f3028978640 1 --2- 172.21.15.2:0/3788932694 >> v2:172.21.15.66:3300/0 conn(0x7f302413f750 0x7f302415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.868+0000 7f3023fff640 1 --2- 172.21.15.2:0/3788932694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302413fb30 0x7f30240cd7c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3024071f40 tx=0x7f301002e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376f34626df44822 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.868+0000 7f30237fe640 1 -- 172.21.15.2:0/3788932694 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301002ee50 con 0x7f302413fb30 2023-11-25T04:09:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.868+0000 7f30237fe640 1 -- 172.21.15.2:0/3788932694 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3010036440 con 0x7f302413fb30 2023-11-25T04:09:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.868+0000 7f30237fe640 1 -- 172.21.15.2:0/3788932694 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100367d0 con 0x7f302413fb30 2023-11-25T04:09:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.868+0000 7f302abdc640 1 -- 172.21.15.2:0/3788932694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302413fb30 msgr2=0x7f30240cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.868+0000 7f302abdc640 1 --2- 172.21.15.2:0/3788932694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302413fb30 0x7f30240cd7c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3024071f40 tx=0x7f301002e0a0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.869+0000 7f302abdc640 1 -- 172.21.15.2:0/3788932694 shutdown_connections 2023-11-25T04:09:00.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.869+0000 7f302abdc640 1 --2- 172.21.15.2:0/3788932694 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302413fb30 0x7f30240cd7c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.869+0000 7f302abdc640 1 --2- 172.21.15.2:0/3788932694 >> v2:172.21.15.66:3300/0 conn(0x7f302413f750 0x7f302415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.869+0000 7f302abdc640 1 -- 172.21.15.2:0/3788932694 >> 172.21.15.2:0/3788932694 conn(0x7f302406a8f0 msgr2=0x7f302406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.869+0000 7f302abdc640 1 -- 172.21.15.2:0/3788932694 shutdown_connections 2023-11-25T04:09:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.869+0000 7f302abdc640 1 -- 172.21.15.2:0/3788932694 wait complete. 2023-11-25T04:09:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.870+0000 7f302abdc640 1 Processor -- start 2023-11-25T04:09:00.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.870+0000 7f302abdc640 1 -- start start 2023-11-25T04:09:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f302abdc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f302413f750 0x7f302415d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f302abdc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f302413fb30 0x7f302412edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f302abdc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302415db40 0x7f3024155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f302abdc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302415b120 con 0x7f302415db40 2023-11-25T04:09:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f302abdc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3024155e70 con 0x7f302413fb30 2023-11-25T04:09:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f302abdc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302415a7f0 con 0x7f302413f750 2023-11-25T04:09:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3029179640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302415db40 0x7f3024155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3029179640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302415db40 0x7f3024155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35258/0 (socket says 172.21.15.2:35258) 2023-11-25T04:09:00.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3029179640 1 -- 172.21.15.2:0/4252710534 learned_addr learned my addr 172.21.15.2:0/4252710534 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3028978640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f302413f750 0x7f302415d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3023fff640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f302413fb30 0x7f302412edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3029179640 1 -- 172.21.15.2:0/4252710534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f302413f750 msgr2=0x7f302415d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3029179640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f302413f750 0x7f302415d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3029179640 1 -- 172.21.15.2:0/4252710534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f302413fb30 msgr2=0x7f302412edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3029179640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f302413fb30 0x7f302412edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3029179640 1 -- 172.21.15.2:0/4252710534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301000b6a0 con 0x7f302415db40 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3028978640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f302413f750 0x7f302415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f3029179640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302415db40 0x7f3024155620 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c7a0 tx=0x7f301c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.871+0000 7f30217fa640 1 -- 172.21.15.2:0/4252710534 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00a640 con 0x7f302415db40 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.872+0000 7f30217fa640 1 -- 172.21.15.2:0/4252710534 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00a7a0 con 0x7f302415db40 2023-11-25T04:09:00.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.872+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302415aad0 con 0x7f302415db40 2023-11-25T04:09:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.872+0000 7f30217fa640 1 -- 172.21.15.2:0/4252710534 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00abd0 con 0x7f302415db40 2023-11-25T04:09:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.872+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3024155b60 con 0x7f302415db40 2023-11-25T04:09:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.873+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302415b290 con 0x7f302415db40 2023-11-25T04:09:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.873+0000 7f30217fa640 1 -- 172.21.15.2:0/4252710534 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f301c00ad30 con 0x7f302415db40 2023-11-25T04:09:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.873+0000 7f30217fa640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f300806ae40 0x7f300806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:00.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.874+0000 7f30217fa640 1 -- 172.21.15.2:0/4252710534 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f301c088ce0 con 0x7f302415db40 2023-11-25T04:09:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.874+0000 7f3028978640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f300806ae40 0x7f300806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:00.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.874+0000 7f3028978640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f300806ae40 0x7f300806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3018006fd0 tx=0x7f3018008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:00.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:00.878+0000 7f30217fa640 1 -- 172.21.15.2:0/4252710534 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f301c053ed0 con 0x7f302415db40 2023-11-25T04:09:01.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.052+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3024072ae0 con 0x7f302415db40 2023-11-25T04:09:01.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.053+0000 7f30217fa640 1 -- 172.21.15.2:0/4252710534 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f301c018020 con 0x7f302415db40 2023-11-25T04:09:01.054 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:01.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f300806ae40 msgr2=0x7f300806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f300806ae40 0x7f300806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3018006fd0 tx=0x7f3018008040 comp rx=0 tx=0).stop 2023-11-25T04:09:01.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302415db40 msgr2=0x7f3024155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302415db40 0x7f3024155620 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c7a0 tx=0x7f301c00cc60 comp rx=0 tx=0).stop 2023-11-25T04:09:01.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 shutdown_connections 2023-11-25T04:09:01.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f302415db40 0x7f3024155620 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f300806ae40 0x7f300806d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f302413fb30 0x7f302412edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 --2- 172.21.15.2:0/4252710534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f302413f750 0x7f302415d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 >> 172.21.15.2:0/4252710534 conn(0x7f302406a8f0 msgr2=0x7f302413ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:01.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 shutdown_connections 2023-11-25T04:09:01.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.055+0000 7f302abdc640 1 -- 172.21.15.2:0/4252710534 wait complete. 2023-11-25T04:09:01.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:01.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.175+0000 7f19357b0640 1 Processor -- start 2023-11-25T04:09:01.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.176+0000 7f19357b0640 1 -- start start 2023-11-25T04:09:01.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.176+0000 7f19357b0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f19300b2110 0x7f19300cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.176+0000 7f19357b0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19300d0070 0x7f19300ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.176+0000 7f19357b0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19300b4b30 con 0x7f1930160ad0 2023-11-25T04:09:01.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.176+0000 7f19357b0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19300d0520 con 0x7f19300d0070 2023-11-25T04:09:01.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.176+0000 7f19357b0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19300d16a0 con 0x7f19300b2110 2023-11-25T04:09:01.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.176+0000 7f192f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19300d0070 0x7f19300ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.176+0000 7f192f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f19300d0070 0x7f19300ce230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35260/0 (socket says 172.21.15.2:35260) 2023-11-25T04:09:01.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.176+0000 7f192f7fe640 1 -- 172.21.15.2:0/2785750410 learned_addr learned my addr 172.21.15.2:0/2785750410 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:01.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.177+0000 7f192e7fc640 1 --2- 172.21.15.2:0/2785750410 >> v2:172.21.15.66:3300/0 conn(0x7f19300b2110 0x7f19300cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.177+0000 7f192f7fe640 1 -- 172.21.15.2:0/2785750410 >> v2:172.21.15.66:3300/0 conn(0x7f19300b2110 msgr2=0x7f19300cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:01.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.177+0000 7f192f7fe640 1 --2- 172.21.15.2:0/2785750410 >> v2:172.21.15.66:3300/0 conn(0x7f19300b2110 0x7f19300cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.177+0000 7f192f7fe640 1 -- 172.21.15.2:0/2785750410 >> v1:172.21.15.66:6789/0 conn(0x7f1930160ad0 legacy=0x7f19300b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:01.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.177+0000 7f192f7fe640 1 -- 172.21.15.2:0/2785750410 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19300d1980 con 0x7f19300d0070 2023-11-25T04:09:01.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f192f7fe640 1 --2- 172.21.15.2:0/2785750410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19300d0070 0x7f19300ce230 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f193008b7c0 tx=0x7f192002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac386f3c293e9930 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:01.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f192dffb640 1 -- 172.21.15.2:0/2785750410 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192002c9f0 con 0x7f19300d0070 2023-11-25T04:09:01.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f192dffb640 1 -- 172.21.15.2:0/2785750410 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192002cb50 con 0x7f19300d0070 2023-11-25T04:09:01.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f192dffb640 1 -- 172.21.15.2:0/2785750410 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19200343f0 con 0x7f19300d0070 2023-11-25T04:09:01.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f19357b0640 1 -- 172.21.15.2:0/2785750410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19300d0070 msgr2=0x7f19300ce230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f19357b0640 1 --2- 172.21.15.2:0/2785750410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19300d0070 0x7f19300ce230 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f193008b7c0 tx=0x7f192002be50 comp rx=0 tx=0).stop 2023-11-25T04:09:01.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f19357b0640 1 -- 172.21.15.2:0/2785750410 shutdown_connections 2023-11-25T04:09:01.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f19357b0640 1 --2- 172.21.15.2:0/2785750410 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f19300d0070 0x7f19300ce230 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f19357b0640 1 --2- 172.21.15.2:0/2785750410 >> v2:172.21.15.66:3300/0 conn(0x7f19300b2110 0x7f19300cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f19357b0640 1 -- 172.21.15.2:0/2785750410 >> 172.21.15.2:0/2785750410 conn(0x7f193009c500 msgr2=0x7f19300d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f19357b0640 1 -- 172.21.15.2:0/2785750410 shutdown_connections 2023-11-25T04:09:01.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.178+0000 7f19357b0640 1 -- 172.21.15.2:0/2785750410 wait complete. 2023-11-25T04:09:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f19357b0640 1 Processor -- start 2023-11-25T04:09:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f19357b0640 1 -- start start 2023-11-25T04:09:01.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f19357b0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19300b2110 0x7f193009f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f19357b0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19300d0070 0x7f19301f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f19357b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1930160ad0 0x7f193015c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f19357b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193009e000 con 0x7f1930160ad0 2023-11-25T04:09:01.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f19357b0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19300a0770 con 0x7f19300b2110 2023-11-25T04:09:01.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f19357b0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19301f40c0 con 0x7f19300d0070 2023-11-25T04:09:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f192f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1930160ad0 0x7f193015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f192f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1930160ad0 0x7f193015c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35276/0 (socket says 172.21.15.2:35276) 2023-11-25T04:09:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.180+0000 7f192f7fe640 1 -- 172.21.15.2:0/2847879177 learned_addr learned my addr 172.21.15.2:0/2847879177 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f192effd640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19300b2110 0x7f193009f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f192e7fc640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19300d0070 0x7f19301f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f192f7fe640 1 -- 172.21.15.2:0/2847879177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19300d0070 msgr2=0x7f19301f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f192f7fe640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19300d0070 0x7f19301f3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f192f7fe640 1 -- 172.21.15.2:0/2847879177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19300b2110 msgr2=0x7f193009f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f192f7fe640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19300b2110 0x7f193009f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f192f7fe640 1 -- 172.21.15.2:0/2847879177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1920009b30 con 0x7f1930160ad0 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f192effd640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19300b2110 0x7f193009f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f192f7fe640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1930160ad0 0x7f193015c080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1920036040 tx=0x7f1920004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f19177fe640 1 -- 172.21.15.2:0/2847879177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920009510 con 0x7f1930160ad0 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f19177fe640 1 -- 172.21.15.2:0/2847879177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192003e450 con 0x7f1930160ad0 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193009fb60 con 0x7f1930160ad0 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f19177fe640 1 -- 172.21.15.2:0/2847879177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192003e800 con 0x7f1930160ad0 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.181+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19300a0120 con 0x7f1930160ad0 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.182+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19300a11e0 con 0x7f1930160ad0 2023-11-25T04:09:01.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.182+0000 7f19177fe640 1 -- 172.21.15.2:0/2847879177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f192003e960 con 0x7f1930160ad0 2023-11-25T04:09:01.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.183+0000 7f19177fe640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f191c06ae40 0x7f191c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.183+0000 7f19177fe640 1 -- 172.21.15.2:0/2847879177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19200ac3f0 con 0x7f1930160ad0 2023-11-25T04:09:01.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.183+0000 7f192effd640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f191c06ae40 0x7f191c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.183+0000 7f192effd640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f191c06ae40 0x7f191c06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f192800a830 tx=0x7f1928008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:01.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.187+0000 7f19177fe640 1 -- 172.21.15.2:0/2847879177 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19200775e0 con 0x7f1930160ad0 2023-11-25T04:09:01.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.362+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f193004e920 con 0x7f1930160ad0 2023-11-25T04:09:01.438 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.363+0000 7f19177fe640 1 -- 172.21.15.2:0/2847879177 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f192007ac00 con 0x7f1930160ad0 2023-11-25T04:09:01.438 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f191c06ae40 msgr2=0x7f191c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f191c06ae40 0x7f191c06d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f192800a830 tx=0x7f1928008040 comp rx=0 tx=0).stop 2023-11-25T04:09:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1930160ad0 msgr2=0x7f193015c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1930160ad0 0x7f193015c080 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1920036040 tx=0x7f1920004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 shutdown_connections 2023-11-25T04:09:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1930160ad0 0x7f193015c080 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19300d0070 0x7f19301f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f191c06ae40 0x7f191c06d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 --2- 172.21.15.2:0/2847879177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19300b2110 0x7f193009f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 >> 172.21.15.2:0/2847879177 conn(0x7f193009c500 msgr2=0x7f19300ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:01.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 shutdown_connections 2023-11-25T04:09:01.441 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.365+0000 7f19357b0640 1 -- 172.21.15.2:0/2847879177 wait complete. 2023-11-25T04:09:01.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:01.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.549+0000 7f6afba31640 1 Processor -- start 2023-11-25T04:09:01.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.549+0000 7f6afba31640 1 -- start start 2023-11-25T04:09:01.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.550+0000 7f6afba31640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6af415ea80 0x7f6af40cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.550+0000 7f6afba31640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6af40afee0 0x7f6af40cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.550+0000 7f6afba31640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af415ee60 con 0x7f6af40cbbd0 2023-11-25T04:09:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.550+0000 7f6afba31640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af40cef60 con 0x7f6af415ea80 2023-11-25T04:09:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.550+0000 7f6afba31640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af4099a10 con 0x7f6af40afee0 2023-11-25T04:09:01.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.550+0000 7f6af97cd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6af415ea80 0x7f6af40cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.550+0000 7f6af97cd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6af415ea80 0x7f6af40cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35278/0 (socket says 172.21.15.2:35278) 2023-11-25T04:09:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.550+0000 7f6af97cd640 1 -- 172.21.15.2:0/443682363 learned_addr learned my addr 172.21.15.2:0/443682363 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.551+0000 7f6af8fcc640 1 --2- 172.21.15.2:0/443682363 >> v2:172.21.15.66:3300/0 conn(0x7f6af40afee0 0x7f6af40cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.551+0000 7f6af97cd640 1 -- 172.21.15.2:0/443682363 >> v2:172.21.15.66:3300/0 conn(0x7f6af40afee0 msgr2=0x7f6af40cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.551+0000 7f6af97cd640 1 --2- 172.21.15.2:0/443682363 >> v2:172.21.15.66:3300/0 conn(0x7f6af40afee0 0x7f6af40cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.551+0000 7f6af97cd640 1 -- 172.21.15.2:0/443682363 >> v1:172.21.15.66:6789/0 conn(0x7f6af40cbbd0 legacy=0x7f6af40cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.551+0000 7f6af97cd640 1 -- 172.21.15.2:0/443682363 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af4099cf0 con 0x7f6af415ea80 2023-11-25T04:09:01.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6af97cd640 1 --2- 172.21.15.2:0/443682363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af415ea80 0x7f6af40cf240 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6af40afe70 tx=0x7f6ae402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6d230f9a8128b7 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:01.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6af3fff640 1 -- 172.21.15.2:0/443682363 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae402cb20 con 0x7f6af415ea80 2023-11-25T04:09:01.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6af3fff640 1 -- 172.21.15.2:0/443682363 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae402cc80 con 0x7f6af415ea80 2023-11-25T04:09:01.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6af3fff640 1 -- 172.21.15.2:0/443682363 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae40343f0 con 0x7f6af415ea80 2023-11-25T04:09:01.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6afba31640 1 -- 172.21.15.2:0/443682363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af415ea80 msgr2=0x7f6af40cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6afba31640 1 --2- 172.21.15.2:0/443682363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af415ea80 0x7f6af40cf240 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6af40afe70 tx=0x7f6ae402bf80 comp rx=0 tx=0).stop 2023-11-25T04:09:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6afba31640 1 -- 172.21.15.2:0/443682363 shutdown_connections 2023-11-25T04:09:01.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6afba31640 1 --2- 172.21.15.2:0/443682363 >> v2:172.21.15.66:3300/0 conn(0x7f6af40afee0 0x7f6af40cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6afba31640 1 --2- 172.21.15.2:0/443682363 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af415ea80 0x7f6af40cf240 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6afba31640 1 -- 172.21.15.2:0/443682363 >> 172.21.15.2:0/443682363 conn(0x7f6af40b2ab0 msgr2=0x7f6af40b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:01.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6afba31640 1 -- 172.21.15.2:0/443682363 shutdown_connections 2023-11-25T04:09:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.552+0000 7f6afba31640 1 -- 172.21.15.2:0/443682363 wait complete. 2023-11-25T04:09:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6afba31640 1 Processor -- start 2023-11-25T04:09:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6afba31640 1 -- start start 2023-11-25T04:09:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6afba31640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40afee0 0x7f6af41f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6afba31640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6af40cbbd0 0x7f6af40b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6afba31640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6af415ea80 0x7f6af40b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6afba31640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c89c0 con 0x7f6af40afee0 2023-11-25T04:09:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6afba31640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c8ca0 con 0x7f6af415ea80 2023-11-25T04:09:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6afba31640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c8f80 con 0x7f6af40cbbd0 2023-11-25T04:09:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6af97cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40afee0 0x7f6af41f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6af97cd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40afee0 0x7f6af41f3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35284/0 (socket says 172.21.15.2:35284) 2023-11-25T04:09:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.554+0000 7f6af97cd640 1 -- 172.21.15.2:0/576372122 learned_addr learned my addr 172.21.15.2:0/576372122 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:01.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af9fce640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6af415ea80 0x7f6af40b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af97cd640 1 -- 172.21.15.2:0/576372122 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6af40cbbd0 msgr2=0x7f6af40b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af97cd640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6af40cbbd0 0x7f6af40b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af97cd640 1 -- 172.21.15.2:0/576372122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6af415ea80 msgr2=0x7f6af40b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af97cd640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6af415ea80 0x7f6af40b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af97cd640 1 -- 172.21.15.2:0/576372122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae4009b30 con 0x7f6af40afee0 2023-11-25T04:09:01.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af97cd640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40afee0 0x7f6af41f3e50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000f80 tx=0x7f6ae4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:01.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af1ffb640 1 -- 172.21.15.2:0/576372122 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae4009510 con 0x7f6af40afee0 2023-11-25T04:09:01.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af1ffb640 1 -- 172.21.15.2:0/576372122 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae4007e60 con 0x7f6af40afee0 2023-11-25T04:09:01.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6af1ffb640 1 -- 172.21.15.2:0/576372122 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae403e690 con 0x7f6af40afee0 2023-11-25T04:09:01.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af40c9260 con 0x7f6af40afee0 2023-11-25T04:09:01.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.555+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af41f4390 con 0x7f6af40afee0 2023-11-25T04:09:01.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.556+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af41f4520 con 0x7f6af40afee0 2023-11-25T04:09:01.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.557+0000 7f6af1ffb640 1 -- 172.21.15.2:0/576372122 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ae403e7f0 con 0x7f6af40afee0 2023-11-25T04:09:01.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.557+0000 7f6af1ffb640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6ae006ae40 0x7f6ae006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.557+0000 7f6af1ffb640 1 -- 172.21.15.2:0/576372122 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ae40ac170 con 0x7f6af40afee0 2023-11-25T04:09:01.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.557+0000 7f6af8fcc640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6ae006ae40 0x7f6ae006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.558+0000 7f6af8fcc640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6ae006ae40 0x7f6ae006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8006a90 tx=0x7f6ae8006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:01.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.561+0000 7f6af1ffb640 1 -- 172.21.15.2:0/576372122 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ae4077220 con 0x7f6af40afee0 2023-11-25T04:09:01.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.739+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6af40c9720 con 0x7f6af40afee0 2023-11-25T04:09:01.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.740+0000 7f6af1ffb640 1 -- 172.21.15.2:0/576372122 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ae407a840 con 0x7f6af40afee0 2023-11-25T04:09:01.741 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6ae006ae40 msgr2=0x7f6ae006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6ae006ae40 0x7f6ae006d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ae8006a90 tx=0x7f6ae8006a20 comp rx=0 tx=0).stop 2023-11-25T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40afee0 msgr2=0x7f6af41f3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40afee0 0x7f6af41f3e50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4000f80 tx=0x7f6ae4004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 shutdown_connections 2023-11-25T04:09:01.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6ae006ae40 0x7f6ae006d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6af415ea80 0x7f6af40b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6af40cbbd0 0x7f6af40b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 --2- 172.21.15.2:0/576372122 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6af40afee0 0x7f6af41f3e50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 >> 172.21.15.2:0/576372122 conn(0x7f6af40b2ab0 msgr2=0x7f6af406e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 shutdown_connections 2023-11-25T04:09:01.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.742+0000 7f6afba31640 1 -- 172.21.15.2:0/576372122 wait complete. 2023-11-25T04:09:01.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:01.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.860+0000 7f882c1c9640 1 Processor -- start 2023-11-25T04:09:01.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.860+0000 7f882c1c9640 1 -- start start 2023-11-25T04:09:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.861+0000 7f882c1c9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f882406dc30 0x7f8824071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.861+0000 7f882c1c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88240b1df0 0x7f88240cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.861+0000 7f882c1c9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88240b3130 con 0x7f8824142d20 2023-11-25T04:09:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.861+0000 7f882c1c9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88240b2280 con 0x7f882406dc30 2023-11-25T04:09:01.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.861+0000 7f882c1c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8824143100 con 0x7f88240b1df0 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f882a766640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88240b1df0 0x7f88240cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f8829764640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f882406dc30 0x7f8824071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f8829764640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f882406dc30 0x7f8824071f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:60560/0 (socket says 172.21.15.2:60560) 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f882a766640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88240b1df0 0x7f88240cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:51334/0 (socket says 172.21.15.2:51334) 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f8829764640 1 -- 172.21.15.2:0/583527333 learned_addr learned my addr 172.21.15.2:0/583527333 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f8829764640 1 -- 172.21.15.2:0/583527333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88240b1df0 msgr2=0x7f88240cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f8829764640 1 --2- 172.21.15.2:0/583527333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88240b1df0 0x7f88240cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f8829764640 1 -- 172.21.15.2:0/583527333 >> v1:172.21.15.66:6789/0 conn(0x7f8824142d20 legacy=0x7f882406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f8829764640 1 -- 172.21.15.2:0/583527333 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88240b2520 con 0x7f882406dc30 2023-11-25T04:09:01.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.862+0000 7f8828f63640 1 -- 172.21.15.2:0/583527333 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920295382 0 0) 0x7f88240b3130 con 0x7f8824142d20 2023-11-25T04:09:01.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.863+0000 7f8829764640 1 --2- 172.21.15.2:0/583527333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 0x7f8824071f00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8814009870 tx=0x7f881402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9270cf3d8eaac208 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:01.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.863+0000 7f8828f63640 1 -- 172.21.15.2:0/583527333 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814030840 con 0x7f882406dc30 2023-11-25T04:09:01.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.863+0000 7f8828f63640 1 -- 172.21.15.2:0/583527333 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88140309a0 con 0x7f882406dc30 2023-11-25T04:09:01.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.863+0000 7f8828f63640 1 -- 172.21.15.2:0/583527333 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814030d30 con 0x7f882406dc30 2023-11-25T04:09:01.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.863+0000 7f882c1c9640 1 -- 172.21.15.2:0/583527333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 msgr2=0x7f8824071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.863+0000 7f882c1c9640 1 --2- 172.21.15.2:0/583527333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 0x7f8824071f00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8814009870 tx=0x7f881402b980 comp rx=0 tx=0).stop 2023-11-25T04:09:01.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.864+0000 7f882c1c9640 1 -- 172.21.15.2:0/583527333 shutdown_connections 2023-11-25T04:09:01.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.864+0000 7f882c1c9640 1 --2- 172.21.15.2:0/583527333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88240b1df0 0x7f88240cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.864+0000 7f882c1c9640 1 --2- 172.21.15.2:0/583527333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 0x7f8824071f00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.864+0000 7f882c1c9640 1 -- 172.21.15.2:0/583527333 >> 172.21.15.2:0/583527333 conn(0x7f88240b0af0 msgr2=0x7f88240b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:01.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.864+0000 7f882c1c9640 1 -- 172.21.15.2:0/583527333 shutdown_connections 2023-11-25T04:09:01.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.864+0000 7f882c1c9640 1 -- 172.21.15.2:0/583527333 wait complete. 2023-11-25T04:09:01.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.865+0000 7f882c1c9640 1 Processor -- start 2023-11-25T04:09:01.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.865+0000 7f882c1c9640 1 -- start start 2023-11-25T04:09:01.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f882c1c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 0x7f882414d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f882c1c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88240b1df0 0x7f88240c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f882c1c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8824142d20 0x7f882414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f882c1c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882414de60 con 0x7f88240b1df0 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f882c1c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882414e140 con 0x7f882406dc30 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f882c1c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882414e420 con 0x7f8824142d20 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829764640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88240b1df0 0x7f88240c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829764640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88240b1df0 0x7f88240c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35294/0 (socket says 172.21.15.2:35294) 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829764640 1 -- 172.21.15.2:0/3614315568 learned_addr learned my addr 172.21.15.2:0/3614315568 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f882a766640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8824142d20 0x7f882414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829f65640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 0x7f882414d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829764640 1 -- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8824142d20 msgr2=0x7f882414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829764640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8824142d20 0x7f882414ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829764640 1 -- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 msgr2=0x7f882414d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:01.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829764640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 0x7f882414d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:01.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829764640 1 -- 172.21.15.2:0/3614315568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88140094d0 con 0x7f88240b1df0 2023-11-25T04:09:01.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829f65640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 0x7f882414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:01.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f882a766640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8824142d20 0x7f882414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:01.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f8829764640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88240b1df0 0x7f88240c3f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8814000c00 tx=0x7f8814004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:01.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f881a7fc640 1 -- 172.21.15.2:0/3614315568 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814039c90 con 0x7f88240b1df0 2023-11-25T04:09:01.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f881a7fc640 1 -- 172.21.15.2:0/3614315568 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8814039df0 con 0x7f88240b1df0 2023-11-25T04:09:01.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f881a7fc640 1 -- 172.21.15.2:0/3614315568 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8814043640 con 0x7f88240b1df0 2023-11-25T04:09:01.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.866+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f882414e700 con 0x7f88240b1df0 2023-11-25T04:09:01.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.867+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88240c4490 con 0x7f88240b1df0 2023-11-25T04:09:01.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.868+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f882414ec20 con 0x7f88240b1df0 2023-11-25T04:09:01.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.868+0000 7f881a7fc640 1 -- 172.21.15.2:0/3614315568 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88140437a0 con 0x7f88240b1df0 2023-11-25T04:09:01.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.868+0000 7f881a7fc640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f880806ae40 0x7f880806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:01.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.868+0000 7f881a7fc640 1 -- 172.21.15.2:0/3614315568 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f881403e070 con 0x7f88240b1df0 2023-11-25T04:09:01.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.868+0000 7f8829f65640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f880806ae40 0x7f880806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:01.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.869+0000 7f8829f65640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f880806ae40 0x7f880806d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f881c000f60 tx=0x7f881c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:01.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:01.873+0000 7f881a7fc640 1 -- 172.21.15.2:0/3614315568 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f882414ec20 con 0x7f88240b1df0 2023-11-25T04:09:02.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.048+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f882414ec20 con 0x7f88240b1df0 2023-11-25T04:09:02.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.049+0000 7f881a7fc640 1 -- 172.21.15.2:0/3614315568 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f882414ec20 con 0x7f88240b1df0 2023-11-25T04:09:02.051 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:02.051 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:02.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f880806ae40 msgr2=0x7f880806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f880806ae40 0x7f880806d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f881c000f60 tx=0x7f881c009040 comp rx=0 tx=0).stop 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88240b1df0 msgr2=0x7f88240c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88240b1df0 0x7f88240c3f50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8814000c00 tx=0x7f8814004730 comp rx=0 tx=0).stop 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 shutdown_connections 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8824142d20 0x7f882414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f88240b1df0 0x7f88240c3f50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f880806ae40 0x7f880806d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 --2- 172.21.15.2:0/3614315568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f882406dc30 0x7f882414d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 >> 172.21.15.2:0/3614315568 conn(0x7f88240b0af0 msgr2=0x7f882406c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 shutdown_connections 2023-11-25T04:09:02.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.051+0000 7f882c1c9640 1 -- 172.21.15.2:0/3614315568 wait complete. 2023-11-25T04:09:02.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:02.064 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:02.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.172+0000 7f99a0c09640 1 Processor -- start 2023-11-25T04:09:02.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.172+0000 7f99a0c09640 1 -- start start 2023-11-25T04:09:02.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f99a0c09640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f999c0b6b50 0x7f999c0cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f99a0c09640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f999c06bc50 0x7f999c06c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f99a0c09640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f999c0b3590 con 0x7f999c099970 2023-11-25T04:09:02.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f99a0c09640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c06b310 con 0x7f999c06bc50 2023-11-25T04:09:02.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f99a0c09640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f999c0cd3a0 con 0x7f999c0b6b50 2023-11-25T04:09:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f999ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f999c06bc50 0x7f999c06c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f999ad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f999c06bc50 0x7f999c06c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35310/0 (socket says 172.21.15.2:35310) 2023-11-25T04:09:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f999ad9d640 1 -- 172.21.15.2:0/2644337431 learned_addr learned my addr 172.21.15.2:0/2644337431 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f999a59c640 1 --2- 172.21.15.2:0/2644337431 >> v2:172.21.15.66:3300/0 conn(0x7f999c0b6b50 0x7f999c0cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f999ad9d640 1 -- 172.21.15.2:0/2644337431 >> v2:172.21.15.66:3300/0 conn(0x7f999c0b6b50 msgr2=0x7f999c0cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f999ad9d640 1 --2- 172.21.15.2:0/2644337431 >> v2:172.21.15.66:3300/0 conn(0x7f999c0b6b50 0x7f999c0cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f999ad9d640 1 -- 172.21.15.2:0/2644337431 >> v1:172.21.15.66:6789/0 conn(0x7f999c099970 legacy=0x7f999c099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.173+0000 7f999ad9d640 1 -- 172.21.15.2:0/2644337431 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0b37c0 con 0x7f999c06bc50 2023-11-25T04:09:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.174+0000 7f999ad9d640 1 --2- 172.21.15.2:0/2644337431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c06bc50 0x7f999c06c100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f999c071790 tx=0x7f999402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd04ba608eddcfb server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:02.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.174+0000 7f9999d9b640 1 -- 172.21.15.2:0/2644337431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999402cbb0 con 0x7f999c06bc50 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.174+0000 7f9999d9b640 1 -- 172.21.15.2:0/2644337431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999402cd10 con 0x7f999c06bc50 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.174+0000 7f9999d9b640 1 -- 172.21.15.2:0/2644337431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994034610 con 0x7f999c06bc50 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.175+0000 7f99a0c09640 1 -- 172.21.15.2:0/2644337431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c06bc50 msgr2=0x7f999c06c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.175+0000 7f99a0c09640 1 --2- 172.21.15.2:0/2644337431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c06bc50 0x7f999c06c100 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f999c071790 tx=0x7f999402c010 comp rx=0 tx=0).stop 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.175+0000 7f99a0c09640 1 -- 172.21.15.2:0/2644337431 shutdown_connections 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.175+0000 7f99a0c09640 1 --2- 172.21.15.2:0/2644337431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c06bc50 0x7f999c06c100 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.175+0000 7f99a0c09640 1 --2- 172.21.15.2:0/2644337431 >> v2:172.21.15.66:3300/0 conn(0x7f999c0b6b50 0x7f999c0cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.175+0000 7f99a0c09640 1 -- 172.21.15.2:0/2644337431 >> 172.21.15.2:0/2644337431 conn(0x7f999c0b2a70 msgr2=0x7f999c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.175+0000 7f99a0c09640 1 -- 172.21.15.2:0/2644337431 shutdown_connections 2023-11-25T04:09:02.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.175+0000 7f99a0c09640 1 -- 172.21.15.2:0/2644337431 wait complete. 2023-11-25T04:09:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.176+0000 7f99a0c09640 1 Processor -- start 2023-11-25T04:09:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.176+0000 7f99a0c09640 1 -- start start 2023-11-25T04:09:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f99a0c09640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f999c06bc50 0x7f999c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f99a0c09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c099970 0x7f999c0adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f99a0c09640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f999c0b6b50 0x7f999c0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f99a0c09640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c152c40 con 0x7f999c099970 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f99a0c09640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f999c15ef90 con 0x7f999c06bc50 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f99a0c09640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999c15da40 con 0x7f999c0b6b50 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f9993fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c099970 0x7f999c0adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f999a59c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f999c06bc50 0x7f999c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f9993fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c099970 0x7f999c0adbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35320/0 (socket says 172.21.15.2:35320) 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f9993fff640 1 -- 172.21.15.2:0/545255101 learned_addr learned my addr 172.21.15.2:0/545255101 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f999ad9d640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f999c0b6b50 0x7f999c0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f9993fff640 1 -- 172.21.15.2:0/545255101 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f999c0b6b50 msgr2=0x7f999c0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f9993fff640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f999c0b6b50 0x7f999c0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f9993fff640 1 -- 172.21.15.2:0/545255101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f999c06bc50 msgr2=0x7f999c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f9993fff640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f999c06bc50 0x7f999c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f9993fff640 1 -- 172.21.15.2:0/545255101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9994009b30 con 0x7f999c099970 2023-11-25T04:09:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.177+0000 7f999ad9d640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f999c0b6b50 0x7f999c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.178+0000 7f9993fff640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c099970 0x7f999c0adbc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f998400c400 tx=0x7f998400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.178+0000 7f9992ffd640 1 -- 172.21.15.2:0/545255101 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840052d0 con 0x7f999c099970 2023-11-25T04:09:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.178+0000 7f9992ffd640 1 -- 172.21.15.2:0/545255101 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9984005430 con 0x7f999c099970 2023-11-25T04:09:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.178+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f999c15dd20 con 0x7f999c099970 2023-11-25T04:09:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.178+0000 7f9992ffd640 1 -- 172.21.15.2:0/545255101 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9984003830 con 0x7f999c099970 2023-11-25T04:09:02.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.178+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999c15e2e0 con 0x7f999c099970 2023-11-25T04:09:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.179+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f999c09ef40 con 0x7f999c099970 2023-11-25T04:09:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.179+0000 7f9992ffd640 1 -- 172.21.15.2:0/545255101 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9984003990 con 0x7f999c099970 2023-11-25T04:09:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.180+0000 7f9992ffd640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f997c06ae40 0x7f997c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.180+0000 7f9992ffd640 1 -- 172.21.15.2:0/545255101 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9984088b00 con 0x7f999c099970 2023-11-25T04:09:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.180+0000 7f999a59c640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f997c06ae40 0x7f997c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.180+0000 7f999a59c640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f997c06ae40 0x7f997c06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f998c0079a0 tx=0x7f998c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:02.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.184+0000 7f9992ffd640 1 -- 172.21.15.2:0/545255101 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9984053cf0 con 0x7f999c099970 2023-11-25T04:09:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.359+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f999c15e4a0 con 0x7f999c099970 2023-11-25T04:09:02.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.360+0000 7f9992ffd640 1 -- 172.21.15.2:0/545255101 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99840170a0 con 0x7f999c099970 2023-11-25T04:09:02.361 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f997c06ae40 msgr2=0x7f997c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f997c06ae40 0x7f997c06d300 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f998c0079a0 tx=0x7f998c008040 comp rx=0 tx=0).stop 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c099970 msgr2=0x7f999c0adbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c099970 0x7f999c0adbc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f998400c400 tx=0x7f998400c8c0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 shutdown_connections 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f999c0b6b50 0x7f999c0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f999c099970 0x7f999c0adbc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f997c06ae40 0x7f997c06d300 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 --2- 172.21.15.2:0/545255101 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f999c06bc50 0x7f999c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 >> 172.21.15.2:0/545255101 conn(0x7f999c0b2a70 msgr2=0x7f999c0cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 shutdown_connections 2023-11-25T04:09:02.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.361+0000 7f99a0c09640 1 -- 172.21.15.2:0/545255101 wait complete. 2023-11-25T04:09:02.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.483+0000 7f9c2c3de640 1 Processor -- start 2023-11-25T04:09:02.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.483+0000 7f9c2c3de640 1 -- start start 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.484+0000 7f9c2c3de640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240b2aa0 0x7f9c24168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.484+0000 7f9c2c3de640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240ce360 con 0x7f9c24160b70 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.484+0000 7f9c2c3de640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240d19f0 con 0x7f9c240d1570 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.484+0000 7f9c2c3de640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240b2f10 con 0x7f9c240b2aa0 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.484+0000 7f9c2a17a640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f9c24160b70 0x7f9c240ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50616/0 (socket says 172.21.15.2:50616) 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.484+0000 7f9c2a17a640 1 -- 172.21.15.2:0/3683478518 learned_addr learned my addr 172.21.15.2:0/3683478518 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c2a97b640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240b2aa0 0x7f9c24168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208869042 0 0) 0x7f9c240ce360 con 0x7f9c24160b70 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c0c003520 con 0x7f9c24160b70 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2261293223 0 0) 0x7f9c0c003520 con 0x7f9c24160b70 2023-11-25T04:09:02.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240b2aa0 msgr2=0x7f9c24168560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240b2aa0 0x7f9c24168560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 >> v1:172.21.15.66:6789/0 conn(0x7f9c240d1570 legacy=0x7f9c240cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240cdd50 con 0x7f9c24160b70 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f9c1c001670 con 0x7f9c24160b70 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 >> v1:172.21.15.2:6789/0 conn(0x7f9c24160b70 legacy=0x7f9c240ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240b2aa0 0x7f9c0c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c0c004d00 0x7f9c0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240b2f10 con 0x7f9c0c003f20 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c00ba60 con 0x7f9c0c004d00 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0c00bc20 con 0x7f9c240b2aa0 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29979640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c2a17a640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240b2aa0 0x7f9c0c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c2a97b640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c0c004d00 0x7f9c0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29979640 1 -- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240b2aa0 msgr2=0x7f9c0c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29979640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240b2aa0 0x7f9c0c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29979640 1 -- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c0c004d00 msgr2=0x7f9c0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29979640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c0c004d00 0x7f9c0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.485+0000 7f9c29979640 1 -- 172.21.15.2:0/3683478518 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c003520 con 0x7f9c0c003f20 2023-11-25T04:09:02.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.486+0000 7f9c29979640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c0c0047c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c18001750 tx=0x7f9c0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7535468024b5d7b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:02.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.486+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c180052d0 con 0x7f9c0c003f20 2023-11-25T04:09:02.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.486+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1802e050 con 0x7f9c0c003f20 2023-11-25T04:09:02.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.486+0000 7f9c29178640 1 -- 172.21.15.2:0/3683478518 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c18003830 con 0x7f9c0c003f20 2023-11-25T04:09:02.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.487+0000 7f9c2c3de640 1 -- 172.21.15.2:0/3683478518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 msgr2=0x7f9c0c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.487+0000 7f9c2c3de640 1 --2- 172.21.15.2:0/3683478518 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c0c0047c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9c18001750 tx=0x7f9c0c0057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.487+0000 7f9c2a97b640 1 -- 172.21.15.2:0/3683478518 reap_dead start 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.487+0000 7f9c2c3de640 1 -- 172.21.15.2:0/3683478518 shutdown_connections 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.487+0000 7f9c2c3de640 1 -- 172.21.15.2:0/3683478518 >> 172.21.15.2:0/3683478518 conn(0x7f9c2409c470 msgr2=0x7f9c240d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.487+0000 7f9c2c3de640 1 -- 172.21.15.2:0/3683478518 shutdown_connections 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.487+0000 7f9c2c3de640 1 -- 172.21.15.2:0/3683478518 wait complete. 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.488+0000 7f9c2c3de640 1 Processor -- start 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.488+0000 7f9c2c3de640 1 -- start start 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2c3de640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c240b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2c3de640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2414c570 0x7f9c240c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2c3de640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240c9380 0x7f9c24157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2c3de640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240c9800 con 0x7f9c0c003f20 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2c3de640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240b3f00 con 0x7f9c2414c570 2023-11-25T04:09:02.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2c3de640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24157130 con 0x7f9c240c9380 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2a17a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c240b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2a17a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c240b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35348/0 (socket says 172.21.15.2:35348) 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2a17a640 1 -- 172.21.15.2:0/2303133867 learned_addr learned my addr 172.21.15.2:0/2303133867 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c29979640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2414c570 0x7f9c240c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2a97b640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240c9380 0x7f9c24157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2a17a640 1 -- 172.21.15.2:0/2303133867 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240c9380 msgr2=0x7f9c24157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.489+0000 7f9c2a17a640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240c9380 0x7f9c24157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.490+0000 7f9c2a17a640 1 -- 172.21.15.2:0/2303133867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2414c570 msgr2=0x7f9c240c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.490+0000 7f9c2a17a640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2414c570 0x7f9c240c8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.490+0000 7f9c2a17a640 1 -- 172.21.15.2:0/2303133867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24157410 con 0x7f9c0c003f20 2023-11-25T04:09:02.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.490+0000 7f9c2a17a640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c240b39c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0072c0 tx=0x7f9c1c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.490+0000 7f9c22ffd640 1 -- 172.21.15.2:0/2303133867 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00f8e0 con 0x7f9c0c003f20 2023-11-25T04:09:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.490+0000 7f9c22ffd640 1 -- 172.21.15.2:0/2303133867 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c00fa40 con 0x7f9c0c003f20 2023-11-25T04:09:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.490+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c241576f0 con 0x7f9c0c003f20 2023-11-25T04:09:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.490+0000 7f9c22ffd640 1 -- 172.21.15.2:0/2303133867 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c00fdf0 con 0x7f9c0c003f20 2023-11-25T04:09:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.490+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2414c9d0 con 0x7f9c0c003f20 2023-11-25T04:09:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.491+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c24157270 con 0x7f9c0c003f20 2023-11-25T04:09:02.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.491+0000 7f9c22ffd640 1 -- 172.21.15.2:0/2303133867 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c1c01d460 con 0x7f9c0c003f20 2023-11-25T04:09:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.492+0000 7f9c22ffd640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9c1006ae40 0x7f9c1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.492+0000 7f9c22ffd640 1 -- 172.21.15.2:0/2303133867 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c1c0896c0 con 0x7f9c0c003f20 2023-11-25T04:09:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.492+0000 7f9c29979640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9c1006ae40 0x7f9c1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.492+0000 7f9c29979640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9c1006ae40 0x7f9c1006d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c18033000 tx=0x7f9c18009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:02.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.496+0000 7f9c22ffd640 1 -- 172.21.15.2:0/2303133867 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c24157270 con 0x7f9c0c003f20 2023-11-25T04:09:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.675+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9c24157270 con 0x7f9c0c003f20 2023-11-25T04:09:02.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.675+0000 7f9c22ffd640 1 -- 172.21.15.2:0/2303133867 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9c24157270 con 0x7f9c0c003f20 2023-11-25T04:09:02.677 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9c1006ae40 msgr2=0x7f9c1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9c1006ae40 0x7f9c1006d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9c18033000 tx=0x7f9c18009030 comp rx=0 tx=0).stop 2023-11-25T04:09:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 msgr2=0x7f9c240b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c240b39c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c0072c0 tx=0x7f9c1c007780 comp rx=0 tx=0).stop 2023-11-25T04:09:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 shutdown_connections 2023-11-25T04:09:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c240c9380 0x7f9c24157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9c1006ae40 0x7f9c1006d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c2414c570 0x7f9c240c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 --2- 172.21.15.2:0/2303133867 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9c0c003f20 0x7f9c240b39c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 >> 172.21.15.2:0/2303133867 conn(0x7f9c2409c470 msgr2=0x7f9c240afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:02.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 shutdown_connections 2023-11-25T04:09:02.680 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.677+0000 7f9c2c3de640 1 -- 172.21.15.2:0/2303133867 wait complete. 2023-11-25T04:09:02.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:02.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.797+0000 7f98e5090640 1 Processor -- start 2023-11-25T04:09:02.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.798+0000 7f98e5090640 1 -- start start 2023-11-25T04:09:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.798+0000 7f98e5090640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e00b6b50 0x7f98e00cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.798+0000 7f98e5090640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98e006bc50 0x7f98e006c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.798+0000 7f98e5090640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e00b3590 con 0x7f98e0099970 2023-11-25T04:09:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.798+0000 7f98e5090640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e006b310 con 0x7f98e006bc50 2023-11-25T04:09:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.798+0000 7f98e5090640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00cd3a0 con 0x7f98e00b6b50 2023-11-25T04:09:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.798+0000 7f98df59e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98e006bc50 0x7f98e006c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.799+0000 7f98df59e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f98e006bc50 0x7f98e006c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35352/0 (socket says 172.21.15.2:35352) 2023-11-25T04:09:02.800 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.799+0000 7f98df59e640 1 -- 172.21.15.2:0/1539045243 learned_addr learned my addr 172.21.15.2:0/1539045243 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:02.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.799+0000 7f98ded9d640 1 --2- 172.21.15.2:0/1539045243 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e00b6b50 0x7f98e00cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.799+0000 7f98df59e640 1 -- 172.21.15.2:0/1539045243 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e00b6b50 msgr2=0x7f98e00cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:02.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.799+0000 7f98df59e640 1 --2- 172.21.15.2:0/1539045243 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e00b6b50 0x7f98e00cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.799+0000 7f98df59e640 1 -- 172.21.15.2:0/1539045243 >> v1:172.21.15.66:6789/0 conn(0x7f98e0099970 legacy=0x7f98e0099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:02.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.799+0000 7f98df59e640 1 -- 172.21.15.2:0/1539045243 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e00b37c0 con 0x7f98e006bc50 2023-11-25T04:09:02.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98df59e640 1 --2- 172.21.15.2:0/1539045243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 0x7f98e006c0b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009e50 tx=0x7f98d802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6893c3b9d9680b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:02.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98ddd9b640 1 -- 172.21.15.2:0/1539045243 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d802cb00 con 0x7f98e006bc50 2023-11-25T04:09:02.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98ddd9b640 1 -- 172.21.15.2:0/1539045243 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d802cc60 con 0x7f98e006bc50 2023-11-25T04:09:02.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98ddd9b640 1 -- 172.21.15.2:0/1539045243 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d80343f0 con 0x7f98e006bc50 2023-11-25T04:09:02.802 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98e5090640 1 -- 172.21.15.2:0/1539045243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 msgr2=0x7f98e006c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98e5090640 1 --2- 172.21.15.2:0/1539045243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 0x7f98e006c0b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f98d8009e50 tx=0x7f98d802bf60 comp rx=0 tx=0).stop 2023-11-25T04:09:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98e5090640 1 -- 172.21.15.2:0/1539045243 shutdown_connections 2023-11-25T04:09:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98e5090640 1 --2- 172.21.15.2:0/1539045243 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 0x7f98e006c0b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98e5090640 1 --2- 172.21.15.2:0/1539045243 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e00b6b50 0x7f98e00cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98e5090640 1 -- 172.21.15.2:0/1539045243 >> 172.21.15.2:0/1539045243 conn(0x7f98e00b2a70 msgr2=0x7f98e00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98e5090640 1 -- 172.21.15.2:0/1539045243 shutdown_connections 2023-11-25T04:09:02.803 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.800+0000 7f98e5090640 1 -- 172.21.15.2:0/1539045243 wait complete. 2023-11-25T04:09:02.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.802+0000 7f98e5090640 1 Processor -- start 2023-11-25T04:09:02.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.802+0000 7f98e5090640 1 -- start start 2023-11-25T04:09:02.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98e5090640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 0x7f98e00b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.805 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98e5090640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e0099970 0x7f98e0152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98e5090640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e00b6b50 0x7f98e01533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98e5090640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00c8050 con 0x7f98e006bc50 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98e5090640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00c82f0 con 0x7f98e00b6b50 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98e5090640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e00c85d0 con 0x7f98e0099970 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98ded9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 0x7f98e00b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98ded9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 0x7f98e00b5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35360/0 (socket says 172.21.15.2:35360) 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98ded9d640 1 -- 172.21.15.2:0/3050524046 learned_addr learned my addr 172.21.15.2:0/3050524046 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98df59e640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e00b6b50 0x7f98e01533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98de59c640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e0099970 0x7f98e0152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98ded9d640 1 -- 172.21.15.2:0/3050524046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e0099970 msgr2=0x7f98e0152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98ded9d640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e0099970 0x7f98e0152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.806 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98ded9d640 1 -- 172.21.15.2:0/3050524046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e00b6b50 msgr2=0x7f98e01533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98ded9d640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e00b6b50 0x7f98e01533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98ded9d640 1 -- 172.21.15.2:0/3050524046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8009b30 con 0x7f98e006bc50 2023-11-25T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98ded9d640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 0x7f98e00b5640 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98d000c7f0 tx=0x7f98d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98c77fe640 1 -- 172.21.15.2:0/3050524046 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0004220 con 0x7f98e006bc50 2023-11-25T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98c77fe640 1 -- 172.21.15.2:0/3050524046 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d0004380 con 0x7f98e006bc50 2023-11-25T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98c77fe640 1 -- 172.21.15.2:0/3050524046 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0007840 con 0x7f98e006bc50 2023-11-25T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e00c88b0 con 0x7f98e006bc50 2023-11-25T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.803+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e00b5b80 con 0x7f98e006bc50 2023-11-25T04:09:02.807 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.804+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e00c8dd0 con 0x7f98e006bc50 2023-11-25T04:09:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.805+0000 7f98c77fe640 1 -- 172.21.15.2:0/3050524046 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f98d0007bb0 con 0x7f98e006bc50 2023-11-25T04:09:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.805+0000 7f98c77fe640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f98cc06ae40 0x7f98cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.806+0000 7f98c77fe640 1 -- 172.21.15.2:0/3050524046 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98d0089510 con 0x7f98e006bc50 2023-11-25T04:09:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.806+0000 7f98de59c640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f98cc06ae40 0x7f98cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:02.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.806+0000 7f98de59c640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f98cc06ae40 0x7f98cc06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f98e00b5fe0 tx=0x7f98d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:02.810 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.810+0000 7f98c77fe640 1 -- 172.21.15.2:0/3050524046 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98e00c8dd0 con 0x7f98e006bc50 2023-11-25T04:09:02.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.984+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98e00c8dd0 con 0x7f98e006bc50 2023-11-25T04:09:02.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.985+0000 7f98c77fe640 1 -- 172.21.15.2:0/3050524046 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f98d001e020 con 0x7f98e006bc50 2023-11-25T04:09:02.986 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f98cc06ae40 msgr2=0x7f98cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f98cc06ae40 0x7f98cc06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f98e00b5fe0 tx=0x7f98d4009040 comp rx=0 tx=0).stop 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 msgr2=0x7f98e00b5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 0x7f98e00b5640 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f98d000c7f0 tx=0x7f98d000ccb0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 shutdown_connections 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f98cc06ae40 0x7f98cc06d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e00b6b50 0x7f98e01533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e0099970 0x7f98e0152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 --2- 172.21.15.2:0/3050524046 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f98e006bc50 0x7f98e00b5640 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.986+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 >> 172.21.15.2:0/3050524046 conn(0x7f98e00b2a70 msgr2=0x7f98e00b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:02.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.987+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 shutdown_connections 2023-11-25T04:09:02.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:02.987+0000 7f98e5090640 1 -- 172.21.15.2:0/3050524046 wait complete. 2023-11-25T04:09:02.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.104+0000 7fc831f53640 1 Processor -- start 2023-11-25T04:09:03.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.104+0000 7fc831f53640 1 -- start start 2023-11-25T04:09:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.104+0000 7fc831f53640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc82c0d0ab0 0x7fc82c0cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.104+0000 7fc831f53640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c06f9d0 con 0x7fc82c0cce70 2023-11-25T04:09:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.105+0000 7fc831f53640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82c06c190 con 0x7fc82c0d1c50 2023-11-25T04:09:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.105+0000 7fc831f53640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82c06bfa0 con 0x7fc82c0d0ab0 2023-11-25T04:09:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.105+0000 7fc82affd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc82c0d0ab0 0x7fc82c0cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.105+0000 7fc82affd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc82c0d0ab0 0x7fc82c0cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35372/0 (socket says 172.21.15.2:35372) 2023-11-25T04:09:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.105+0000 7fc82affd640 1 -- 172.21.15.2:0/2759730815 learned_addr learned my addr 172.21.15.2:0/2759730815 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.105+0000 7fc82b7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fc82c0cce70 0x7fc82c099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50620/0 (socket says 172.21.15.2:50620) 2023-11-25T04:09:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.105+0000 7fc82affd640 1 -- 172.21.15.2:0/2759730815 >> v1:172.21.15.66:6789/0 conn(0x7fc82c0d1c50 legacy=0x7fc82c0cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.105+0000 7fc82affd640 1 -- 172.21.15.2:0/2759730815 >> v1:172.21.15.2:6789/0 conn(0x7fc82c0cce70 legacy=0x7fc82c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.105+0000 7fc82affd640 1 -- 172.21.15.2:0/2759730815 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c06c470 con 0x7fc82c0d0ab0 2023-11-25T04:09:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc82affd640 1 --2- 172.21.15.2:0/2759730815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d0ab0 0x7fc82c0cf390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009870 tx=0x7fc81c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410c7ab5306760a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc82a7fc640 1 -- 172.21.15.2:0/2759730815 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c02f840 con 0x7fc82c0d0ab0 2023-11-25T04:09:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc82a7fc640 1 -- 172.21.15.2:0/2759730815 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c02f9a0 con 0x7fc82c0d0ab0 2023-11-25T04:09:03.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc82a7fc640 1 -- 172.21.15.2:0/2759730815 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c02fd30 con 0x7fc82c0d0ab0 2023-11-25T04:09:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc831f53640 1 -- 172.21.15.2:0/2759730815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d0ab0 msgr2=0x7fc82c0cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc831f53640 1 --2- 172.21.15.2:0/2759730815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d0ab0 0x7fc82c0cf390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009870 tx=0x7fc81c02ba20 comp rx=0 tx=0).stop 2023-11-25T04:09:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc831f53640 1 -- 172.21.15.2:0/2759730815 shutdown_connections 2023-11-25T04:09:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc831f53640 1 --2- 172.21.15.2:0/2759730815 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d0ab0 0x7fc82c0cf390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc831f53640 1 -- 172.21.15.2:0/2759730815 >> 172.21.15.2:0/2759730815 conn(0x7fc82c0d0f20 msgr2=0x7fc82c0d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc831f53640 1 -- 172.21.15.2:0/2759730815 shutdown_connections 2023-11-25T04:09:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.106+0000 7fc831f53640 1 -- 172.21.15.2:0/2759730815 wait complete. 2023-11-25T04:09:03.109 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.108+0000 7fc831f53640 1 Processor -- start 2023-11-25T04:09:03.112 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.108+0000 7fc831f53640 1 -- start start 2023-11-25T04:09:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc831f53640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc82c0cce70 0x7fc82c150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc831f53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c0d0ab0 0x7fc82c0aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc831f53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d1c50 0x7fc82c0af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc831f53640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0c7ff0 con 0x7fc82c0d1c50 2023-11-25T04:09:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc831f53640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0c8290 con 0x7fc82c0d0ab0 2023-11-25T04:09:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc831f53640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82c0c8570 con 0x7fc82c0cce70 2023-11-25T04:09:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d1c50 0x7fc82c0af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d1c50 0x7fc82c0af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35376/0 (socket says 172.21.15.2:35376) 2023-11-25T04:09:03.113 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82bfff640 1 -- 172.21.15.2:0/752476944 learned_addr learned my addr 172.21.15.2:0/752476944 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82b7fe640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc82c0cce70 0x7fc82c150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82affd640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c0d0ab0 0x7fc82c0aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82bfff640 1 -- 172.21.15.2:0/752476944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc82c0cce70 msgr2=0x7fc82c150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82bfff640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc82c0cce70 0x7fc82c150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82bfff640 1 -- 172.21.15.2:0/752476944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c0d0ab0 msgr2=0x7fc82c0aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82bfff640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c0d0ab0 0x7fc82c0aefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82bfff640 1 -- 172.21.15.2:0/752476944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc81c0094d0 con 0x7fc82c0d1c50 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82affd640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c0d0ab0 0x7fc82c0aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc82bfff640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d1c50 0x7fc82c0af520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c680 tx=0x7fc82400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc823fff640 1 -- 172.21.15.2:0/752476944 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824003b70 con 0x7fc82c0d1c50 2023-11-25T04:09:03.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc823fff640 1 -- 172.21.15.2:0/752476944 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc824003cd0 con 0x7fc82c0d1c50 2023-11-25T04:09:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc823fff640 1 -- 172.21.15.2:0/752476944 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824005310 con 0x7fc82c0d1c50 2023-11-25T04:09:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.109+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc82c0c8850 con 0x7fc82c0d1c50 2023-11-25T04:09:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.110+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc82c0c8e10 con 0x7fc82c0d1c50 2023-11-25T04:09:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.110+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82c1514e0 con 0x7fc82c0d1c50 2023-11-25T04:09:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.111+0000 7fc823fff640 1 -- 172.21.15.2:0/752476944 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc824005470 con 0x7fc82c0d1c50 2023-11-25T04:09:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.111+0000 7fc823fff640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc80c06ae40 0x7fc80c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.111+0000 7fc823fff640 1 -- 172.21.15.2:0/752476944 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc824089270 con 0x7fc82c0d1c50 2023-11-25T04:09:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.111+0000 7fc82b7fe640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc80c06ae40 0x7fc80c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.112+0000 7fc82b7fe640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc80c06ae40 0x7fc80c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc814000f60 tx=0x7fc814000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:03.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.115+0000 7fc823fff640 1 -- 172.21.15.2:0/752476944 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc82c1514e0 con 0x7fc82c0d1c50 2023-11-25T04:09:03.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.295+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc82c1514e0 con 0x7fc82c0d1c50 2023-11-25T04:09:03.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.297+0000 7fc823fff640 1 -- 172.21.15.2:0/752476944 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fc82c1514e0 con 0x7fc82c0d1c50 2023-11-25T04:09:03.298 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:03.298 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:03.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc80c06ae40 msgr2=0x7fc80c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc80c06ae40 0x7fc80c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc814000f60 tx=0x7fc814000ed0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d1c50 msgr2=0x7fc82c0af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d1c50 0x7fc82c0af520 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c680 tx=0x7fc82400cb40 comp rx=0 tx=0).stop 2023-11-25T04:09:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 shutdown_connections 2023-11-25T04:09:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc82c0d1c50 0x7fc82c0af520 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc80c06ae40 0x7fc80c06d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc82c0d0ab0 0x7fc82c0aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 --2- 172.21.15.2:0/752476944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc82c0cce70 0x7fc82c150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 >> 172.21.15.2:0/752476944 conn(0x7fc82c0d0f20 msgr2=0x7fc82c0d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 shutdown_connections 2023-11-25T04:09:03.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.299+0000 7fc831f53640 1 -- 172.21.15.2:0/752476944 wait complete. 2023-11-25T04:09:03.311 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:03.312 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:03.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.420+0000 7f32cfce0640 1 Processor -- start 2023-11-25T04:09:03.421 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.420+0000 7f32cfce0640 1 -- start start 2023-11-25T04:09:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.421+0000 7f32cfce0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c815d8d0 0x7f32c8099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.421+0000 7f32cfce0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c809a310 con 0x7f32c8099eb0 2023-11-25T04:09:03.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.421+0000 7f32cfce0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32c80cfca0 con 0x7f32c80cf640 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.421+0000 7f32cfce0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80b0720 con 0x7f32c815d8d0 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.421+0000 7f32cd27b640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f32c8099eb0 0x7f32c80cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50626/0 (socket says 172.21.15.2:50626) 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.421+0000 7f32cd27b640 1 -- 172.21.15.2:0/684142794 learned_addr learned my addr 172.21.15.2:0/684142794 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.421+0000 7f32cda7c640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c815d8d0 0x7f32c8099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541631766 0 0) 0x7f32c809a310 con 0x7f32c8099eb0 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b0003520 con 0x7f32c8099eb0 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241510389 0 0) 0x7f32c80cfca0 con 0x7f32c80cf640 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32c809a310 con 0x7f32c80cf640 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1922472296 0 0) 0x7f32b0003520 con 0x7f32c8099eb0 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c815d8d0 msgr2=0x7f32c8099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:03.426 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c815d8d0 0x7f32c8099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 >> v1:172.21.15.66:6789/0 conn(0x7f32c80cf640 legacy=0x7f32c80b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c80b0a00 con 0x7f32c8099eb0 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f32bc001670 con 0x7f32c8099eb0 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 >> v1:172.21.15.2:6789/0 conn(0x7f32c8099eb0 legacy=0x7f32c80cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32b0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c815d8d0 0x7f32b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32b0004d00 0x7f32b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80b0720 con 0x7f32b0003b30 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b000ba30 con 0x7f32b0004d00 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b000bbf0 con 0x7f32c815d8d0 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cda7c640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32b0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cd27b640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c815d8d0 0x7f32b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.427 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32ce27d640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32b0004d00 0x7f32b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cda7c640 1 -- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c815d8d0 msgr2=0x7f32b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cda7c640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c815d8d0 0x7f32b00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cda7c640 1 -- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32b0004d00 msgr2=0x7f32b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cda7c640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32b0004d00 0x7f32b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32cda7c640 1 -- 172.21.15.2:0/684142794 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b0003520 con 0x7f32b0003b30 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.422+0000 7f32ce27d640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32b0004d00 0x7f32b0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.423+0000 7f32cda7c640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32b0003f30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009fc0 tx=0x7f32b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba39ea8277c15d6f server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.423+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c002cc20 con 0x7f32b0003b30 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.423+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c000f040 con 0x7f32b0003b30 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.423+0000 7f32cca7a640 1 -- 172.21.15.2:0/684142794 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0034440 con 0x7f32b0003b30 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.424+0000 7f32cfce0640 1 -- 172.21.15.2:0/684142794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 msgr2=0x7f32b0003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.424+0000 7f32cfce0640 1 --2- 172.21.15.2:0/684142794 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32b0003f30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f32c0009fc0 tx=0x7f32b00057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.424+0000 7f32ce27d640 1 -- 172.21.15.2:0/684142794 reap_dead start 2023-11-25T04:09:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.424+0000 7f32cfce0640 1 -- 172.21.15.2:0/684142794 shutdown_connections 2023-11-25T04:09:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.424+0000 7f32cfce0640 1 -- 172.21.15.2:0/684142794 >> 172.21.15.2:0/684142794 conn(0x7f32c80b2ab0 msgr2=0x7f32c80b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.424+0000 7f32cfce0640 1 -- 172.21.15.2:0/684142794 shutdown_connections 2023-11-25T04:09:03.429 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.424+0000 7f32cfce0640 1 -- 172.21.15.2:0/684142794 wait complete. 2023-11-25T04:09:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.425+0000 7f32cfce0640 1 Processor -- start 2023-11-25T04:09:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.425+0000 7f32cfce0640 1 -- start start 2023-11-25T04:09:03.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cfce0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32c80c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cfce0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32c8157070 0x7f32c80c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cfce0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c80c7310 0x7f32c80c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cfce0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80c7790 con 0x7f32b0003b30 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cfce0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80c6570 con 0x7f32c8157070 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cfce0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32c80ca780 con 0x7f32c80c7310 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cda7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32c80c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cda7c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32c80c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35386/0 (socket says 172.21.15.2:35386) 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cda7c640 1 -- 172.21.15.2:0/1667670528 learned_addr learned my addr 172.21.15.2:0/1667670528 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32ce27d640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c80c7310 0x7f32c80c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cd27b640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32c8157070 0x7f32c80c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cda7c640 1 -- 172.21.15.2:0/1667670528 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c80c7310 msgr2=0x7f32c80c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cda7c640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c80c7310 0x7f32c80c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cda7c640 1 -- 172.21.15.2:0/1667670528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32c8157070 msgr2=0x7f32c80c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cda7c640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32c8157070 0x7f32c80c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cda7c640 1 -- 172.21.15.2:0/1667670528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32c80c8210 con 0x7f32b0003b30 2023-11-25T04:09:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cd27b640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32c8157070 0x7f32c80c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.426+0000 7f32cda7c640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32c80c8fd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e200 tx=0x7f32c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.427+0000 7f32c67fc640 1 -- 172.21.15.2:0/1667670528 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0034c00 con 0x7f32b0003b30 2023-11-25T04:09:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.427+0000 7f32c67fc640 1 -- 172.21.15.2:0/1667670528 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32c0034d60 con 0x7f32b0003b30 2023-11-25T04:09:03.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.427+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c80c84f0 con 0x7f32b0003b30 2023-11-25T04:09:03.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.427+0000 7f32c67fc640 1 -- 172.21.15.2:0/1667670528 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32c0003bb0 con 0x7f32b0003b30 2023-11-25T04:09:03.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.427+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c80c8ab0 con 0x7f32b0003b30 2023-11-25T04:09:03.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.428+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32c809f0b0 con 0x7f32b0003b30 2023-11-25T04:09:03.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.428+0000 7f32c67fc640 1 -- 172.21.15.2:0/1667670528 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32c0040450 con 0x7f32b0003b30 2023-11-25T04:09:03.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.429+0000 7f32c67fc640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f32b406ae70 0x7f32b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.429+0000 7f32cd27b640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f32b406ae70 0x7f32b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.429+0000 7f32c67fc640 1 -- 172.21.15.2:0/1667670528 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32c00abd00 con 0x7f32b0003b30 2023-11-25T04:09:03.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.429+0000 7f32cd27b640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f32b406ae70 0x7f32b406d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f32c80af750 tx=0x7f32bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:03.435 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.433+0000 7f32c67fc640 1 -- 172.21.15.2:0/1667670528 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32c0076f80 con 0x7f32b0003b30 2023-11-25T04:09:03.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.607+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32c804e920 con 0x7f32b0003b30 2023-11-25T04:09:03.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.608+0000 7f32c67fc640 1 -- 172.21.15.2:0/1667670528 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32c007a5a0 con 0x7f32b0003b30 2023-11-25T04:09:03.609 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f32b406ae70 msgr2=0x7f32b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f32b406ae70 0x7f32b406d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f32c80af750 tx=0x7f32bc009040 comp rx=0 tx=0).stop 2023-11-25T04:09:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 msgr2=0x7f32c80c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32c80c8fd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f32c000e200 tx=0x7f32c0009750 comp rx=0 tx=0).stop 2023-11-25T04:09:03.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 shutdown_connections 2023-11-25T04:09:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32c80c7310 0x7f32c80c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f32b406ae70 0x7f32b406d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32c8157070 0x7f32c80c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 --2- 172.21.15.2:0/1667670528 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f32b0003b30 0x7f32c80c8fd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 >> 172.21.15.2:0/1667670528 conn(0x7f32c80b2ab0 msgr2=0x7f32c806f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 shutdown_connections 2023-11-25T04:09:03.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.610+0000 7f32cfce0640 1 -- 172.21.15.2:0/1667670528 wait complete. 2023-11-25T04:09:03.622 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:03.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.730+0000 7f9ec6c07640 1 Processor -- start 2023-11-25T04:09:03.731 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.730+0000 7f9ec6c07640 1 -- start start 2023-11-25T04:09:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec6c07640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00b6b50 0x7f9ec00cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec6c07640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9ec0099970 0x7f9ec0099d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec6c07640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9ec00cc390 0x7f9ec00cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec6c07640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec00b3590 con 0x7f9ec00cc390 2023-11-25T04:09:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec6c07640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec006b310 con 0x7f9ec0099970 2023-11-25T04:09:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec6c07640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec009a2d0 con 0x7f9ec00b6b50 2023-11-25T04:09:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec51a4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9ec00cc390 0x7f9ec00cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec51a4640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9ec00cc390 0x7f9ec00cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35400/0 (socket says 172.21.15.2:35400) 2023-11-25T04:09:03.733 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec51a4640 1 -- 172.21.15.2:0/1227631491 learned_addr learned my addr 172.21.15.2:0/1227631491 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec49a3640 1 --2- 172.21.15.2:0/1227631491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00b6b50 0x7f9ec00cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec51a4640 1 -- 172.21.15.2:0/1227631491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00b6b50 msgr2=0x7f9ec00cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec51a4640 1 --2- 172.21.15.2:0/1227631491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00b6b50 0x7f9ec00cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ebffff640 1 --2- 172.21.15.2:0/1227631491 >> v2:172.21.15.66:3300/0 conn(0x7f9ec0099970 0x7f9ec0099d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.731+0000 7f9ec51a4640 1 -- 172.21.15.2:0/1227631491 >> v2:172.21.15.66:3300/0 conn(0x7f9ec0099970 msgr2=0x7f9ec0099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.732+0000 7f9ec51a4640 1 --2- 172.21.15.2:0/1227631491 >> v2:172.21.15.66:3300/0 conn(0x7f9ec0099970 0x7f9ec0099d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.732+0000 7f9ec51a4640 1 -- 172.21.15.2:0/1227631491 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec00b37c0 con 0x7f9ec00cc390 2023-11-25T04:09:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.732+0000 7f9ec49a3640 1 --2- 172.21.15.2:0/1227631491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00b6b50 0x7f9ec00cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:03.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.732+0000 7f9ebffff640 1 --2- 172.21.15.2:0/1227631491 >> v2:172.21.15.66:3300/0 conn(0x7f9ec0099970 0x7f9ec0099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.732+0000 7f9ec51a4640 1 --2- 172.21.15.2:0/1227631491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00cc390 0x7f9ec00cc7f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0066c30 tx=0x7f9eb002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a0f8faadf38e66 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.732+0000 7f9ebf7fe640 1 -- 172.21.15.2:0/1227631491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0030860 con 0x7f9ec00cc390 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.732+0000 7f9ebf7fe640 1 -- 172.21.15.2:0/1227631491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb00309c0 con 0x7f9ec00cc390 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.732+0000 7f9ebf7fe640 1 -- 172.21.15.2:0/1227631491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb0030d50 con 0x7f9ec00cc390 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.733+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1227631491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00cc390 msgr2=0x7f9ec00cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.733+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1227631491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00cc390 0x7f9ec00cc7f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0066c30 tx=0x7f9eb002b9a0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.733+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1227631491 shutdown_connections 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.733+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1227631491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00cc390 0x7f9ec00cc7f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.733+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1227631491 >> v2:172.21.15.66:3300/0 conn(0x7f9ec0099970 0x7f9ec0099d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.733+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1227631491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00b6b50 0x7f9ec00cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.733+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1227631491 >> 172.21.15.2:0/1227631491 conn(0x7f9ec00b2a70 msgr2=0x7f9ec00b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.733+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1227631491 shutdown_connections 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.733+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1227631491 wait complete. 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.734+0000 7f9ec6c07640 1 Processor -- start 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.734+0000 7f9ec6c07640 1 -- start start 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ec6c07640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ec0099970 0x7f9ec01604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ec6c07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00b6b50 0x7f9ec009e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ec6c07640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00cc390 0x7f9ec015e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ec6c07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec015adf0 con 0x7f9ec00b6b50 2023-11-25T04:09:03.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ec6c07640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec009ed10 con 0x7f9ec0099970 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ec6c07640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec015ebc0 con 0x7f9ec00cc390 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00b6b50 0x7f9ec009e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ebffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00b6b50 0x7f9ec009e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35404/0 (socket says 172.21.15.2:35404) 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ebffff640 1 -- 172.21.15.2:0/1584350768 learned_addr learned my addr 172.21.15.2:0/1584350768 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ec51a4640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00cc390 0x7f9ec015e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.735+0000 7f9ec49a3640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ec0099970 0x7f9ec01604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ebffff640 1 -- 172.21.15.2:0/1584350768 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00cc390 msgr2=0x7f9ec015e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ebffff640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00cc390 0x7f9ec015e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ebffff640 1 -- 172.21.15.2:0/1584350768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ec0099970 msgr2=0x7f9ec01604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ebffff640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ec0099970 0x7f9ec01604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ebffff640 1 -- 172.21.15.2:0/1584350768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb00094d0 con 0x7f9ec00b6b50 2023-11-25T04:09:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ebffff640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00b6b50 0x7f9ec009e7d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c7c0 tx=0x7f9eb400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ebd7fa640 1 -- 172.21.15.2:0/1584350768 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4007a30 con 0x7f9ec00b6b50 2023-11-25T04:09:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ebd7fa640 1 -- 172.21.15.2:0/1584350768 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb4007b90 con 0x7f9ec00b6b50 2023-11-25T04:09:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec015eea0 con 0x7f9ec00b6b50 2023-11-25T04:09:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ebd7fa640 1 -- 172.21.15.2:0/1584350768 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb400ce70 con 0x7f9ec00b6b50 2023-11-25T04:09:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.736+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec015f460 con 0x7f9ec00b6b50 2023-11-25T04:09:03.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.737+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec009ef40 con 0x7f9ec00b6b50 2023-11-25T04:09:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.738+0000 7f9ebd7fa640 1 -- 172.21.15.2:0/1584350768 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9eb40113f0 con 0x7f9ec00b6b50 2023-11-25T04:09:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.738+0000 7f9ebd7fa640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9eac06ae40 0x7f9eac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.738+0000 7f9ebd7fa640 1 -- 172.21.15.2:0/1584350768 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9eb40896f0 con 0x7f9ec00b6b50 2023-11-25T04:09:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.738+0000 7f9ec49a3640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9eac06ae40 0x7f9eac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:03.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.738+0000 7f9ec49a3640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9eac06ae40 0x7f9eac06d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800d620 tx=0x7f9eb8007810 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:03.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.742+0000 7f9ebd7fa640 1 -- 172.21.15.2:0/1584350768 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9eb40547b0 con 0x7f9ec00b6b50 2023-11-25T04:09:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.919+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ec004e920 con 0x7f9ec00b6b50 2023-11-25T04:09:03.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.919+0000 7f9ebd7fa640 1 -- 172.21.15.2:0/1584350768 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9eb4057dd0 con 0x7f9ec00b6b50 2023-11-25T04:09:03.921 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.921+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9eac06ae40 msgr2=0x7f9eac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.921+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9eac06ae40 0x7f9eac06d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800d620 tx=0x7f9eb8007810 comp rx=0 tx=0).stop 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.921+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00b6b50 msgr2=0x7f9ec009e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.921+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00b6b50 0x7f9ec009e7d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400c7c0 tx=0x7f9eb400cc80 comp rx=0 tx=0).stop 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.922+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 shutdown_connections 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.922+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ec00cc390 0x7f9ec015e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.922+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9ec00b6b50 0x7f9ec009e7d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.922+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9eac06ae40 0x7f9eac06d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.922+0000 7f9ec6c07640 1 --2- 172.21.15.2:0/1584350768 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ec0099970 0x7f9ec01604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:03.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.922+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 >> 172.21.15.2:0/1584350768 conn(0x7f9ec00b2a70 msgr2=0x7f9ec00b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.922+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 shutdown_connections 2023-11-25T04:09:03.924 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:03.922+0000 7f9ec6c07640 1 -- 172.21.15.2:0/1584350768 wait complete. 2023-11-25T04:09:03.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.042+0000 7fa9ea89b640 1 Processor -- start 2023-11-25T04:09:04.043 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.042+0000 7fa9ea89b640 1 -- start start 2023-11-25T04:09:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9ea89b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e413f750 0x7fa9e415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.044 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9ea89b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9e413fb30 0x7fa9e40cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9ea89b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9e40ce060 con 0x7fa9e415db40 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9ea89b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9e40cec70 con 0x7fa9e413fb30 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9ea89b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e40ce340 con 0x7fa9e413f750 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9e37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9e413fb30 0x7fa9e40cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9e37fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fa9e413fb30 0x7fa9e40cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35414/0 (socket says 172.21.15.2:35414) 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9e37fe640 1 -- 172.21.15.2:0/660691750 learned_addr learned my addr 172.21.15.2:0/660691750 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9e3fff640 1 --2- 172.21.15.2:0/660691750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e413f750 0x7fa9e415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9e37fe640 1 -- 172.21.15.2:0/660691750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e413f750 msgr2=0x7fa9e415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9e37fe640 1 --2- 172.21.15.2:0/660691750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e413f750 0x7fa9e415b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9e37fe640 1 -- 172.21.15.2:0/660691750 >> v1:172.21.15.66:6789/0 conn(0x7fa9e415db40 legacy=0x7fa9e415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9e37fe640 1 -- 172.21.15.2:0/660691750 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e40ce620 con 0x7fa9e413fb30 2023-11-25T04:09:04.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.043+0000 7fa9e3fff640 1 --2- 172.21.15.2:0/660691750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e413f750 0x7fa9e415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.044+0000 7fa9e37fe640 1 --2- 172.21.15.2:0/660691750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413fb30 0x7fa9e40cd7c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009870 tx=0x7fa9d802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168fd2a19e5bdffa server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.044+0000 7fa9e2ffd640 1 -- 172.21.15.2:0/660691750 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8031640 con 0x7fa9e413fb30 2023-11-25T04:09:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.044+0000 7fa9e2ffd640 1 -- 172.21.15.2:0/660691750 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d80317a0 con 0x7fa9e413fb30 2023-11-25T04:09:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.044+0000 7fa9e2ffd640 1 -- 172.21.15.2:0/660691750 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d8031b30 con 0x7fa9e413fb30 2023-11-25T04:09:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.045+0000 7fa9ea89b640 1 -- 172.21.15.2:0/660691750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413fb30 msgr2=0x7fa9e40cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.045+0000 7fa9ea89b640 1 --2- 172.21.15.2:0/660691750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413fb30 0x7fa9e40cd7c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8009870 tx=0x7fa9d802b8f0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.045+0000 7fa9ea89b640 1 -- 172.21.15.2:0/660691750 shutdown_connections 2023-11-25T04:09:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.045+0000 7fa9ea89b640 1 --2- 172.21.15.2:0/660691750 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413fb30 0x7fa9e40cd7c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.045+0000 7fa9ea89b640 1 --2- 172.21.15.2:0/660691750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e413f750 0x7fa9e415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.045+0000 7fa9ea89b640 1 -- 172.21.15.2:0/660691750 >> 172.21.15.2:0/660691750 conn(0x7fa9e406a8f0 msgr2=0x7fa9e406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.045+0000 7fa9ea89b640 1 -- 172.21.15.2:0/660691750 shutdown_connections 2023-11-25T04:09:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.045+0000 7fa9ea89b640 1 -- 172.21.15.2:0/660691750 wait complete. 2023-11-25T04:09:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.046+0000 7fa9ea89b640 1 Processor -- start 2023-11-25T04:09:04.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.046+0000 7fa9ea89b640 1 -- start start 2023-11-25T04:09:04.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9ea89b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413f750 0x7fa9e412f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9ea89b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e413fb30 0x7fa9e40aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9ea89b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e415db40 0x7fa9e41e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9ea89b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e412f8a0 con 0x7fa9e413f750 2023-11-25T04:09:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9ea89b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e41560f0 con 0x7fa9e413fb30 2023-11-25T04:09:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9ea89b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e41563d0 con 0x7fa9e415db40 2023-11-25T04:09:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413f750 0x7fa9e412f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e3fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413f750 0x7fa9e412f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35422/0 (socket says 172.21.15.2:35422) 2023-11-25T04:09:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e3fff640 1 -- 172.21.15.2:0/1219925213 learned_addr learned my addr 172.21.15.2:0/1219925213 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:04.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e37fe640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e413fb30 0x7fa9e40aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e8e38640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e415db40 0x7fa9e41e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e3fff640 1 -- 172.21.15.2:0/1219925213 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e415db40 msgr2=0x7fa9e41e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e3fff640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e415db40 0x7fa9e41e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e3fff640 1 -- 172.21.15.2:0/1219925213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e413fb30 msgr2=0x7fa9e40aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e3fff640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e413fb30 0x7fa9e40aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e3fff640 1 -- 172.21.15.2:0/1219925213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80094d0 con 0x7fa9e413f750 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.047+0000 7fa9e3fff640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413f750 0x7fa9e412f360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400c7f0 tx=0x7fa9d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.048+0000 7fa9e0ff9640 1 -- 172.21.15.2:0/1219925213 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4007a30 con 0x7fa9e413f750 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.048+0000 7fa9e0ff9640 1 -- 172.21.15.2:0/1219925213 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4007b90 con 0x7fa9e413f750 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.048+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9e41566b0 con 0x7fa9e413f750 2023-11-25T04:09:04.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.048+0000 7fa9e0ff9640 1 -- 172.21.15.2:0/1219925213 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400ce40 con 0x7fa9e413f750 2023-11-25T04:09:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.048+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9e4156c70 con 0x7fa9e413f750 2023-11-25T04:09:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.049+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9e40b1ce0 con 0x7fa9e413f750 2023-11-25T04:09:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.049+0000 7fa9e0ff9640 1 -- 172.21.15.2:0/1219925213 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa9d40113f0 con 0x7fa9e413f750 2023-11-25T04:09:04.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.049+0000 7fa9e0ff9640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa9d006ae70 0x7fa9d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.050+0000 7fa9e0ff9640 1 -- 172.21.15.2:0/1219925213 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9d40896b0 con 0x7fa9e413f750 2023-11-25T04:09:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.050+0000 7fa9e37fe640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa9d006ae70 0x7fa9d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.050+0000 7fa9e37fe640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa9d006ae70 0x7fa9d006d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8036000 tx=0x7fa9d803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:04.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.054+0000 7fa9e0ff9640 1 -- 172.21.15.2:0/1219925213 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa9d4054810 con 0x7fa9e413f750 2023-11-25T04:09:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.231+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9e404e920 con 0x7fa9e413f750 2023-11-25T04:09:04.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.231+0000 7fa9e0ff9640 1 -- 172.21.15.2:0/1219925213 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9d4057e30 con 0x7fa9e413f750 2023-11-25T04:09:04.232 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:04.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa9d006ae70 msgr2=0x7fa9d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa9d006ae70 0x7fa9d006d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8036000 tx=0x7fa9d803c040 comp rx=0 tx=0).stop 2023-11-25T04:09:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413f750 msgr2=0x7fa9e412f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413f750 0x7fa9e412f360 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa9d400c7f0 tx=0x7fa9d400cbf0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 shutdown_connections 2023-11-25T04:09:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9e415db40 0x7fa9e41e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa9d006ae70 0x7fa9d006d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9e413fb30 0x7fa9e40aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 --2- 172.21.15.2:0/1219925213 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa9e413f750 0x7fa9e412f360 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 >> 172.21.15.2:0/1219925213 conn(0x7fa9e406a8f0 msgr2=0x7fa9e406d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 shutdown_connections 2023-11-25T04:09:04.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.233+0000 7fa9ea89b640 1 -- 172.21.15.2:0/1219925213 wait complete. 2023-11-25T04:09:04.286 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-25T04:09:04.286 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:04.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.393+0000 7f47f4061640 1 Processor -- start 2023-11-25T04:09:04.394 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.393+0000 7f47f4061640 1 -- start start 2023-11-25T04:09:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f4061640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f47ec13e2d0 0x7f47ec0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f4061640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47ec15bf60 0x7f47ec0cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f4061640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec06de80 con 0x7f47ec0b4640 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f4061640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec0b4ad0 con 0x7f47ec15bf60 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f4061640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec15fc60 con 0x7f47ec13e2d0 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f25fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47ec15bf60 0x7f47ec0cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f25fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f47ec15bf60 0x7f47ec0cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35438/0 (socket says 172.21.15.2:35438) 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f25fe640 1 -- 172.21.15.2:0/69061805 learned_addr learned my addr 172.21.15.2:0/69061805 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f1dfd640 1 --2- 172.21.15.2:0/69061805 >> v2:172.21.15.66:3300/0 conn(0x7f47ec13e2d0 0x7f47ec0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f25fe640 1 -- 172.21.15.2:0/69061805 >> v2:172.21.15.66:3300/0 conn(0x7f47ec13e2d0 msgr2=0x7f47ec0b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f25fe640 1 --2- 172.21.15.2:0/69061805 >> v2:172.21.15.66:3300/0 conn(0x7f47ec13e2d0 0x7f47ec0b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f25fe640 1 -- 172.21.15.2:0/69061805 >> v1:172.21.15.66:6789/0 conn(0x7f47ec0b4640 legacy=0x7f47ec15b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:04.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.394+0000 7f47f25fe640 1 -- 172.21.15.2:0/69061805 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec15c360 con 0x7f47ec15bf60 2023-11-25T04:09:04.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.395+0000 7f47f25fe640 1 --2- 172.21.15.2:0/69061805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 0x7f47ec0cd810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f47ec06ff30 tx=0x7f47e402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62621e42a5da73e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:04.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.395+0000 7f47f0dfb640 1 -- 172.21.15.2:0/69061805 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e402ca80 con 0x7f47ec15bf60 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.395+0000 7f47f0dfb640 1 -- 172.21.15.2:0/69061805 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e402cbe0 con 0x7f47ec15bf60 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.395+0000 7f47f0dfb640 1 -- 172.21.15.2:0/69061805 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e40343f0 con 0x7f47ec15bf60 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.396+0000 7f47f4061640 1 -- 172.21.15.2:0/69061805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 msgr2=0x7f47ec0cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.396+0000 7f47f4061640 1 --2- 172.21.15.2:0/69061805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 0x7f47ec0cd810 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f47ec06ff30 tx=0x7f47e402bee0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.396+0000 7f47f4061640 1 -- 172.21.15.2:0/69061805 shutdown_connections 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.396+0000 7f47f4061640 1 --2- 172.21.15.2:0/69061805 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 0x7f47ec0cd810 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.396+0000 7f47f4061640 1 --2- 172.21.15.2:0/69061805 >> v2:172.21.15.66:3300/0 conn(0x7f47ec13e2d0 0x7f47ec0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.396+0000 7f47f4061640 1 -- 172.21.15.2:0/69061805 >> 172.21.15.2:0/69061805 conn(0x7f47ec0b0af0 msgr2=0x7f47ec0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.396+0000 7f47f4061640 1 -- 172.21.15.2:0/69061805 shutdown_connections 2023-11-25T04:09:04.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.396+0000 7f47f4061640 1 -- 172.21.15.2:0/69061805 wait complete. 2023-11-25T04:09:04.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.397+0000 7f47f4061640 1 Processor -- start 2023-11-25T04:09:04.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.397+0000 7f47f4061640 1 -- start start 2023-11-25T04:09:04.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f4061640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0b4640 0x7f47ec13d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f4061640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec13e2d0 0x7f47ec153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f4061640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 0x7f47ec156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f4061640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec153330 con 0x7f47ec15bf60 2023-11-25T04:09:04.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f4061640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec1f1030 con 0x7f47ec13e2d0 2023-11-25T04:09:04.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f4061640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec157940 con 0x7f47ec0b4640 2023-11-25T04:09:04.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f25fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 0x7f47ec156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f25fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 0x7f47ec156dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35442/0 (socket says 172.21.15.2:35442) 2023-11-25T04:09:04.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f25fe640 1 -- 172.21.15.2:0/3999349716 learned_addr learned my addr 172.21.15.2:0/3999349716 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:04.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f15fc640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec13e2d0 0x7f47ec153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f1dfd640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0b4640 0x7f47ec13d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f25fe640 1 -- 172.21.15.2:0/3999349716 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0b4640 msgr2=0x7f47ec13d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f25fe640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0b4640 0x7f47ec13d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f25fe640 1 -- 172.21.15.2:0/3999349716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec13e2d0 msgr2=0x7f47ec153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f25fe640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec13e2d0 0x7f47ec153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f25fe640 1 -- 172.21.15.2:0/3999349716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e4009b30 con 0x7f47ec15bf60 2023-11-25T04:09:04.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f1dfd640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0b4640 0x7f47ec13d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:04.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.398+0000 7f47f25fe640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 0x7f47ec156dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009e50 tx=0x7f47e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:04.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.399+0000 7f47e27fc640 1 -- 172.21.15.2:0/3999349716 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e4009510 con 0x7f47ec15bf60 2023-11-25T04:09:04.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.399+0000 7f47e27fc640 1 -- 172.21.15.2:0/3999349716 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e403e450 con 0x7f47ec15bf60 2023-11-25T04:09:04.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.399+0000 7f47e27fc640 1 -- 172.21.15.2:0/3999349716 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e403e7e0 con 0x7f47ec15bf60 2023-11-25T04:09:04.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.399+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec157c20 con 0x7f47ec15bf60 2023-11-25T04:09:04.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.399+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec152f50 con 0x7f47ec15bf60 2023-11-25T04:09:04.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.400+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec0b0320 con 0x7f47ec15bf60 2023-11-25T04:09:04.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.400+0000 7f47e27fc640 1 -- 172.21.15.2:0/3999349716 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47e402cd50 con 0x7f47ec15bf60 2023-11-25T04:09:04.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.401+0000 7f47e27fc640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f47d006ae40 0x7f47d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.401+0000 7f47e27fc640 1 -- 172.21.15.2:0/3999349716 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47e40ac100 con 0x7f47ec15bf60 2023-11-25T04:09:04.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.401+0000 7f47f1dfd640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f47d006ae40 0x7f47d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.401+0000 7f47f1dfd640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f47d006ae40 0x7f47d006d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47ec15f5f0 tx=0x7f47e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:04.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.405+0000 7f47e27fc640 1 -- 172.21.15.2:0/3999349716 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47e4077360 con 0x7f47ec15bf60 2023-11-25T04:09:04.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.586+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47ec067420 con 0x7f47ec15bf60 2023-11-25T04:09:04.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.587+0000 7f47e27fc640 1 -- 172.21.15.2:0/3999349716 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f47e407a980 con 0x7f47ec15bf60 2023-11-25T04:09:04.588 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:04.589 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:04.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f47d006ae40 msgr2=0x7f47d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f47d006ae40 0x7f47d006d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47ec15f5f0 tx=0x7f47e8008040 comp rx=0 tx=0).stop 2023-11-25T04:09:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 msgr2=0x7f47ec156dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 0x7f47ec156dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009e50 tx=0x7f47e4004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 shutdown_connections 2023-11-25T04:09:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f47ec15bf60 0x7f47ec156dd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f47d006ae40 0x7f47d006d300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec13e2d0 0x7f47ec153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 --2- 172.21.15.2:0/3999349716 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0b4640 0x7f47ec13d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 >> 172.21.15.2:0/3999349716 conn(0x7f47ec0b0af0 msgr2=0x7f47ec0ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 shutdown_connections 2023-11-25T04:09:04.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.589+0000 7f47f4061640 1 -- 172.21.15.2:0/3999349716 wait complete. 2023-11-25T04:09:04.602 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:04.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:04.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.710+0000 7fba3ba07640 1 Processor -- start 2023-11-25T04:09:04.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.711+0000 7fba3ba07640 1 -- start start 2023-11-25T04:09:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.711+0000 7fba3ba07640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fba340cfd40 0x7fba3406c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba3ba07640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba340b3590 con 0x7fba340b6b50 2023-11-25T04:09:04.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba3ba07640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba3406b310 con 0x7fba3409a080 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba3ba07640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba340cd3a0 con 0x7fba340cfd40 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba397a3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fba340b6b50 0x7fba34099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50628/0 (socket says 172.21.15.2:50628) 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba397a3640 1 -- 172.21.15.2:0/1301766116 learned_addr learned my addr 172.21.15.2:0/1301766116 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba39fa4640 1 --2- 172.21.15.2:0/1301766116 >> v2:172.21.15.66:3300/0 conn(0x7fba340cfd40 0x7fba3406c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996996342 0 0) 0x7fba340b3590 con 0x7fba340b6b50 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba20003520 con 0x7fba340b6b50 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1669729626 0 0) 0x7fba20003520 con 0x7fba340b6b50 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 >> v2:172.21.15.66:3300/0 conn(0x7fba340cfd40 msgr2=0x7fba3406c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 --2- 172.21.15.2:0/1301766116 >> v2:172.21.15.66:3300/0 conn(0x7fba340cfd40 0x7fba3406c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 >> v1:172.21.15.66:6789/0 conn(0x7fba3409a080 legacy=0x7fba3406bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba340b37c0 con 0x7fba340b6b50 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7fba30001670 con 0x7fba340b6b50 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 >> v1:172.21.15.2:6789/0 conn(0x7fba340b6b50 legacy=0x7fba34099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba20003970 0x7fba20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba200047c0 0x7fba20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba20005180 0x7fba2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba340cd3a0 con 0x7fba20005180 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2000c030 con 0x7fba200047c0 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba2000c1f0 con 0x7fba20003970 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.712+0000 7fba39fa4640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba20005180 0x7fba2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.713+0000 7fba397a3640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba20003970 0x7fba20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.713+0000 7fba38fa2640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba200047c0 0x7fba20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.717 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.713+0000 7fba39fa4640 1 -- 172.21.15.2:0/1301766116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba20003970 msgr2=0x7fba20003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.713+0000 7fba39fa4640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba20003970 0x7fba20003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.713+0000 7fba39fa4640 1 -- 172.21.15.2:0/1301766116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba200047c0 msgr2=0x7fba20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.713+0000 7fba39fa4640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba200047c0 0x7fba20004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.713+0000 7fba39fa4640 1 -- 172.21.15.2:0/1301766116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20003520 con 0x7fba20005180 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.713+0000 7fba39fa4640 1 -- 172.21.15.2:0/1301766116 reap_dead start 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba39fa4640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba20005180 0x7fba2000b980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009fc0 tx=0x7fba200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f99fb05edf80a65 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c02cc60 con 0x7fba20005180 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c00f040 con 0x7fba20005180 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba2bfff640 1 -- 172.21.15.2:0/1301766116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c003990 con 0x7fba20005180 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba3ba07640 1 -- 172.21.15.2:0/1301766116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba20005180 msgr2=0x7fba2000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba3ba07640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba20005180 0x7fba2000b980 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fba2c009fc0 tx=0x7fba200057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba3ba07640 1 -- 172.21.15.2:0/1301766116 shutdown_connections 2023-11-25T04:09:04.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba3ba07640 1 --2- 172.21.15.2:0/1301766116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba20005180 0x7fba2000b980 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba3ba07640 1 -- 172.21.15.2:0/1301766116 >> 172.21.15.2:0/1301766116 conn(0x7fba340b2a70 msgr2=0x7fba340b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:04.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba3ba07640 1 -- 172.21.15.2:0/1301766116 shutdown_connections 2023-11-25T04:09:04.719 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.714+0000 7fba3ba07640 1 -- 172.21.15.2:0/1301766116 wait complete. 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.715+0000 7fba3ba07640 1 Processor -- start 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba3ba07640 1 -- start start 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba3ba07640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba20005180 0x7fba3406ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba3ba07640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba340b4da0 0x7fba341f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba3ba07640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba341f2720 0x7fba341f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba3ba07640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba340b3dd0 con 0x7fba340b4da0 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba3ba07640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba341f2ba0 con 0x7fba341f2720 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba3ba07640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba340b3fe0 con 0x7fba20005180 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba38fa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba340b4da0 0x7fba341f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba38fa2640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba340b4da0 0x7fba341f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35460/0 (socket says 172.21.15.2:35460) 2023-11-25T04:09:04.722 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.716+0000 7fba38fa2640 1 -- 172.21.15.2:0/2081180244 learned_addr learned my addr 172.21.15.2:0/2081180244 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba38fa2640 1 -- 172.21.15.2:0/2081180244 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba20005180 msgr2=0x7fba3406ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba38fa2640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba20005180 0x7fba3406ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba39fa4640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba341f2720 0x7fba341f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba38fa2640 1 -- 172.21.15.2:0/2081180244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba341f2720 msgr2=0x7fba341f6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba38fa2640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba341f2720 0x7fba341f6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba38fa2640 1 -- 172.21.15.2:0/2081180244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba340b42c0 con 0x7fba340b4da0 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba38fa2640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba340b4da0 0x7fba341f21e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba2400f5f0 tx=0x7fba2400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba29ffb640 1 -- 172.21.15.2:0/2081180244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba240052e0 con 0x7fba340b4da0 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba29ffb640 1 -- 172.21.15.2:0/2081180244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba24005440 con 0x7fba340b4da0 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba340b45a0 con 0x7fba340b4da0 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba29ffb640 1 -- 172.21.15.2:0/2081180244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24003810 con 0x7fba340b4da0 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.717+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba3406f270 con 0x7fba340b4da0 2023-11-25T04:09:04.723 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.718+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3404e920 con 0x7fba340b4da0 2023-11-25T04:09:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.719+0000 7fba29ffb640 1 -- 172.21.15.2:0/2081180244 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba24003970 con 0x7fba340b4da0 2023-11-25T04:09:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.719+0000 7fba29ffb640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fba1806ae70 0x7fba1806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.719+0000 7fba29ffb640 1 -- 172.21.15.2:0/2081180244 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba24089490 con 0x7fba340b4da0 2023-11-25T04:09:04.724 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.719+0000 7fba397a3640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fba1806ae70 0x7fba1806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.720+0000 7fba397a3640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fba1806ae70 0x7fba1806d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba30001c90 tx=0x7fba30001b20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:04.725 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.723+0000 7fba29ffb640 1 -- 172.21.15.2:0/2081180244 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba24054540 con 0x7fba340b4da0 2023-11-25T04:09:04.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.897+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba3406f430 con 0x7fba340b4da0 2023-11-25T04:09:04.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.898+0000 7fba29ffb640 1 -- 172.21.15.2:0/2081180244 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba24057b60 con 0x7fba340b4da0 2023-11-25T04:09:04.900 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:04.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fba1806ae70 msgr2=0x7fba1806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fba1806ae70 0x7fba1806d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fba30001c90 tx=0x7fba30001b20 comp rx=0 tx=0).stop 2023-11-25T04:09:04.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba340b4da0 msgr2=0x7fba341f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:04.902 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba340b4da0 0x7fba341f21e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fba2400f5f0 tx=0x7fba2400fab0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 shutdown_connections 2023-11-25T04:09:04.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fba1806ae70 0x7fba1806d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba341f2720 0x7fba341f6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba340b4da0 0x7fba341f21e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 --2- 172.21.15.2:0/2081180244 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba20005180 0x7fba3406ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:04.903 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 >> 172.21.15.2:0/2081180244 conn(0x7fba340b2a70 msgr2=0x7fba3406ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:04.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 shutdown_connections 2023-11-25T04:09:04.904 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:04.900+0000 7fba3ba07640 1 -- 172.21.15.2:0/2081180244 wait complete. 2023-11-25T04:09:04.912 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:05.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.020+0000 7f0a66390640 1 Processor -- start 2023-11-25T04:09:05.021 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.020+0000 7f0a66390640 1 -- start start 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a66390640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a600cc170 0x7f0a600cc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a66390640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a6015f2a0 0x7f0a6006a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a66390640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a600cf510 con 0x7f0a600ce0d0 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a66390640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a600ce990 con 0x7f0a600cc170 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a66390640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600cec70 con 0x7f0a6015f2a0 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a5ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a600cc170 0x7f0a600cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a5f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0a600ce0d0 0x7f0a6015eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50638/0 (socket says 172.21.15.2:50638) 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a5ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a600cc170 0x7f0a600cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35464/0 (socket says 172.21.15.2:35464) 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a5f7fe640 1 -- 172.21.15.2:0/3844469121 learned_addr learned my addr 172.21.15.2:0/3844469121 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a6492d640 1 --2- 172.21.15.2:0/3844469121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a6015f2a0 0x7f0a6006a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.023 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a5ffff640 1 -- 172.21.15.2:0/3844469121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a6015f2a0 msgr2=0x7f0a6006a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:05.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a5ffff640 1 --2- 172.21.15.2:0/3844469121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a6015f2a0 0x7f0a6006a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a5ffff640 1 -- 172.21.15.2:0/3844469121 >> v1:172.21.15.2:6789/0 conn(0x7f0a600ce0d0 legacy=0x7f0a6015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a5ffff640 1 -- 172.21.15.2:0/3844469121 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a600cef50 con 0x7f0a600cc170 2023-11-25T04:09:05.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.021+0000 7f0a5effd640 1 -- 172.21.15.2:0/3844469121 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305544887 0 0) 0x7f0a600cf510 con 0x7f0a600ce0d0 2023-11-25T04:09:05.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.022+0000 7f0a5ffff640 1 --2- 172.21.15.2:0/3844469121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a600cc170 0x7f0a600cc550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0a540097a0 tx=0x7f0a5402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4471de0a0d8ca6f server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:05.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.022+0000 7f0a5effd640 1 -- 172.21.15.2:0/3844469121 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54031830 con 0x7f0a600cc170 2023-11-25T04:09:05.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.022+0000 7f0a5effd640 1 -- 172.21.15.2:0/3844469121 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a54031990 con 0x7f0a600cc170 2023-11-25T04:09:05.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.022+0000 7f0a5effd640 1 -- 172.21.15.2:0/3844469121 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54031d20 con 0x7f0a600cc170 2023-11-25T04:09:05.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.023+0000 7f0a66390640 1 -- 172.21.15.2:0/3844469121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a600cc170 msgr2=0x7f0a600cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.023+0000 7f0a66390640 1 --2- 172.21.15.2:0/3844469121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a600cc170 0x7f0a600cc550 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0a540097a0 tx=0x7f0a5402b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.023+0000 7f0a66390640 1 -- 172.21.15.2:0/3844469121 shutdown_connections 2023-11-25T04:09:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.023+0000 7f0a66390640 1 --2- 172.21.15.2:0/3844469121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a6015f2a0 0x7f0a6006a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.023+0000 7f0a66390640 1 --2- 172.21.15.2:0/3844469121 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a600cc170 0x7f0a600cc550 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.023+0000 7f0a66390640 1 -- 172.21.15.2:0/3844469121 >> 172.21.15.2:0/3844469121 conn(0x7f0a600b1670 msgr2=0x7f0a600b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.023+0000 7f0a66390640 1 -- 172.21.15.2:0/3844469121 shutdown_connections 2023-11-25T04:09:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.023+0000 7f0a66390640 1 -- 172.21.15.2:0/3844469121 wait complete. 2023-11-25T04:09:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.024+0000 7f0a66390640 1 Processor -- start 2023-11-25T04:09:05.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.024+0000 7f0a66390640 1 -- start start 2023-11-25T04:09:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a66390640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600cc170 0x7f0a6013cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a66390640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600ce0d0 0x7f0a60159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a66390640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a6015f2a0 0x7f0a60159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a66390640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a6013d440 con 0x7f0a6015f2a0 2023-11-25T04:09:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a66390640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a60157720 con 0x7f0a600ce0d0 2023-11-25T04:09:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a66390640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a60157a00 con 0x7f0a600cc170 2023-11-25T04:09:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a6492d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a6015f2a0 0x7f0a60159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.031 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a6492d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a6015f2a0 0x7f0a60159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35474/0 (socket says 172.21.15.2:35474) 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a6492d640 1 -- 172.21.15.2:0/3334664003 learned_addr learned my addr 172.21.15.2:0/3334664003 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a5ffff640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600cc170 0x7f0a6013cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a5f7fe640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600ce0d0 0x7f0a60159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a6492d640 1 -- 172.21.15.2:0/3334664003 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600cc170 msgr2=0x7f0a6013cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a6492d640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600cc170 0x7f0a6013cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a6492d640 1 -- 172.21.15.2:0/3334664003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600ce0d0 msgr2=0x7f0a60159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a6492d640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600ce0d0 0x7f0a60159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.025+0000 7f0a6492d640 1 -- 172.21.15.2:0/3334664003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54009400 con 0x7f0a6015f2a0 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.026+0000 7f0a6492d640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a6015f2a0 0x7f0a60159750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800efc0 tx=0x7f0a5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:05.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.026+0000 7f0a5cff9640 1 -- 172.21.15.2:0/3334664003 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58009b20 con 0x7f0a6015f2a0 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.026+0000 7f0a5cff9640 1 -- 172.21.15.2:0/3334664003 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5800f040 con 0x7f0a6015f2a0 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.026+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a60157ce0 con 0x7f0a6015f2a0 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.026+0000 7f0a5cff9640 1 -- 172.21.15.2:0/3334664003 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580146c0 con 0x7f0a6015f2a0 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.026+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a601582a0 con 0x7f0a6015f2a0 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.027+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6006d200 con 0x7f0a6015f2a0 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.027+0000 7f0a5cff9640 1 -- 172.21.15.2:0/3334664003 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a58014820 con 0x7f0a6015f2a0 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.028+0000 7f0a5cff9640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a4c06ae40 0x7f0a4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.028+0000 7f0a5cff9640 1 -- 172.21.15.2:0/3334664003 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a5808a330 con 0x7f0a6015f2a0 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.028+0000 7f0a5ffff640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a4c06ae40 0x7f0a4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.028+0000 7f0a5ffff640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a4c06ae40 0x7f0a4c06d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0a54036000 tx=0x7f0a5403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:05.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.032+0000 7f0a5cff9640 1 -- 172.21.15.2:0/3334664003 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a6006d200 con 0x7f0a6015f2a0 2023-11-25T04:09:05.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.206+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a6006d200 con 0x7f0a6015f2a0 2023-11-25T04:09:05.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.207+0000 7f0a5cff9640 1 -- 172.21.15.2:0/3334664003 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a6006d200 con 0x7f0a6015f2a0 2023-11-25T04:09:05.208 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:05.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a4c06ae40 msgr2=0x7f0a4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a4c06ae40 0x7f0a4c06d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0a54036000 tx=0x7f0a5403c040 comp rx=0 tx=0).stop 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a6015f2a0 msgr2=0x7f0a60159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a6015f2a0 0x7f0a60159750 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800efc0 tx=0x7f0a5800c490 comp rx=0 tx=0).stop 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 shutdown_connections 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a6015f2a0 0x7f0a60159750 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a4c06ae40 0x7f0a4c06d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600ce0d0 0x7f0a60159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 --2- 172.21.15.2:0/3334664003 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600cc170 0x7f0a6013cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.208+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 >> 172.21.15.2:0/3334664003 conn(0x7f0a600b1670 msgr2=0x7f0a6015b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.209+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 shutdown_connections 2023-11-25T04:09:05.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.209+0000 7f0a66390640 1 -- 172.21.15.2:0/3334664003 wait complete. 2023-11-25T04:09:05.220 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:05.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.329+0000 7f9e49656640 1 Processor -- start 2023-11-25T04:09:05.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.330+0000 7f9e49656640 1 -- start start 2023-11-25T04:09:05.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.330+0000 7f9e49656640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e4415b0d0 0x7f9e440cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.330+0000 7f9e49656640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9e44070630 0x7f9e44070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.330+0000 7f9e49656640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4415b530 con 0x7f9e4413f750 2023-11-25T04:09:05.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.330+0000 7f9e49656640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e440cec70 con 0x7f9e44070630 2023-11-25T04:09:05.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.330+0000 7f9e49656640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440ce060 con 0x7f9e4415b0d0 2023-11-25T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.331+0000 7f9e437fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9e44070630 0x7f9e44070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.331+0000 7f9e427fc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e4415b0d0 0x7f9e440cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.331+0000 7f9e437fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9e44070630 0x7f9e44070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:60716/0 (socket says 172.21.15.2:60716) 2023-11-25T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.331+0000 7f9e437fe640 1 -- 172.21.15.2:0/2702582460 learned_addr learned my addr 172.21.15.2:0/2702582460 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.331+0000 7f9e437fe640 1 -- 172.21.15.2:0/2702582460 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e4415b0d0 msgr2=0x7f9e440cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.331+0000 7f9e437fe640 1 --2- 172.21.15.2:0/2702582460 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e4415b0d0 0x7f9e440cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.331+0000 7f9e437fe640 1 -- 172.21.15.2:0/2702582460 >> v1:172.21.15.66:6789/0 conn(0x7f9e4413f750 legacy=0x7f9e4413fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.331+0000 7f9e437fe640 1 -- 172.21.15.2:0/2702582460 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440ce340 con 0x7f9e44070630 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.331+0000 7f9e41ffb640 1 -- 172.21.15.2:0/2702582460 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745992262 0 0) 0x7f9e4415b530 con 0x7f9e4413f750 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.332+0000 7f9e437fe640 1 --2- 172.21.15.2:0/2702582460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e44070630 0x7f9e44070ac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00d150 tx=0x7f9e3c02e160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b852b8409c350e67 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.332+0000 7f9e41ffb640 1 -- 172.21.15.2:0/2702582460 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00b0d0 con 0x7f9e44070630 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.332+0000 7f9e41ffb640 1 -- 172.21.15.2:0/2702582460 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c00b230 con 0x7f9e44070630 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.332+0000 7f9e41ffb640 1 -- 172.21.15.2:0/2702582460 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c009600 con 0x7f9e44070630 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.333+0000 7f9e49656640 1 -- 172.21.15.2:0/2702582460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e44070630 msgr2=0x7f9e44070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.333+0000 7f9e49656640 1 --2- 172.21.15.2:0/2702582460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e44070630 0x7f9e44070ac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00d150 tx=0x7f9e3c02e160 comp rx=0 tx=0).stop 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.333+0000 7f9e49656640 1 -- 172.21.15.2:0/2702582460 shutdown_connections 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.333+0000 7f9e49656640 1 --2- 172.21.15.2:0/2702582460 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e44070630 0x7f9e44070ac0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.333+0000 7f9e49656640 1 --2- 172.21.15.2:0/2702582460 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e4415b0d0 0x7f9e440cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.333+0000 7f9e49656640 1 -- 172.21.15.2:0/2702582460 >> 172.21.15.2:0/2702582460 conn(0x7f9e4406a8f0 msgr2=0x7f9e4406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.333+0000 7f9e49656640 1 -- 172.21.15.2:0/2702582460 shutdown_connections 2023-11-25T04:09:05.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.333+0000 7f9e49656640 1 -- 172.21.15.2:0/2702582460 wait complete. 2023-11-25T04:09:05.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.334+0000 7f9e49656640 1 Processor -- start 2023-11-25T04:09:05.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.334+0000 7f9e49656640 1 -- start start 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e49656640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e44070630 0x7f9e4413c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e49656640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4413f750 0x7f9e440b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e49656640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e4415b0d0 0x7f9e44154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e49656640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441f1340 con 0x7f9e4413f750 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e49656640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4413cc20 con 0x7f9e4415b0d0 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e49656640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441f06c0 con 0x7f9e44070630 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e427fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4413f750 0x7f9e440b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e427fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4413f750 0x7f9e440b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35482/0 (socket says 172.21.15.2:35482) 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e427fc640 1 -- 172.21.15.2:0/1643065412 learned_addr learned my addr 172.21.15.2:0/1643065412 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e42ffd640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e44070630 0x7f9e4413c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e437fe640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e4415b0d0 0x7f9e44154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e427fc640 1 -- 172.21.15.2:0/1643065412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e44070630 msgr2=0x7f9e4413c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e427fc640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e44070630 0x7f9e4413c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e427fc640 1 -- 172.21.15.2:0/1643065412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e4415b0d0 msgr2=0x7f9e44154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e427fc640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e4415b0d0 0x7f9e44154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e427fc640 1 -- 172.21.15.2:0/1643065412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c00bd40 con 0x7f9e4413f750 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.335+0000 7f9e427fc640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4413f750 0x7f9e440b05c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800e9b0 tx=0x7f9e3800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.336+0000 7f9e2b7fe640 1 -- 172.21.15.2:0/1643065412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38009670 con 0x7f9e4413f750 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.336+0000 7f9e2b7fe640 1 -- 172.21.15.2:0/1643065412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3800c9a0 con 0x7f9e4413f750 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.336+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e441f09a0 con 0x7f9e4413f750 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.336+0000 7f9e2b7fe640 1 -- 172.21.15.2:0/1643065412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3800cd50 con 0x7f9e4413f750 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.336+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e441f0f60 con 0x7f9e4413f750 2023-11-25T04:09:05.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.337+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e441f1480 con 0x7f9e4413f750 2023-11-25T04:09:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.337+0000 7f9e2b7fe640 1 -- 172.21.15.2:0/1643065412 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e38013470 con 0x7f9e4413f750 2023-11-25T04:09:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.337+0000 7f9e2b7fe640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9e3006ae40 0x7f9e3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.338+0000 7f9e2b7fe640 1 -- 172.21.15.2:0/1643065412 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e38089820 con 0x7f9e4413f750 2023-11-25T04:09:05.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.338+0000 7f9e42ffd640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9e3006ae40 0x7f9e3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.338+0000 7f9e42ffd640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9e3006ae40 0x7f9e3006d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000f60 tx=0x7f9e34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:05.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.342+0000 7f9e2b7fe640 1 -- 172.21.15.2:0/1643065412 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e441f1480 con 0x7f9e4413f750 2023-11-25T04:09:05.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.518+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e441f1480 con 0x7f9e4413f750 2023-11-25T04:09:05.519 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.518+0000 7f9e2b7fe640 1 -- 172.21.15.2:0/1643065412 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e441f1480 con 0x7f9e4413f750 2023-11-25T04:09:05.519 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:05.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9e3006ae40 msgr2=0x7f9e3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9e3006ae40 0x7f9e3006d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000f60 tx=0x7f9e34009040 comp rx=0 tx=0).stop 2023-11-25T04:09:05.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4413f750 msgr2=0x7f9e440b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4413f750 0x7f9e440b05c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9e3800e9b0 tx=0x7f9e3800ee70 comp rx=0 tx=0).stop 2023-11-25T04:09:05.521 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 shutdown_connections 2023-11-25T04:09:05.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9e3006ae40 0x7f9e3006d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e4415b0d0 0x7f9e44154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9e4413f750 0x7f9e440b05c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 --2- 172.21.15.2:0/1643065412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e44070630 0x7f9e4413c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 >> 172.21.15.2:0/1643065412 conn(0x7f9e4406a8f0 msgr2=0x7f9e4413d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:05.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 shutdown_connections 2023-11-25T04:09:05.522 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.520+0000 7f9e49656640 1 -- 172.21.15.2:0/1643065412 wait complete. 2023-11-25T04:09:05.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-25T04:09:05.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.638+0000 7f65ae60e640 1 Processor -- start 2023-11-25T04:09:05.639 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.638+0000 7f65ae60e640 1 -- start start 2023-11-25T04:09:05.640 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65ae60e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a8142d20 0x7f65a8071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65ae60e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65a806dc30 0x7f65a80cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65ae60e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a80b3130 con 0x7f65a80b1df0 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65ae60e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a8143100 con 0x7f65a806dc30 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65ae60e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80b2250 con 0x7f65a8142d20 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65acbab640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65a806dc30 0x7f65a80cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65a77fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f65a80b1df0 0x7f65a806d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50640/0 (socket says 172.21.15.2:50640) 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65a77fe640 1 -- 172.21.15.2:0/2988304474 learned_addr learned my addr 172.21.15.2:0/2988304474 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65a7fff640 1 --2- 172.21.15.2:0/2988304474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a8142d20 0x7f65a8071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65acbab640 1 -- 172.21.15.2:0/2988304474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a8142d20 msgr2=0x7f65a8071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65acbab640 1 --2- 172.21.15.2:0/2988304474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a8142d20 0x7f65a8071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.641 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.639+0000 7f65acbab640 1 -- 172.21.15.2:0/2988304474 >> v1:172.21.15.2:6789/0 conn(0x7f65a80b1df0 legacy=0x7f65a806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.640+0000 7f65acbab640 1 -- 172.21.15.2:0/2988304474 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80b2520 con 0x7f65a806dc30 2023-11-25T04:09:05.642 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.640+0000 7f65a6ffd640 1 -- 172.21.15.2:0/2988304474 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016601839 0 0) 0x7f65a80b3130 con 0x7f65a80b1df0 2023-11-25T04:09:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.640+0000 7f65acbab640 1 --2- 172.21.15.2:0/2988304474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a806dc30 0x7f65a80cc610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009d90 tx=0x7f65a002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b7017ff6aebe34 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.640+0000 7f65a6ffd640 1 -- 172.21.15.2:0/2988304474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a002cc50 con 0x7f65a806dc30 2023-11-25T04:09:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.640+0000 7f65a6ffd640 1 -- 172.21.15.2:0/2988304474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a002cdb0 con 0x7f65a806dc30 2023-11-25T04:09:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.640+0000 7f65a6ffd640 1 -- 172.21.15.2:0/2988304474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a0034660 con 0x7f65a806dc30 2023-11-25T04:09:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.641+0000 7f65ae60e640 1 -- 172.21.15.2:0/2988304474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a806dc30 msgr2=0x7f65a80cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.643 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.641+0000 7f65ae60e640 1 --2- 172.21.15.2:0/2988304474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a806dc30 0x7f65a80cc610 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f65a0009d90 tx=0x7f65a002bea0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.641+0000 7f65ae60e640 1 -- 172.21.15.2:0/2988304474 shutdown_connections 2023-11-25T04:09:05.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.641+0000 7f65ae60e640 1 --2- 172.21.15.2:0/2988304474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a806dc30 0x7f65a80cc610 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.641+0000 7f65ae60e640 1 --2- 172.21.15.2:0/2988304474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a8142d20 0x7f65a8071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.641+0000 7f65ae60e640 1 -- 172.21.15.2:0/2988304474 >> 172.21.15.2:0/2988304474 conn(0x7f65a80b0af0 msgr2=0x7f65a80b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:05.645 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.641+0000 7f65ae60e640 1 -- 172.21.15.2:0/2988304474 shutdown_connections 2023-11-25T04:09:05.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.641+0000 7f65ae60e640 1 -- 172.21.15.2:0/2988304474 wait complete. 2023-11-25T04:09:05.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.642+0000 7f65ae60e640 1 Processor -- start 2023-11-25T04:09:05.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.643+0000 7f65ae60e640 1 -- start start 2023-11-25T04:09:05.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.643+0000 7f65ae60e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a806dc30 0x7f65a81599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.650 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.643+0000 7f65ae60e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a80b1df0 0x7f65a80cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.643+0000 7f65ae60e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a8142d20 0x7f65a80c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.643+0000 7f65ae60e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80c9370 con 0x7f65a80b1df0 2023-11-25T04:09:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.643+0000 7f65ae60e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a815c200 con 0x7f65a8142d20 2023-11-25T04:09:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.643+0000 7f65ae60e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a815bf20 con 0x7f65a806dc30 2023-11-25T04:09:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a80b1df0 0x7f65a80cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.651 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a80b1df0 0x7f65a80cd1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35504/0 (socket says 172.21.15.2:35504) 2023-11-25T04:09:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a77fe640 1 -- 172.21.15.2:0/3445405672 learned_addr learned my addr 172.21.15.2:0/3445405672 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a7fff640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a806dc30 0x7f65a81599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65acbab640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a8142d20 0x7f65a80c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a77fe640 1 -- 172.21.15.2:0/3445405672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a806dc30 msgr2=0x7f65a81599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a77fe640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a806dc30 0x7f65a81599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a77fe640 1 -- 172.21.15.2:0/3445405672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a8142d20 msgr2=0x7f65a80c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:05.652 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a77fe640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a8142d20 0x7f65a80c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a77fe640 1 -- 172.21.15.2:0/3445405672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a0009a70 con 0x7f65a80b1df0 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a77fe640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a80b1df0 0x7f65a80cd1f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f659c00c4d0 tx=0x7f659c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a4ff9640 1 -- 172.21.15.2:0/3445405672 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c0074e0 con 0x7f65a80b1df0 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a4ff9640 1 -- 172.21.15.2:0/3445405672 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c007660 con 0x7f65a80b1df0 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a80c8cb0 con 0x7f65a80b1df0 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65a4ff9640 1 -- 172.21.15.2:0/3445405672 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c004a20 con 0x7f65a80b1df0 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.644+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a80ce1d0 con 0x7f65a80b1df0 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.646+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a80c94b0 con 0x7f65a80b1df0 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.646+0000 7f65a4ff9640 1 -- 172.21.15.2:0/3445405672 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f659c004b80 con 0x7f65a80b1df0 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.646+0000 7f65a4ff9640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f659406ae40 0x7f659406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:05.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.646+0000 7f65a7fff640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f659406ae40 0x7f659406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:05.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.646+0000 7f65a4ff9640 1 -- 172.21.15.2:0/3445405672 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f659c0886a0 con 0x7f65a80b1df0 2023-11-25T04:09:05.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.647+0000 7f65a7fff640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f659406ae40 0x7f659406d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65980079a0 tx=0x7f6598008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:05.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.651+0000 7f65a4ff9640 1 -- 172.21.15.2:0/3445405672 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65a80c94b0 con 0x7f65a80b1df0 2023-11-25T04:09:05.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:05.895+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f65a80c94b0 con 0x7f65a80b1df0 2023-11-25T04:09:06.268 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.267+0000 7f65a4ff9640 1 -- 172.21.15.2:0/3445405672 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v54) v1 ==== 147+0+0 (secure 0 0 0) 0x7f65a80c94b0 con 0x7f65a80b1df0 2023-11-25T04:09:06.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f659406ae40 msgr2=0x7f659406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f659406ae40 0x7f659406d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65980079a0 tx=0x7f6598008040 comp rx=0 tx=0).stop 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a80b1df0 msgr2=0x7f65a80cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a80b1df0 0x7f65a80cd1f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f659c00c4d0 tx=0x7f659c00c990 comp rx=0 tx=0).stop 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 shutdown_connections 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f659406ae40 0x7f659406d300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a8142d20 0x7f65a80c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65a80b1df0 0x7f65a80cd1f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 --2- 172.21.15.2:0/3445405672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a806dc30 0x7f65a81599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.269+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 >> 172.21.15.2:0/3445405672 conn(0x7f65a80b0af0 msgr2=0x7f65a80702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.270+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 shutdown_connections 2023-11-25T04:09:06.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.270+0000 7f65ae60e640 1 -- 172.21.15.2:0/3445405672 wait complete. 2023-11-25T04:09:06.283 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-25T04:09:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.394+0000 7f2de43a9640 1 Processor -- start 2023-11-25T04:09:06.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.394+0000 7f2de43a9640 1 -- start start 2023-11-25T04:09:06.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de43a9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ddc15eb80 0x7f2ddc0cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de43a9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 0x7f2ddc0ae430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de43a9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc06ae00 con 0x7f2ddc15c750 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de43a9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc0cf3a0 con 0x7f2ddc15eb80 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de43a9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc06a4d0 con 0x7f2ddc15ef60 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de2145640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ddc15eb80 0x7f2ddc0cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de2145640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ddc15eb80 0x7f2ddc0cc7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35510/0 (socket says 172.21.15.2:35510) 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de2145640 1 -- 172.21.15.2:0/1104186058 learned_addr learned my addr 172.21.15.2:0/1104186058 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de2946640 1 --2- 172.21.15.2:0/1104186058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 0x7f2ddc0ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de2145640 1 -- 172.21.15.2:0/1104186058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 msgr2=0x7f2ddc0ae430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de2145640 1 --2- 172.21.15.2:0/1104186058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 0x7f2ddc0ae430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de2145640 1 -- 172.21.15.2:0/1104186058 >> v1:172.21.15.66:6789/0 conn(0x7f2ddc15c750 legacy=0x7f2ddc0cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:06.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.395+0000 7f2de2145640 1 -- 172.21.15.2:0/1104186058 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc06a7b0 con 0x7f2ddc15eb80 2023-11-25T04:09:06.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.396+0000 7f2de2145640 1 --2- 172.21.15.2:0/1104186058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 0x7f2ddc0cc7f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009870 tx=0x7f2dd802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4605e52741f880b2 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:06.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.396+0000 7f2de1143640 1 -- 172.21.15.2:0/1104186058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8030840 con 0x7f2ddc15eb80 2023-11-25T04:09:06.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.396+0000 7f2de1143640 1 -- 172.21.15.2:0/1104186058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd80309a0 con 0x7f2ddc15eb80 2023-11-25T04:09:06.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.396+0000 7f2de1143640 1 -- 172.21.15.2:0/1104186058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8030d30 con 0x7f2ddc15eb80 2023-11-25T04:09:06.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.397+0000 7f2de43a9640 1 -- 172.21.15.2:0/1104186058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 msgr2=0x7f2ddc0cc7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.397+0000 7f2de43a9640 1 --2- 172.21.15.2:0/1104186058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 0x7f2ddc0cc7f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009870 tx=0x7f2dd802b980 comp rx=0 tx=0).stop 2023-11-25T04:09:06.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.397+0000 7f2de43a9640 1 -- 172.21.15.2:0/1104186058 shutdown_connections 2023-11-25T04:09:06.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.397+0000 7f2de43a9640 1 --2- 172.21.15.2:0/1104186058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 0x7f2ddc0ae430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.397+0000 7f2de43a9640 1 --2- 172.21.15.2:0/1104186058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 0x7f2ddc0cc7f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.397+0000 7f2de43a9640 1 -- 172.21.15.2:0/1104186058 >> 172.21.15.2:0/1104186058 conn(0x7f2ddc0b1670 msgr2=0x7f2ddc0b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:06.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.397+0000 7f2de43a9640 1 -- 172.21.15.2:0/1104186058 shutdown_connections 2023-11-25T04:09:06.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.397+0000 7f2de43a9640 1 -- 172.21.15.2:0/1104186058 wait complete. 2023-11-25T04:09:06.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.398+0000 7f2de43a9640 1 Processor -- start 2023-11-25T04:09:06.400 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.398+0000 7f2de43a9640 1 -- start start 2023-11-25T04:09:06.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de43a9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc15c750 0x7f2ddc155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de43a9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 0x7f2ddc1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de43a9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 0x7f2ddc143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de43a9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc1f0d30 con 0x7f2ddc15eb80 2023-11-25T04:09:06.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de43a9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0ac7e0 con 0x7f2ddc15c750 2023-11-25T04:09:06.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de43a9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc144450 con 0x7f2ddc15ef60 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de1944640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 0x7f2ddc1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de1944640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 0x7f2ddc1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35512/0 (socket says 172.21.15.2:35512) 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de1944640 1 -- 172.21.15.2:0/634548055 learned_addr learned my addr 172.21.15.2:0/634548055 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de2946640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 0x7f2ddc143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de2145640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc15c750 0x7f2ddc155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de1944640 1 -- 172.21.15.2:0/634548055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 msgr2=0x7f2ddc143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de1944640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 0x7f2ddc143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de1944640 1 -- 172.21.15.2:0/634548055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc15c750 msgr2=0x7f2ddc155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de1944640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc15c750 0x7f2ddc155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.399+0000 7f2de1944640 1 -- 172.21.15.2:0/634548055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80094d0 con 0x7f2ddc15eb80 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.400+0000 7f2de1944640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 0x7f2ddc1585f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c400 tx=0x7f2dcc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:06.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.400+0000 7f2dd2ffd640 1 -- 172.21.15.2:0/634548055 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc0052d0 con 0x7f2ddc15eb80 2023-11-25T04:09:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.400+0000 7f2dd2ffd640 1 -- 172.21.15.2:0/634548055 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc005430 con 0x7f2ddc15eb80 2023-11-25T04:09:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.400+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc0ad040 con 0x7f2ddc15eb80 2023-11-25T04:09:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.400+0000 7f2dd2ffd640 1 -- 172.21.15.2:0/634548055 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc003830 con 0x7f2ddc15eb80 2023-11-25T04:09:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.400+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc0ac9f0 con 0x7f2ddc15eb80 2023-11-25T04:09:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.401+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc0ad1d0 con 0x7f2ddc15eb80 2023-11-25T04:09:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.401+0000 7f2dd2ffd640 1 -- 172.21.15.2:0/634548055 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2dcc003990 con 0x7f2ddc15eb80 2023-11-25T04:09:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.402+0000 7f2dd2ffd640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2dc006ae70 0x7f2dc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.402+0000 7f2de2145640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2dc006ae70 0x7f2dc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.402+0000 7f2dd2ffd640 1 -- 172.21.15.2:0/634548055 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dcc088a90 con 0x7f2ddc15eb80 2023-11-25T04:09:06.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.402+0000 7f2de2145640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2dc006ae70 0x7f2dc006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8036000 tx=0x7f2dd8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:06.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.406+0000 7f2dd2ffd640 1 -- 172.21.15.2:0/634548055 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2dcc053be0 con 0x7f2ddc15eb80 2023-11-25T04:09:06.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:09:06.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:09:06.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.584+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2ddc072720 con 0x7f2ddc15eb80 2023-11-25T04:09:06.588 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.587+0000 7f2dd2ffd640 1 -- 172.21.15.2:0/634548055 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2dcc057200 con 0x7f2ddc15eb80 2023-11-25T04:09:06.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2dc006ae70 msgr2=0x7f2dc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2dc006ae70 0x7f2dc006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8036000 tx=0x7f2dd8008030 comp rx=0 tx=0).stop 2023-11-25T04:09:06.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 msgr2=0x7f2ddc1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 0x7f2ddc1585f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c400 tx=0x7f2dcc00c8c0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 shutdown_connections 2023-11-25T04:09:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc15ef60 0x7f2ddc143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ddc15eb80 0x7f2ddc1585f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2dc006ae70 0x7f2dc006d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 --2- 172.21.15.2:0/634548055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc15c750 0x7f2ddc155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 >> 172.21.15.2:0/634548055 conn(0x7f2ddc0b1670 msgr2=0x7f2ddc15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:06.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 shutdown_connections 2023-11-25T04:09:06.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.589+0000 7f2de43a9640 1 -- 172.21.15.2:0/634548055 wait complete. 2023-11-25T04:09:06.601 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-25T04:09:06.601 DEBUG:teuthology.orchestra.run.smithi002:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-25T04:09:06.653 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-25T04:09:06.705 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-25T04:09:06.706 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:09:06.706 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:06.724 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:09:06.724 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:06.782 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:06.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.927+0000 7fd1b091d640 1 Processor -- start 2023-11-25T04:09:06.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.927+0000 7fd1b091d640 1 -- start start 2023-11-25T04:09:06.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1b091d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0d1720 0x7fd1ac0d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1b091d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1ac0b3db0 0x7fd1ac0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1b091d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1ac0b5f90 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1b091d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1ac0d20a0 con 0x7fd1ac0b3db0 2023-11-25T04:09:06.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1b091d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0b61e0 con 0x7fd1ac0d1720 2023-11-25T04:09:06.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1aad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1ac0b3db0 0x7fd1ac0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1aad9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd1ac0b3db0 0x7fd1ac0b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35522/0 (socket says 172.21.15.2:35522) 2023-11-25T04:09:06.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1aad9d640 1 -- 172.21.15.2:0/2710423248 learned_addr learned my addr 172.21.15.2:0/2710423248 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:06.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1aad9d640 1 -- 172.21.15.2:0/2710423248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0d1720 msgr2=0x7fd1ac0d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:06.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1a9d9b640 1 --2- 172.21.15.2:0/2710423248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0d1720 0x7fd1ac0d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1aad9d640 1 --2- 172.21.15.2:0/2710423248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0d1720 0x7fd1ac0d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1aad9d640 1 -- 172.21.15.2:0/2710423248 >> v1:172.21.15.66:6789/0 conn(0x7fd1ac15d3e0 legacy=0x7fd1ac0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:06.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1aad9d640 1 -- 172.21.15.2:0/2710423248 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac0b64c0 con 0x7fd1ac0b3db0 2023-11-25T04:09:06.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.928+0000 7fd1a9d9b640 1 --2- 172.21.15.2:0/2710423248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0d1720 0x7fd1ac0d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:06.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.929+0000 7fd1aad9d640 1 --2- 172.21.15.2:0/2710423248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b3db0 0x7fd1ac0b4240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009e50 tx=0x7fd1a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0354985742460f server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:06.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.929+0000 7fd1a959a640 1 -- 172.21.15.2:0/2710423248 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a402ca70 con 0x7fd1ac0b3db0 2023-11-25T04:09:06.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.929+0000 7fd1a959a640 1 -- 172.21.15.2:0/2710423248 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a402cbd0 con 0x7fd1ac0b3db0 2023-11-25T04:09:06.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.929+0000 7fd1a959a640 1 -- 172.21.15.2:0/2710423248 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40343f0 con 0x7fd1ac0b3db0 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.930+0000 7fd1b091d640 1 -- 172.21.15.2:0/2710423248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b3db0 msgr2=0x7fd1ac0b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.930+0000 7fd1b091d640 1 --2- 172.21.15.2:0/2710423248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b3db0 0x7fd1ac0b4240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009e50 tx=0x7fd1a402bed0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.930+0000 7fd1b091d640 1 -- 172.21.15.2:0/2710423248 shutdown_connections 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.930+0000 7fd1b091d640 1 --2- 172.21.15.2:0/2710423248 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac0b3db0 0x7fd1ac0b4240 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.930+0000 7fd1b091d640 1 --2- 172.21.15.2:0/2710423248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0d1720 0x7fd1ac0d1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.930+0000 7fd1b091d640 1 -- 172.21.15.2:0/2710423248 >> 172.21.15.2:0/2710423248 conn(0x7fd1ac09c480 msgr2=0x7fd1ac0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.930+0000 7fd1b091d640 1 -- 172.21.15.2:0/2710423248 shutdown_connections 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.930+0000 7fd1b091d640 1 -- 172.21.15.2:0/2710423248 wait complete. 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.931+0000 7fd1b091d640 1 Processor -- start 2023-11-25T04:09:06.938 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.931+0000 7fd1b091d640 1 -- start start 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1b091d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0b3db0 0x7fd1ac151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1b091d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1ac0d1720 0x7fd1ac1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1b091d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac15d3e0 0x7fd1ac0cc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1b091d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ca210 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1b091d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ca4f0 con 0x7fd1ac0d1720 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1b091d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1ac0ca7d0 con 0x7fd1ac0b3db0 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac15d3e0 0x7fd1ac0cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac15d3e0 0x7fd1ac0cc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35534/0 (socket says 172.21.15.2:35534) 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aad9d640 1 -- 172.21.15.2:0/597623025 learned_addr learned my addr 172.21.15.2:0/597623025 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1a9d9b640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1ac0d1720 0x7fd1ac1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aa59c640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0b3db0 0x7fd1ac151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aad9d640 1 -- 172.21.15.2:0/597623025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0b3db0 msgr2=0x7fd1ac151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aad9d640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0b3db0 0x7fd1ac151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aad9d640 1 -- 172.21.15.2:0/597623025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1ac0d1720 msgr2=0x7fd1ac1525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aad9d640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1ac0d1720 0x7fd1ac1525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aad9d640 1 -- 172.21.15.2:0/597623025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a4009b30 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.932+0000 7fd1aad9d640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac15d3e0 0x7fd1ac0cc820 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009e50 tx=0x7fd1a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.933+0000 7fd19affd640 1 -- 172.21.15.2:0/597623025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4009510 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.933+0000 7fd19affd640 1 -- 172.21.15.2:0/597623025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a403e450 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.933+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1ac0caab0 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.933+0000 7fd19affd640 1 -- 172.21.15.2:0/597623025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a403e800 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.933+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1ac15e690 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.934+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1ac0cafd0 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.934+0000 7fd19affd640 1 -- 172.21.15.2:0/597623025 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd1a403e960 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.934+0000 7fd19affd640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd18c06ae40 0x7fd18c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:06.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.935+0000 7fd19affd640 1 -- 172.21.15.2:0/597623025 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1a40ac3d0 con 0x7fd1ac15d3e0 2023-11-25T04:09:06.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.935+0000 7fd1aa59c640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd18c06ae40 0x7fd18c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:06.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.935+0000 7fd1aa59c640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd18c06ae40 0x7fd18c06d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd19c006fd0 tx=0x7fd19c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:06.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:06.939+0000 7fd19affd640 1 -- 172.21.15.2:0/597623025 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd1ac0cafd0 con 0x7fd1ac15d3e0 2023-11-25T04:09:07.115 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.115+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1ac0cafd0 con 0x7fd1ac15d3e0 2023-11-25T04:09:07.117 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.116+0000 7fd19affd640 1 -- 172.21.15.2:0/597623025 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fd1ac0cafd0 con 0x7fd1ac15d3e0 2023-11-25T04:09:07.117 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:07.117 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.117+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd18c06ae40 msgr2=0x7fd18c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.117+0000 7fd1b091d640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd18c06ae40 0x7fd18c06d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd19c006fd0 tx=0x7fd19c008040 comp rx=0 tx=0).stop 2023-11-25T04:09:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.117+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac15d3e0 msgr2=0x7fd1ac0cc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.117+0000 7fd1b091d640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac15d3e0 0x7fd1ac0cc820 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4009e50 tx=0x7fd1a4004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.118+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 shutdown_connections 2023-11-25T04:09:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.118+0000 7fd1b091d640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd1ac15d3e0 0x7fd1ac0cc820 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.118+0000 7fd1b091d640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd18c06ae40 0x7fd18c06d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.118+0000 7fd1b091d640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1ac0d1720 0x7fd1ac1525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.118+0000 7fd1b091d640 1 --2- 172.21.15.2:0/597623025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1ac0b3db0 0x7fd1ac151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.118+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 >> 172.21.15.2:0/597623025 conn(0x7fd1ac09c480 msgr2=0x7fd1ac0d3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.118+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 shutdown_connections 2023-11-25T04:09:07.120 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.118+0000 7fd1b091d640 1 -- 172.21.15.2:0/597623025 wait complete. 2023-11-25T04:09:07.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:07.130 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.239+0000 7f699e67c640 1 Processor -- start 2023-11-25T04:09:07.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.239+0000 7f699e67c640 1 -- start start 2023-11-25T04:09:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f699e67c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f699815d6c0 0x7f69980cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f699e67c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f69980d1d60 0x7f69980d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f699e67c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69980d11d0 con 0x7f69980d1980 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f699e67c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69980ce2b0 con 0x7f699815d6c0 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f699e67c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69980ce590 con 0x7f69980d1d60 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f69977fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f699815d6c0 0x7f69980cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f69977fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f699815d6c0 0x7f69980cdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35548/0 (socket says 172.21.15.2:35548) 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f69977fe640 1 -- 172.21.15.2:0/2684804367 learned_addr learned my addr 172.21.15.2:0/2684804367 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f699cc19640 1 --2- 172.21.15.2:0/2684804367 >> v2:172.21.15.66:3300/0 conn(0x7f69980d1d60 0x7f69980d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f69977fe640 1 -- 172.21.15.2:0/2684804367 >> v2:172.21.15.66:3300/0 conn(0x7f69980d1d60 msgr2=0x7f69980d3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f69977fe640 1 --2- 172.21.15.2:0/2684804367 >> v2:172.21.15.66:3300/0 conn(0x7f69980d1d60 0x7f69980d3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f69977fe640 1 -- 172.21.15.2:0/2684804367 >> v1:172.21.15.66:6789/0 conn(0x7f69980d1980 legacy=0x7f699815cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.240+0000 7f69977fe640 1 -- 172.21.15.2:0/2684804367 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69980ce870 con 0x7f699815d6c0 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.241+0000 7f69977fe640 1 --2- 172.21.15.2:0/2684804367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699815d6c0 0x7f69980cdc40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f69980cd7b0 tx=0x7f698c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b549ac151d1852 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.241+0000 7f6996ffd640 1 -- 172.21.15.2:0/2684804367 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c031870 con 0x7f699815d6c0 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.241+0000 7f6996ffd640 1 -- 172.21.15.2:0/2684804367 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c0319d0 con 0x7f699815d6c0 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.241+0000 7f6996ffd640 1 -- 172.21.15.2:0/2684804367 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c031d60 con 0x7f699815d6c0 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.242+0000 7f699e67c640 1 -- 172.21.15.2:0/2684804367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699815d6c0 msgr2=0x7f69980cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.242+0000 7f699e67c640 1 --2- 172.21.15.2:0/2684804367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699815d6c0 0x7f69980cdc40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f69980cd7b0 tx=0x7f698c02b910 comp rx=0 tx=0).stop 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.242+0000 7f699e67c640 1 -- 172.21.15.2:0/2684804367 shutdown_connections 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.242+0000 7f699e67c640 1 --2- 172.21.15.2:0/2684804367 >> v2:172.21.15.66:3300/0 conn(0x7f69980d1d60 0x7f69980d3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.242+0000 7f699e67c640 1 --2- 172.21.15.2:0/2684804367 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f699815d6c0 0x7f69980cdc40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.242+0000 7f699e67c640 1 -- 172.21.15.2:0/2684804367 >> 172.21.15.2:0/2684804367 conn(0x7f699809c470 msgr2=0x7f69980d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:07.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.242+0000 7f699e67c640 1 -- 172.21.15.2:0/2684804367 shutdown_connections 2023-11-25T04:09:07.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.242+0000 7f699e67c640 1 -- 172.21.15.2:0/2684804367 wait complete. 2023-11-25T04:09:07.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.243+0000 7f699e67c640 1 Processor -- start 2023-11-25T04:09:07.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.243+0000 7f699e67c640 1 -- start start 2023-11-25T04:09:07.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f699e67c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69980d1980 0x7f699815ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f699e67c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69980d1d60 0x7f699814b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f699e67c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f699815d6c0 0x7f69980cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f699e67c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699815eae0 con 0x7f69980d1d60 2023-11-25T04:09:07.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f699e67c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f699815de60 con 0x7f69980d1980 2023-11-25T04:09:07.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f699e67c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f699815e140 con 0x7f699815d6c0 2023-11-25T04:09:07.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f69977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69980d1d60 0x7f699814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f69977fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69980d1d60 0x7f699814b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35564/0 (socket says 172.21.15.2:35564) 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f69977fe640 1 -- 172.21.15.2:0/481112151 learned_addr learned my addr 172.21.15.2:0/481112151 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f6997fff640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69980d1980 0x7f699815ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f699cc19640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f699815d6c0 0x7f69980cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f69977fe640 1 -- 172.21.15.2:0/481112151 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f699815d6c0 msgr2=0x7f69980cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f69977fe640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f699815d6c0 0x7f69980cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f69977fe640 1 -- 172.21.15.2:0/481112151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69980d1980 msgr2=0x7f699815ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f69977fe640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69980d1980 0x7f699815ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f69977fe640 1 -- 172.21.15.2:0/481112151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f698c0094d0 con 0x7f69980d1d60 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.244+0000 7f69977fe640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69980d1d60 0x7f699814b770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f698c02b950 tx=0x7f698c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:07.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.245+0000 7f6994ff9640 1 -- 172.21.15.2:0/481112151 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c03abe0 con 0x7f69980d1d60 2023-11-25T04:09:07.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.245+0000 7f6994ff9640 1 -- 172.21.15.2:0/481112151 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f698c03ad60 con 0x7f69980d1d60 2023-11-25T04:09:07.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.245+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f699815e420 con 0x7f69980d1d60 2023-11-25T04:09:07.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.245+0000 7f6994ff9640 1 -- 172.21.15.2:0/481112151 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f698c044630 con 0x7f69980d1d60 2023-11-25T04:09:07.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.245+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f699815db10 con 0x7f69980d1d60 2023-11-25T04:09:07.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.246+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69980a10e0 con 0x7f69980d1d60 2023-11-25T04:09:07.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.246+0000 7f6994ff9640 1 -- 172.21.15.2:0/481112151 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f698c04d450 con 0x7f69980d1d60 2023-11-25T04:09:07.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.246+0000 7f6994ff9640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f698406ae40 0x7f698406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.246+0000 7f6994ff9640 1 -- 172.21.15.2:0/481112151 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f698c02d040 con 0x7f69980d1d60 2023-11-25T04:09:07.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.247+0000 7f6997fff640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f698406ae40 0x7f698406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.247+0000 7f6997fff640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f698406ae40 0x7f698406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6988000f60 tx=0x7f6988009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:07.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.251+0000 7f6994ff9640 1 -- 172.21.15.2:0/481112151 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f698c076af0 con 0x7f69980d1d60 2023-11-25T04:09:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.424+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69980d39b0 con 0x7f69980d1d60 2023-11-25T04:09:07.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.425+0000 7f6994ff9640 1 -- 172.21.15.2:0/481112151 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f698c035020 con 0x7f69980d1d60 2023-11-25T04:09:07.426 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f698406ae40 msgr2=0x7f698406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f698406ae40 0x7f698406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6988000f60 tx=0x7f6988009040 comp rx=0 tx=0).stop 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69980d1d60 msgr2=0x7f699814b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69980d1d60 0x7f699814b770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f698c02b950 tx=0x7f698c0046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 shutdown_connections 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f699815d6c0 0x7f69980cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f69980d1d60 0x7f699814b770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f698406ae40 0x7f698406d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 --2- 172.21.15.2:0/481112151 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69980d1980 0x7f699815ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.426+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 >> 172.21.15.2:0/481112151 conn(0x7f699809c470 msgr2=0x7f69980d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.427+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 shutdown_connections 2023-11-25T04:09:07.428 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.427+0000 7f699e67c640 1 -- 172.21.15.2:0/481112151 wait complete. 2023-11-25T04:09:07.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:07.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.548+0000 7f0057da9640 1 Processor -- start 2023-11-25T04:09:07.549 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.548+0000 7f0057da9640 1 -- start start 2023-11-25T04:09:07.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0057da9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00500b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0057da9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f005006abe0 0x7f0050160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0057da9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00500721d0 con 0x7f0050071d40 2023-11-25T04:09:07.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0057da9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0050161d80 con 0x7f005006abe0 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0057da9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00501612d0 con 0x7f00501465d0 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0055b45640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00500b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0056346640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f005006abe0 0x7f0050160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0055344640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f0050071d40 0x7f005006a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:55506/0 (socket says 172.21.15.2:55506) 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0056346640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f005006abe0 0x7f0050160d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:60772/0 (socket says 172.21.15.2:60772) 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0055344640 1 -- 172.21.15.2:0/2670790060 learned_addr learned my addr 172.21.15.2:0/2670790060 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0055b45640 1 -- 172.21.15.2:0/2670790060 >> v2:172.21.15.66:3300/0 conn(0x7f005006abe0 msgr2=0x7f0050160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0055b45640 1 --2- 172.21.15.2:0/2670790060 >> v2:172.21.15.66:3300/0 conn(0x7f005006abe0 0x7f0050160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0055b45640 1 -- 172.21.15.2:0/2670790060 >> v1:172.21.15.66:6789/0 conn(0x7f0050071d40 legacy=0x7f005006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.549+0000 7f0055b45640 1 -- 172.21.15.2:0/2670790060 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00500cf790 con 0x7f00501465d0 2023-11-25T04:09:07.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.550+0000 7f0055b45640 1 --2- 172.21.15.2:0/2670790060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00500b2ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f004c0097a0 tx=0x7f004c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86ee770c87dc2510 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:07.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.550+0000 7f0054b43640 1 -- 172.21.15.2:0/2670790060 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c031830 con 0x7f00501465d0 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.550+0000 7f0054b43640 1 -- 172.21.15.2:0/2670790060 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c031990 con 0x7f00501465d0 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.550+0000 7f0054b43640 1 -- 172.21.15.2:0/2670790060 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c031d20 con 0x7f00501465d0 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.551+0000 7f0057da9640 1 -- 172.21.15.2:0/2670790060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 msgr2=0x7f00500b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.551+0000 7f0057da9640 1 --2- 172.21.15.2:0/2670790060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00500b2ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f004c0097a0 tx=0x7f004c02b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.551+0000 7f0057da9640 1 -- 172.21.15.2:0/2670790060 shutdown_connections 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.551+0000 7f0057da9640 1 --2- 172.21.15.2:0/2670790060 >> v2:172.21.15.66:3300/0 conn(0x7f005006abe0 0x7f0050160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.551+0000 7f0057da9640 1 --2- 172.21.15.2:0/2670790060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00500b2ee0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.551+0000 7f0057da9640 1 -- 172.21.15.2:0/2670790060 >> 172.21.15.2:0/2670790060 conn(0x7f00500cc930 msgr2=0x7f00500ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.551+0000 7f0057da9640 1 -- 172.21.15.2:0/2670790060 shutdown_connections 2023-11-25T04:09:07.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.551+0000 7f0057da9640 1 -- 172.21.15.2:0/2670790060 wait complete. 2023-11-25T04:09:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.552+0000 7f0057da9640 1 Processor -- start 2023-11-25T04:09:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.552+0000 7f0057da9640 1 -- start start 2023-11-25T04:09:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0057da9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f005006abe0 0x7f005015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0057da9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0050071d40 0x7f005013ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0057da9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00501410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0057da9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0050140290 con 0x7f005006abe0 2023-11-25T04:09:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0057da9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005013f710 con 0x7f0050071d40 2023-11-25T04:09:07.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0057da9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005013f9f0 con 0x7f00501465d0 2023-11-25T04:09:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0055b45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f005006abe0 0x7f005015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0055b45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f005006abe0 0x7f005015f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35574/0 (socket says 172.21.15.2:35574) 2023-11-25T04:09:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0055b45640 1 -- 172.21.15.2:0/3658323753 learned_addr learned my addr 172.21.15.2:0/3658323753 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0056346640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00501410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0055344640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0050071d40 0x7f005013ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0055b45640 1 -- 172.21.15.2:0/3658323753 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 msgr2=0x7f00501410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0055b45640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00501410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0055b45640 1 -- 172.21.15.2:0/3658323753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0050071d40 msgr2=0x7f005013ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0055b45640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0050071d40 0x7f005013ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0055b45640 1 -- 172.21.15.2:0/3658323753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c009400 con 0x7f005006abe0 2023-11-25T04:09:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.553+0000 7f0056346640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00501410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.554+0000 7f0055b45640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f005006abe0 0x7f005015f9d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.554+0000 7f00467fc640 1 -- 172.21.15.2:0/3658323753 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c03a830 con 0x7f005006abe0 2023-11-25T04:09:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.554+0000 7f00467fc640 1 -- 172.21.15.2:0/3658323753 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c03a9b0 con 0x7f005006abe0 2023-11-25T04:09:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.554+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005013fcd0 con 0x7f005006abe0 2023-11-25T04:09:07.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.554+0000 7f00467fc640 1 -- 172.21.15.2:0/3658323753 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c03ad60 con 0x7f005006abe0 2023-11-25T04:09:07.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.554+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005015ff10 con 0x7f005006abe0 2023-11-25T04:09:07.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.555+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005006e6a0 con 0x7f005006abe0 2023-11-25T04:09:07.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.555+0000 7f00467fc640 1 -- 172.21.15.2:0/3658323753 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f004c04d450 con 0x7f005006abe0 2023-11-25T04:09:07.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.556+0000 7f00467fc640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f003406ae40 0x7f003406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.556+0000 7f00467fc640 1 -- 172.21.15.2:0/3658323753 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f004c0ab630 con 0x7f005006abe0 2023-11-25T04:09:07.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.556+0000 7f0055344640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f003406ae40 0x7f003406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.556+0000 7f0055344640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f003406ae40 0x7f003406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0050145c30 tx=0x7f0040009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:07.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.560+0000 7f00467fc640 1 -- 172.21.15.2:0/3658323753 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f004c0766e0 con 0x7f005006abe0 2023-11-25T04:09:07.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.736+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f005004e920 con 0x7f005006abe0 2023-11-25T04:09:07.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.736+0000 7f00467fc640 1 -- 172.21.15.2:0/3658323753 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f004c079d00 con 0x7f005006abe0 2023-11-25T04:09:07.738 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:07.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f003406ae40 msgr2=0x7f003406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f003406ae40 0x7f003406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0050145c30 tx=0x7f0040009040 comp rx=0 tx=0).stop 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f005006abe0 msgr2=0x7f005015f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f005006abe0 0x7f005015f9d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f004c000c00 tx=0x7f004c0046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 shutdown_connections 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00501465d0 0x7f00501410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f003406ae40 0x7f003406d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0050071d40 0x7f005013ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 --2- 172.21.15.2:0/3658323753 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f005006abe0 0x7f005015f9d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 >> 172.21.15.2:0/3658323753 conn(0x7f00500cc930 msgr2=0x7f00500b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:07.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 shutdown_connections 2023-11-25T04:09:07.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.738+0000 7f0057da9640 1 -- 172.21.15.2:0/3658323753 wait complete. 2023-11-25T04:09:07.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:07.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.861+0000 7f1773f9e640 1 Processor -- start 2023-11-25T04:09:07.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.862+0000 7f1773f9e640 1 -- start start 2023-11-25T04:09:07.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.862+0000 7f1773f9e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f176c160b70 0x7f176c0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.862+0000 7f1773f9e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f176c0cef00 0x7f176c161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.862+0000 7f1773f9e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0ce360 con 0x7f176c0b2aa0 2023-11-25T04:09:07.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.862+0000 7f1773f9e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c0b2f20 con 0x7f176c160b70 2023-11-25T04:09:07.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.862+0000 7f1773f9e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c0cdd50 con 0x7f176c0cef00 2023-11-25T04:09:07.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.863+0000 7f1771d3a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f176c160b70 0x7f176c0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.863+0000 7f1771d3a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f176c160b70 0x7f176c0d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35584/0 (socket says 172.21.15.2:35584) 2023-11-25T04:09:07.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.863+0000 7f1771d3a640 1 -- 172.21.15.2:0/4214383680 learned_addr learned my addr 172.21.15.2:0/4214383680 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:07.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.863+0000 7f177253b640 1 --2- 172.21.15.2:0/4214383680 >> v2:172.21.15.66:3300/0 conn(0x7f176c0cef00 0x7f176c161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.863+0000 7f1771d3a640 1 -- 172.21.15.2:0/4214383680 >> v2:172.21.15.66:3300/0 conn(0x7f176c0cef00 msgr2=0x7f176c161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:07.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.863+0000 7f1771d3a640 1 --2- 172.21.15.2:0/4214383680 >> v2:172.21.15.66:3300/0 conn(0x7f176c0cef00 0x7f176c161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.863+0000 7f1771d3a640 1 -- 172.21.15.2:0/4214383680 >> v1:172.21.15.66:6789/0 conn(0x7f176c0b2aa0 legacy=0x7f176c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.863+0000 7f1771d3a640 1 -- 172.21.15.2:0/4214383680 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c0d1c70 con 0x7f176c160b70 2023-11-25T04:09:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1771d3a640 1 --2- 172.21.15.2:0/4214383680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c160b70 0x7f176c0d1570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f176c072b40 tx=0x7f176802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec37d784db845b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1770d38640 1 -- 172.21.15.2:0/4214383680 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768030860 con 0x7f176c160b70 2023-11-25T04:09:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1770d38640 1 -- 172.21.15.2:0/4214383680 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17680309c0 con 0x7f176c160b70 2023-11-25T04:09:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1770d38640 1 -- 172.21.15.2:0/4214383680 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768030d50 con 0x7f176c160b70 2023-11-25T04:09:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1773f9e640 1 -- 172.21.15.2:0/4214383680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c160b70 msgr2=0x7f176c0d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1773f9e640 1 --2- 172.21.15.2:0/4214383680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c160b70 0x7f176c0d1570 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f176c072b40 tx=0x7f176802b9a0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1773f9e640 1 -- 172.21.15.2:0/4214383680 shutdown_connections 2023-11-25T04:09:07.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1773f9e640 1 --2- 172.21.15.2:0/4214383680 >> v2:172.21.15.66:3300/0 conn(0x7f176c0cef00 0x7f176c161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1773f9e640 1 --2- 172.21.15.2:0/4214383680 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c160b70 0x7f176c0d1570 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1773f9e640 1 -- 172.21.15.2:0/4214383680 >> 172.21.15.2:0/4214383680 conn(0x7f176c09c470 msgr2=0x7f176c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:07.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1773f9e640 1 -- 172.21.15.2:0/4214383680 shutdown_connections 2023-11-25T04:09:07.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.864+0000 7f1773f9e640 1 -- 172.21.15.2:0/4214383680 wait complete. 2023-11-25T04:09:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1773f9e640 1 Processor -- start 2023-11-25T04:09:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1773f9e640 1 -- start start 2023-11-25T04:09:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1773f9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c0b2aa0 0x7f176c1569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1773f9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f176c0cef00 0x7f176c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1773f9e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f176c160b70 0x7f176c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1773f9e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0ccaf0 con 0x7f176c0b2aa0 2023-11-25T04:09:07.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1773f9e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0b6b90 con 0x7f176c0cef00 2023-11-25T04:09:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1773f9e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0b6e70 con 0x7f176c160b70 2023-11-25T04:09:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1771d3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c0b2aa0 0x7f176c1569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1771d3a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c0b2aa0 0x7f176c1569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35588/0 (socket says 172.21.15.2:35588) 2023-11-25T04:09:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.866+0000 7f1771d3a640 1 -- 172.21.15.2:0/2294009177 learned_addr learned my addr 172.21.15.2:0/2294009177 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f177253b640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f176c160b70 0x7f176c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f1771539640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f176c0cef00 0x7f176c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f1771d3a640 1 -- 172.21.15.2:0/2294009177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f176c160b70 msgr2=0x7f176c0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.875 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f1771d3a640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f176c160b70 0x7f176c0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f1771d3a640 1 -- 172.21.15.2:0/2294009177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f176c0cef00 msgr2=0x7f176c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f1771d3a640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f176c0cef00 0x7f176c0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f1771d3a640 1 -- 172.21.15.2:0/2294009177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680094d0 con 0x7f176c0b2aa0 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f177253b640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f176c160b70 0x7f176c0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f1771d3a640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c0b2aa0 0x7f176c1569b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f176802b9e0 tx=0x7f1768004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f17627fc640 1 -- 172.21.15.2:0/2294009177 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768039d60 con 0x7f176c0b2aa0 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f17627fc640 1 -- 172.21.15.2:0/2294009177 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768043400 con 0x7f176c0b2aa0 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f17627fc640 1 -- 172.21.15.2:0/2294009177 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680437b0 con 0x7f176c0b2aa0 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c0b7150 con 0x7f176c0b2aa0 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.867+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c0b6700 con 0x7f176c0b2aa0 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.868+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c0b6950 con 0x7f176c0b2aa0 2023-11-25T04:09:07.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.868+0000 7f17627fc640 1 -- 172.21.15.2:0/2294009177 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1768043910 con 0x7f176c0b2aa0 2023-11-25T04:09:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.869+0000 7f17627fc640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f175006ae70 0x7f175006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.869+0000 7f17627fc640 1 -- 172.21.15.2:0/2294009177 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f176803e070 con 0x7f176c0b2aa0 2023-11-25T04:09:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.869+0000 7f1771539640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f175006ae70 0x7f175006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.869+0000 7f1771539640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f175006ae70 0x7f175006d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f176c1f4b10 tx=0x7f175c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:07.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:07.873+0000 7f17627fc640 1 -- 172.21.15.2:0/2294009177 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f176c0b6950 con 0x7f176c0b2aa0 2023-11-25T04:09:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.047+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f176c0b6950 con 0x7f176c0b2aa0 2023-11-25T04:09:08.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.048+0000 7f17627fc640 1 -- 172.21.15.2:0/2294009177 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f176c0b6950 con 0x7f176c0b2aa0 2023-11-25T04:09:08.049 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f175006ae70 msgr2=0x7f175006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f175006ae70 0x7f175006d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f176c1f4b10 tx=0x7f175c009040 comp rx=0 tx=0).stop 2023-11-25T04:09:08.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c0b2aa0 msgr2=0x7f176c1569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c0b2aa0 0x7f176c1569b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f176802b9e0 tx=0x7f1768004730 comp rx=0 tx=0).stop 2023-11-25T04:09:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 shutdown_connections 2023-11-25T04:09:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f176c160b70 0x7f176c0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f175006ae70 0x7f175006d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f176c0cef00 0x7f176c0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 --2- 172.21.15.2:0/2294009177 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f176c0b2aa0 0x7f176c1569b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 >> 172.21.15.2:0/2294009177 conn(0x7f176c09c470 msgr2=0x7f176c0d2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 shutdown_connections 2023-11-25T04:09:08.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.050+0000 7f1773f9e640 1 -- 172.21.15.2:0/2294009177 wait complete. 2023-11-25T04:09:08.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-25T04:09:08.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.171+0000 7fa6897b0640 1 Processor -- start 2023-11-25T04:09:08.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.171+0000 7fa6897b0640 1 -- start start 2023-11-25T04:09:08.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6897b0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa68415ebf0 0x7fa68409a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6897b0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6840cd540 0x7fa6840ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6897b0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6840cd170 con 0x7fa68415e810 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6897b0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6840b2260 con 0x7fa68415ebf0 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6897b0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840b37b0 con 0x7fa6840cd540 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa67bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa68415ebf0 0x7fa68409a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6837fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6840cd540 0x7fa6840ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa682ffd640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa68415e810 0x7fa684099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:55524/0 (socket says 172.21.15.2:55524) 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa682ffd640 1 -- 172.21.15.2:0/2655422571 learned_addr learned my addr 172.21.15.2:0/2655422571 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6827fc640 1 -- 172.21.15.2:0/2655422571 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484089268 0 0) 0x7fa6840cd170 con 0x7fa68415e810 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6827fc640 1 -- 172.21.15.2:0/2655422571 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa670003520 con 0x7fa68415e810 2023-11-25T04:09:08.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6837fe640 1 -- 172.21.15.2:0/2655422571 >> v2:172.21.15.66:3300/0 conn(0x7fa68415ebf0 msgr2=0x7fa68409a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6837fe640 1 --2- 172.21.15.2:0/2655422571 >> v2:172.21.15.66:3300/0 conn(0x7fa68415ebf0 0x7fa68409a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6837fe640 1 -- 172.21.15.2:0/2655422571 >> v1:172.21.15.66:6789/0 conn(0x7fa68415e810 legacy=0x7fa684099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa6837fe640 1 -- 172.21.15.2:0/2655422571 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6840cc720 con 0x7fa6840cd540 2023-11-25T04:09:08.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.172+0000 7fa67bfff640 1 --2- 172.21.15.2:0/2655422571 >> v2:172.21.15.66:3300/0 conn(0x7fa68415ebf0 0x7fa68409a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:09:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.173+0000 7fa6837fe640 1 --2- 172.21.15.2:0/2655422571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6840cd540 0x7fa6840ccc30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009d90 tx=0x7fa67c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626e790a7be109bf server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.173+0000 7fa6827fc640 1 -- 172.21.15.2:0/2655422571 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c02cc50 con 0x7fa6840cd540 2023-11-25T04:09:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.173+0000 7fa6827fc640 1 -- 172.21.15.2:0/2655422571 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c02cdb0 con 0x7fa6840cd540 2023-11-25T04:09:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.173+0000 7fa6827fc640 1 -- 172.21.15.2:0/2655422571 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c034660 con 0x7fa6840cd540 2023-11-25T04:09:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.174+0000 7fa6897b0640 1 -- 172.21.15.2:0/2655422571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6840cd540 msgr2=0x7fa6840ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.174+0000 7fa6897b0640 1 --2- 172.21.15.2:0/2655422571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6840cd540 0x7fa6840ccc30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009d90 tx=0x7fa67c02bea0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.174+0000 7fa6897b0640 1 -- 172.21.15.2:0/2655422571 shutdown_connections 2023-11-25T04:09:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.174+0000 7fa6897b0640 1 --2- 172.21.15.2:0/2655422571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6840cd540 0x7fa6840ccc30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.174+0000 7fa6897b0640 1 --2- 172.21.15.2:0/2655422571 >> v2:172.21.15.66:3300/0 conn(0x7fa68415ebf0 0x7fa68409a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.174+0000 7fa6897b0640 1 -- 172.21.15.2:0/2655422571 >> 172.21.15.2:0/2655422571 conn(0x7fa6840b2a70 msgr2=0x7fa6840b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.174+0000 7fa6897b0640 1 -- 172.21.15.2:0/2655422571 shutdown_connections 2023-11-25T04:09:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.174+0000 7fa6897b0640 1 -- 172.21.15.2:0/2655422571 wait complete. 2023-11-25T04:09:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.175+0000 7fa6897b0640 1 Processor -- start 2023-11-25T04:09:08.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.175+0000 7fa6897b0640 1 -- start start 2023-11-25T04:09:08.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa6897b0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6840cd540 0x7fa68415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa6897b0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa68415e810 0x7fa68415c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa6897b0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa68415ebf0 0x7fa6840c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa6897b0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c9a00 con 0x7fa68415e810 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa6897b0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c8d80 con 0x7fa6840cd540 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa6897b0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6840c9060 con 0x7fa68415ebf0 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa67bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa68415e810 0x7fa68415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa67bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa68415e810 0x7fa68415c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35598/0 (socket says 172.21.15.2:35598) 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa67bfff640 1 -- 172.21.15.2:0/504086025 learned_addr learned my addr 172.21.15.2:0/504086025 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa682ffd640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6840cd540 0x7fa68415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa6837fe640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa68415ebf0 0x7fa6840c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa67bfff640 1 -- 172.21.15.2:0/504086025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa68415ebf0 msgr2=0x7fa6840c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa67bfff640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa68415ebf0 0x7fa6840c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa67bfff640 1 -- 172.21.15.2:0/504086025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6840cd540 msgr2=0x7fa68415bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa67bfff640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6840cd540 0x7fa68415bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa67bfff640 1 -- 172.21.15.2:0/504086025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c009400 con 0x7fa68415e810 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.176+0000 7fa6837fe640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa68415ebf0 0x7fa6840c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.177+0000 7fa67bfff640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa68415e810 0x7fa68415c410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00e900 tx=0x7fa66c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.177+0000 7fa67b7fe640 1 -- 172.21.15.2:0/504086025 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c009660 con 0x7fa68415e810 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.177+0000 7fa67b7fe640 1 -- 172.21.15.2:0/504086025 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c00ca00 con 0x7fa68415e810 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.177+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67c009a70 con 0x7fa68415e810 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.177+0000 7fa67b7fe640 1 -- 172.21.15.2:0/504086025 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c00cdb0 con 0x7fa68415e810 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.177+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6840c9620 con 0x7fa68415e810 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.178+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68409ef40 con 0x7fa68415e810 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.178+0000 7fa67b7fe640 1 -- 172.21.15.2:0/504086025 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa66c013470 con 0x7fa68415e810 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.179+0000 7fa67b7fe640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa66406ae40 0x7fa66406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.181 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.179+0000 7fa67b7fe640 1 -- 172.21.15.2:0/504086025 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa66c0898d0 con 0x7fa68415e810 2023-11-25T04:09:08.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.179+0000 7fa682ffd640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa66406ae40 0x7fa66406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.179+0000 7fa682ffd640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa66406ae40 0x7fa66406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa674005880 tx=0x7fa674009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:08.183 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.183+0000 7fa67b7fe640 1 -- 172.21.15.2:0/504086025 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa66c054970 con 0x7fa68415e810 2023-11-25T04:09:08.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.373+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa68406c900 con 0x7fa68415e810 2023-11-25T04:09:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.374+0000 7fa67b7fe640 1 -- 172.21.15.2:0/504086025 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa66c057f90 con 0x7fa68415e810 2023-11-25T04:09:08.375 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa66406ae40 msgr2=0x7fa66406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa66406ae40 0x7fa66406d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa674005880 tx=0x7fa674009040 comp rx=0 tx=0).stop 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa68415e810 msgr2=0x7fa68415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa68415e810 0x7fa68415c410 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00e900 tx=0x7fa66c00edc0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 shutdown_connections 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa68415ebf0 0x7fa6840c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fa68415e810 0x7fa68415c410 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fa66406ae40 0x7fa66406d300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 --2- 172.21.15.2:0/504086025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6840cd540 0x7fa68415bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.375+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 >> 172.21.15.2:0/504086025 conn(0x7fa6840b2a70 msgr2=0x7fa6840b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.376+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 shutdown_connections 2023-11-25T04:09:08.378 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.376+0000 7fa6897b0640 1 -- 172.21.15.2:0/504086025 wait complete. 2023-11-25T04:09:08.387 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:09:08.388 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:08.404 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.548+0000 7fe29e3e5640 1 Processor -- start 2023-11-25T04:09:08.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.548+0000 7fe29e3e5640 1 -- start start 2023-11-25T04:09:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe29e3e5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29809a080 0x7fe2980b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe29e3e5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2980b0660 con 0x7fe2980b2610 2023-11-25T04:09:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe29e3e5640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29806c900 con 0x7fe29815d900 2023-11-25T04:09:08.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe29e3e5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29806cbe0 con 0x7fe29809a080 2023-11-25T04:09:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe29c982640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe2980b2610 0x7fe2980b1310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50652/0 (socket says 172.21.15.2:50652) 2023-11-25T04:09:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe29c982640 1 -- 172.21.15.2:0/3720675126 learned_addr learned my addr 172.21.15.2:0/3720675126 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe2977fe640 1 --2- 172.21.15.2:0/3720675126 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29809a080 0x7fe2980b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe296ffd640 1 -- 172.21.15.2:0/3720675126 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486252924 0 0) 0x7fe2980b0660 con 0x7fe2980b2610 2023-11-25T04:09:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe296ffd640 1 -- 172.21.15.2:0/3720675126 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe280003520 con 0x7fe2980b2610 2023-11-25T04:09:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe296ffd640 1 -- 172.21.15.2:0/3720675126 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488015256 0 0) 0x7fe29806c900 con 0x7fe29815d900 2023-11-25T04:09:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe296ffd640 1 -- 172.21.15.2:0/3720675126 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2980b0660 con 0x7fe29815d900 2023-11-25T04:09:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe296ffd640 1 -- 172.21.15.2:0/3720675126 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576133990 0 0) 0x7fe280003520 con 0x7fe2980b2610 2023-11-25T04:09:08.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe2977fe640 1 -- 172.21.15.2:0/3720675126 >> v1:172.21.15.66:6789/0 conn(0x7fe29815d900 legacy=0x7fe298099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe2977fe640 1 -- 172.21.15.2:0/3720675126 >> v1:172.21.15.2:6789/0 conn(0x7fe2980b2610 legacy=0x7fe2980b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.549+0000 7fe2977fe640 1 -- 172.21.15.2:0/3720675126 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29806cec0 con 0x7fe29809a080 2023-11-25T04:09:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.550+0000 7fe2977fe640 1 --2- 172.21.15.2:0/3720675126 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29809a080 0x7fe2980b0dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe2880097d0 tx=0x7fe28802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ad531c69a1afec4 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.550+0000 7fe296ffd640 1 -- 172.21.15.2:0/3720675126 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900019f0 con 0x7fe29809a080 2023-11-25T04:09:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.551+0000 7fe296ffd640 1 -- 172.21.15.2:0/3720675126 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28802e050 con 0x7fe29809a080 2023-11-25T04:09:08.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.551+0000 7fe296ffd640 1 -- 172.21.15.2:0/3720675126 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288030710 con 0x7fe29809a080 2023-11-25T04:09:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.551+0000 7fe29e3e5640 1 -- 172.21.15.2:0/3720675126 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29809a080 msgr2=0x7fe2980b0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.551+0000 7fe29e3e5640 1 --2- 172.21.15.2:0/3720675126 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29809a080 0x7fe2980b0dd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe2880097d0 tx=0x7fe28802b800 comp rx=0 tx=0).stop 2023-11-25T04:09:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.551+0000 7fe29e3e5640 1 -- 172.21.15.2:0/3720675126 shutdown_connections 2023-11-25T04:09:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.551+0000 7fe29e3e5640 1 --2- 172.21.15.2:0/3720675126 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29809a080 0x7fe2980b0dd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.551+0000 7fe29e3e5640 1 -- 172.21.15.2:0/3720675126 >> 172.21.15.2:0/3720675126 conn(0x7fe2980b2a70 msgr2=0x7fe2980b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.551+0000 7fe29e3e5640 1 -- 172.21.15.2:0/3720675126 shutdown_connections 2023-11-25T04:09:08.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.551+0000 7fe29e3e5640 1 -- 172.21.15.2:0/3720675126 wait complete. 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.552+0000 7fe29e3e5640 1 Processor -- start 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.552+0000 7fe29e3e5640 1 -- start start 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe29e3e5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29809a080 0x7fe2980c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe29e3e5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe2980b2610 0x7fe2980c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe29e3e5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe29815d900 0x7fe2980b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe29e3e5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815edb0 con 0x7fe29815d900 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe29e3e5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815f090 con 0x7fe29809a080 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe29e3e5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29815f370 con 0x7fe2980b2610 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe29c982640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe29815d900 0x7fe2980b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe29c982640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe29815d900 0x7fe2980b5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35600/0 (socket says 172.21.15.2:35600) 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe29c982640 1 -- 172.21.15.2:0/2620619318 learned_addr learned my addr 172.21.15.2:0/2620619318 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:08.558 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe2977fe640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe2980b2610 0x7fe2980c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.553+0000 7fe297fff640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29809a080 0x7fe2980c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe29c982640 1 -- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe2980b2610 msgr2=0x7fe2980c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe29c982640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe2980b2610 0x7fe2980c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe29c982640 1 -- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29809a080 msgr2=0x7fe2980c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe29c982640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29809a080 0x7fe2980c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe29c982640 1 -- 172.21.15.2:0/2620619318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe288009400 con 0x7fe29815d900 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe2977fe640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe2980b2610 0x7fe2980c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe297fff640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29809a080 0x7fe2980c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe29c982640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe29815d900 0x7fe2980b5670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe290001ef0 tx=0x7fe29000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe294ff9640 1 -- 172.21.15.2:0/2620619318 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290002100 con 0x7fe29815d900 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29815f650 con 0x7fe29815d900 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe294ff9640 1 -- 172.21.15.2:0/2620619318 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe290012400 con 0x7fe29815d900 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe294ff9640 1 -- 172.21.15.2:0/2620619318 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900127f0 con 0x7fe29815d900 2023-11-25T04:09:08.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.554+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2980c67d0 con 0x7fe29815d900 2023-11-25T04:09:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.555+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29815fb70 con 0x7fe29815d900 2023-11-25T04:09:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.555+0000 7fe294ff9640 1 -- 172.21.15.2:0/2620619318 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe290007070 con 0x7fe29815d900 2023-11-25T04:09:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.556+0000 7fe294ff9640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe28406ae40 0x7fe28406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.556+0000 7fe294ff9640 1 -- 172.21.15.2:0/2620619318 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe290089710 con 0x7fe29815d900 2023-11-25T04:09:08.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.556+0000 7fe297fff640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe28406ae40 0x7fe28406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.556+0000 7fe297fff640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe28406ae40 0x7fe28406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0011e0 tx=0x7fe28c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:08.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.560+0000 7fe294ff9640 1 -- 172.21.15.2:0/2620619318 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2900547f0 con 0x7fe29815d900 2023-11-25T04:09:08.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.736+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe298067420 con 0x7fe29815d900 2023-11-25T04:09:08.740 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.737+0000 7fe294ff9640 1 -- 172.21.15.2:0/2620619318 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fe290057e10 con 0x7fe29815d900 2023-11-25T04:09:08.740 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:08.740 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe28406ae40 msgr2=0x7fe28406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe28406ae40 0x7fe28406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0011e0 tx=0x7fe28c009040 comp rx=0 tx=0).stop 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe29815d900 msgr2=0x7fe2980b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe29815d900 0x7fe2980b5670 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fe290001ef0 tx=0x7fe29000a430 comp rx=0 tx=0).stop 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 shutdown_connections 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe29815d900 0x7fe2980b5670 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe2980b2610 0x7fe2980c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe28406ae40 0x7fe28406d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 --2- 172.21.15.2:0/2620619318 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29809a080 0x7fe2980c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.739+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 >> 172.21.15.2:0/2620619318 conn(0x7fe2980b2a70 msgr2=0x7fe298099970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.740+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 shutdown_connections 2023-11-25T04:09:08.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.740+0000 7fe29e3e5640 1 -- 172.21.15.2:0/2620619318 wait complete. 2023-11-25T04:09:08.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:08.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:08.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.860+0000 7ff29ff89640 1 Processor -- start 2023-11-25T04:09:08.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.860+0000 7ff29ff89640 1 -- start start 2023-11-25T04:09:08.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.861+0000 7ff29ff89640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff298160b70 0x7ff2980d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.861+0000 7ff29ff89640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff2980b2aa0 0x7ff2980ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.861+0000 7ff29ff89640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2980ce360 con 0x7ff2980ced30 2023-11-25T04:09:08.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.861+0000 7ff29ff89640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980b2f20 con 0x7ff298160b70 2023-11-25T04:09:08.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.861+0000 7ff29ff89640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2980cdd50 con 0x7ff2980b2aa0 2023-11-25T04:09:08.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.861+0000 7ff29dd25640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7ff298160b70 0x7ff2980d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.861+0000 7ff29e526640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff2980ced30 0x7ff2980cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48284/0 (socket says 172.21.15.2:48284) 2023-11-25T04:09:08.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.861+0000 7ff29e526640 1 -- 172.21.15.2:0/2321309478 learned_addr learned my addr 172.21.15.2:0/2321309478 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:08.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.862+0000 7ff29d524640 1 --2- 172.21.15.2:0/2321309478 >> v2:172.21.15.66:3300/0 conn(0x7ff2980b2aa0 0x7ff2980ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.862+0000 7ff29dd25640 1 -- 172.21.15.2:0/2321309478 >> v2:172.21.15.66:3300/0 conn(0x7ff2980b2aa0 msgr2=0x7ff2980ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:08.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.862+0000 7ff29dd25640 1 --2- 172.21.15.2:0/2321309478 >> v2:172.21.15.66:3300/0 conn(0x7ff2980b2aa0 0x7ff2980ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.862+0000 7ff29dd25640 1 -- 172.21.15.2:0/2321309478 >> v1:172.21.15.2:6789/0 conn(0x7ff2980ced30 legacy=0x7ff2980cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.862+0000 7ff29cd23640 1 -- 172.21.15.2:0/2321309478 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571917621 0 0) 0x7ff2980ce360 con 0x7ff2980ced30 2023-11-25T04:09:08.865 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.862+0000 7ff29dd25640 1 -- 172.21.15.2:0/2321309478 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980d1c70 con 0x7ff298160b70 2023-11-25T04:09:08.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.863+0000 7ff29dd25640 1 --2- 172.21.15.2:0/2321309478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff298160b70 0x7ff2980d1570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff2980d2e30 tx=0x7ff29002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f29a1a92fc38da6 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.863+0000 7ff29cd23640 1 -- 172.21.15.2:0/2321309478 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290031830 con 0x7ff298160b70 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.863+0000 7ff29cd23640 1 -- 172.21.15.2:0/2321309478 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff290031990 con 0x7ff298160b70 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.863+0000 7ff29cd23640 1 -- 172.21.15.2:0/2321309478 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290031d20 con 0x7ff298160b70 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.863+0000 7ff29ff89640 1 -- 172.21.15.2:0/2321309478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff298160b70 msgr2=0x7ff2980d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.863+0000 7ff29ff89640 1 --2- 172.21.15.2:0/2321309478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff298160b70 0x7ff2980d1570 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff2980d2e30 tx=0x7ff29002b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.864+0000 7ff29ff89640 1 -- 172.21.15.2:0/2321309478 shutdown_connections 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.864+0000 7ff29ff89640 1 --2- 172.21.15.2:0/2321309478 >> v2:172.21.15.66:3300/0 conn(0x7ff2980b2aa0 0x7ff2980ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.864+0000 7ff29ff89640 1 --2- 172.21.15.2:0/2321309478 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff298160b70 0x7ff2980d1570 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.864+0000 7ff29ff89640 1 -- 172.21.15.2:0/2321309478 >> 172.21.15.2:0/2321309478 conn(0x7ff29809c470 msgr2=0x7ff2980d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.864+0000 7ff29ff89640 1 -- 172.21.15.2:0/2321309478 shutdown_connections 2023-11-25T04:09:08.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.864+0000 7ff29ff89640 1 -- 172.21.15.2:0/2321309478 wait complete. 2023-11-25T04:09:08.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.865+0000 7ff29ff89640 1 Processor -- start 2023-11-25T04:09:08.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.865+0000 7ff29ff89640 1 -- start start 2023-11-25T04:09:08.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29ff89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2980b2aa0 0x7ff2980b8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29ff89640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2980ced30 0x7ff298159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29ff89640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff298160b70 0x7ff2980cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29ff89640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980b6550 con 0x7ff2980ced30 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29ff89640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2980cd0a0 con 0x7ff2980b2aa0 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29ff89640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff298159d80 con 0x7ff298160b70 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29d524640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2980ced30 0x7ff298159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29d524640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2980ced30 0x7ff298159840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55892/0 (socket says 172.21.15.2:55892) 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29d524640 1 -- 172.21.15.2:0/374613259 learned_addr learned my addr 172.21.15.2:0/374613259 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29e526640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff298160b70 0x7ff2980cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29dd25640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2980b2aa0 0x7ff2980b8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29d524640 1 -- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff298160b70 msgr2=0x7ff2980cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29d524640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff298160b70 0x7ff2980cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29d524640 1 -- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2980b2aa0 msgr2=0x7ff2980b8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29d524640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2980b2aa0 0x7ff2980b8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29d524640 1 -- 172.21.15.2:0/374613259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff290009400 con 0x7ff2980ced30 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29e526640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff298160b70 0x7ff2980cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29dd25640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2980b2aa0 0x7ff2980b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29d524640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2980ced30 0x7ff298159840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00e9b0 tx=0x7ff28c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff2967fc640 1 -- 172.21.15.2:0/374613259 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c009670 con 0x7ff2980ced30 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff2967fc640 1 -- 172.21.15.2:0/374613259 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c00c9a0 con 0x7ff2980ced30 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2980ccb10 con 0x7ff2980ced30 2023-11-25T04:09:08.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff2967fc640 1 -- 172.21.15.2:0/374613259 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28c00cd50 con 0x7ff2980ced30 2023-11-25T04:09:08.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.866+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2980b5e90 con 0x7ff2980ced30 2023-11-25T04:09:08.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.867+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2980b5cf0 con 0x7ff2980ced30 2023-11-25T04:09:08.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.868+0000 7ff2967fc640 1 -- 172.21.15.2:0/374613259 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff28c013470 con 0x7ff2980ced30 2023-11-25T04:09:08.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.868+0000 7ff2967fc640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff28406ae40 0x7ff28406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:08.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.868+0000 7ff29dd25640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff28406ae40 0x7ff28406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:08.873 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.868+0000 7ff2967fc640 1 -- 172.21.15.2:0/374613259 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff28c089790 con 0x7ff2980ced30 2023-11-25T04:09:08.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.869+0000 7ff29dd25640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff28406ae40 0x7ff28406d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff290036000 tx=0x7ff29003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:08.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:08.872+0000 7ff2967fc640 1 -- 172.21.15.2:0/374613259 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2980b5cf0 con 0x7ff2980ced30 2023-11-25T04:09:09.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.046+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2980b5cf0 con 0x7ff2980ced30 2023-11-25T04:09:09.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.047+0000 7ff2967fc640 1 -- 172.21.15.2:0/374613259 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2980b5cf0 con 0x7ff2980ced30 2023-11-25T04:09:09.049 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:09.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff28406ae40 msgr2=0x7ff28406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff28406ae40 0x7ff28406d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff290036000 tx=0x7ff29003c040 comp rx=0 tx=0).stop 2023-11-25T04:09:09.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2980ced30 msgr2=0x7ff298159840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2980ced30 0x7ff298159840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff28c00e9b0 tx=0x7ff28c00ee70 comp rx=0 tx=0).stop 2023-11-25T04:09:09.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 shutdown_connections 2023-11-25T04:09:09.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff298160b70 0x7ff2980cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff2980ced30 0x7ff298159840 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff28406ae40 0x7ff28406d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 --2- 172.21.15.2:0/374613259 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2980b2aa0 0x7ff2980b8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.048+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 >> 172.21.15.2:0/374613259 conn(0x7ff29809c470 msgr2=0x7ff2980b3060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:09.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.049+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 shutdown_connections 2023-11-25T04:09:09.052 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.049+0000 7ff29ff89640 1 -- 172.21.15.2:0/374613259 wait complete. 2023-11-25T04:09:09.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.168+0000 7f9b64f16640 1 Processor -- start 2023-11-25T04:09:09.170 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.168+0000 7f9b64f16640 1 -- start start 2023-11-25T04:09:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b64f16640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 0x7f9b600ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b64f16640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9b6015ebf0 0x7f9b60099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b64f16640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9b600cd540 0x7f9b60099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b64f16640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b600b2260 con 0x7f9b6015ebf0 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b64f16640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b600cd170 con 0x7f9b600cd540 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b64f16640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b600b37b0 con 0x7f9b6015e810 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5dd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9b6015ebf0 0x7f9b60099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5dd9b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f9b6015ebf0 0x7f9b60099970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55906/0 (socket says 172.21.15.2:55906) 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5dd9b640 1 -- 172.21.15.2:0/719602233 learned_addr learned my addr 172.21.15.2:0/719602233 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5e59c640 1 --2- 172.21.15.2:0/719602233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 0x7f9b600ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5ed9d640 1 --2- 172.21.15.2:0/719602233 >> v2:172.21.15.66:3300/0 conn(0x7f9b600cd540 0x7f9b60099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5dd9b640 1 -- 172.21.15.2:0/719602233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 msgr2=0x7f9b600ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5dd9b640 1 --2- 172.21.15.2:0/719602233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 0x7f9b600ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5dd9b640 1 -- 172.21.15.2:0/719602233 >> v2:172.21.15.66:3300/0 conn(0x7f9b600cd540 msgr2=0x7f9b60099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:09.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5dd9b640 1 --2- 172.21.15.2:0/719602233 >> v2:172.21.15.66:3300/0 conn(0x7f9b600cd540 0x7f9b60099eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5dd9b640 1 -- 172.21.15.2:0/719602233 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b600cc720 con 0x7f9b6015ebf0 2023-11-25T04:09:09.173 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.169+0000 7f9b5e59c640 1 --2- 172.21.15.2:0/719602233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 0x7f9b600ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.170+0000 7f9b5dd9b640 1 --2- 172.21.15.2:0/719602233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 0x7f9b60099970 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9b6006e310 tx=0x7f9b4802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b8434431b1f4d5 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.170+0000 7f9b5d59a640 1 -- 172.21.15.2:0/719602233 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48030860 con 0x7f9b6015ebf0 2023-11-25T04:09:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.170+0000 7f9b5d59a640 1 -- 172.21.15.2:0/719602233 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b480309c0 con 0x7f9b6015ebf0 2023-11-25T04:09:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.170+0000 7f9b5d59a640 1 -- 172.21.15.2:0/719602233 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48030d50 con 0x7f9b6015ebf0 2023-11-25T04:09:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.171+0000 7f9b64f16640 1 -- 172.21.15.2:0/719602233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 msgr2=0x7f9b60099970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.171+0000 7f9b64f16640 1 --2- 172.21.15.2:0/719602233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 0x7f9b60099970 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9b6006e310 tx=0x7f9b4802b9a0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.171+0000 7f9b64f16640 1 -- 172.21.15.2:0/719602233 shutdown_connections 2023-11-25T04:09:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.171+0000 7f9b64f16640 1 --2- 172.21.15.2:0/719602233 >> v2:172.21.15.66:3300/0 conn(0x7f9b600cd540 0x7f9b60099eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.171+0000 7f9b64f16640 1 --2- 172.21.15.2:0/719602233 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 0x7f9b60099970 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.171+0000 7f9b64f16640 1 --2- 172.21.15.2:0/719602233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 0x7f9b600ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.171+0000 7f9b64f16640 1 -- 172.21.15.2:0/719602233 >> 172.21.15.2:0/719602233 conn(0x7f9b600b2a70 msgr2=0x7f9b600b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.171+0000 7f9b64f16640 1 -- 172.21.15.2:0/719602233 shutdown_connections 2023-11-25T04:09:09.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.171+0000 7f9b64f16640 1 -- 172.21.15.2:0/719602233 wait complete. 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.172+0000 7f9b64f16640 1 Processor -- start 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.172+0000 7f9b64f16640 1 -- start start 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b64f16640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b600cd540 0x7f9b6006d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b64f16640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 0x7f9b6014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b64f16640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 0x7f9b601e80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b64f16640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6006c300 con 0x7f9b6015ebf0 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b64f16640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6006d5f0 con 0x7f9b600cd540 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b64f16640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6006b680 con 0x7f9b6015e810 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 0x7f9b601e80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b5ed9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 0x7f9b601e80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55922/0 (socket says 172.21.15.2:55922) 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b5ed9d640 1 -- 172.21.15.2:0/1255415602 learned_addr learned my addr 172.21.15.2:0/1255415602 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b5dd9b640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 0x7f9b6014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.173+0000 7f9b5e59c640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b600cd540 0x7f9b6006d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b5ed9d640 1 -- 172.21.15.2:0/1255415602 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 msgr2=0x7f9b6014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b5ed9d640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 0x7f9b6014e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b5ed9d640 1 -- 172.21.15.2:0/1255415602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b600cd540 msgr2=0x7f9b6006d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b5ed9d640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b600cd540 0x7f9b6006d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b5ed9d640 1 -- 172.21.15.2:0/1255415602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b480094d0 con 0x7f9b6015ebf0 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b5ed9d640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 0x7f9b601e80f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9b50007e60 tx=0x7f9b5000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b56ffd640 1 -- 172.21.15.2:0/1255415602 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b50014620 con 0x7f9b6015ebf0 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b56ffd640 1 -- 172.21.15.2:0/1255415602 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5000ee90 con 0x7f9b6015ebf0 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6006b960 con 0x7f9b6015ebf0 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b56ffd640 1 -- 172.21.15.2:0/1255415602 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b500149e0 con 0x7f9b6015ebf0 2023-11-25T04:09:09.178 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.174+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6006bf20 con 0x7f9b6015ebf0 2023-11-25T04:09:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.175+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6006c440 con 0x7f9b6015ebf0 2023-11-25T04:09:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.176+0000 7f9b56ffd640 1 -- 172.21.15.2:0/1255415602 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b50014b40 con 0x7f9b6015ebf0 2023-11-25T04:09:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.176+0000 7f9b56ffd640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9b4006ae40 0x7f9b4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.179 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.176+0000 7f9b5e59c640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9b4006ae40 0x7f9b4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.176+0000 7f9b56ffd640 1 -- 172.21.15.2:0/1255415602 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b50089df0 con 0x7f9b6015ebf0 2023-11-25T04:09:09.180 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.177+0000 7f9b5e59c640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9b4006ae40 0x7f9b4006d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9b6006e2f0 tx=0x7f9b58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:09.182 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.180+0000 7f9b56ffd640 1 -- 172.21.15.2:0/1255415602 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b50054f50 con 0x7f9b6015ebf0 2023-11-25T04:09:09.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.356+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b6006c620 con 0x7f9b6015ebf0 2023-11-25T04:09:09.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.357+0000 7f9b56ffd640 1 -- 172.21.15.2:0/1255415602 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b50058570 con 0x7f9b6015ebf0 2023-11-25T04:09:09.359 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.358+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9b4006ae40 msgr2=0x7f9b4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.358+0000 7f9b64f16640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9b4006ae40 0x7f9b4006d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9b6006e2f0 tx=0x7f9b58008040 comp rx=0 tx=0).stop 2023-11-25T04:09:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 msgr2=0x7f9b601e80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 0x7f9b601e80f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9b50007e60 tx=0x7f9b5000e4b0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 shutdown_connections 2023-11-25T04:09:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f9b6015ebf0 0x7f9b601e80f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b6015e810 0x7f9b6014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.361 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f9b4006ae40 0x7f9b4006d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 --2- 172.21.15.2:0/1255415602 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b600cd540 0x7f9b6006d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 >> 172.21.15.2:0/1255415602 conn(0x7f9b600b2a70 msgr2=0x7f9b6015d580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 shutdown_connections 2023-11-25T04:09:09.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.359+0000 7f9b64f16640 1 -- 172.21.15.2:0/1255415602 wait complete. 2023-11-25T04:09:09.371 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:09.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.478+0000 7f5f28148640 1 Processor -- start 2023-11-25T04:09:09.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.478+0000 7f5f28148640 1 -- start start 2023-11-25T04:09:09.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.479+0000 7f5f28148640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f200b2aa0 0x7f5f20168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.479+0000 7f5f28148640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f200ce360 con 0x7f5f200d1570 2023-11-25T04:09:09.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.479+0000 7f5f28148640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f200d19f0 con 0x7f5f20160b70 2023-11-25T04:09:09.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.479+0000 7f5f28148640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f200cdd50 con 0x7f5f200b2aa0 2023-11-25T04:09:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.479+0000 7f5f266e5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5f200b2aa0 0x7f5f20168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.479+0000 7f5f256e3640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f5f200d1570 0x7f5f200cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48292/0 (socket says 172.21.15.2:48292) 2023-11-25T04:09:09.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.479+0000 7f5f256e3640 1 -- 172.21.15.2:0/57732572 learned_addr learned my addr 172.21.15.2:0/57732572 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.480+0000 7f5f266e5640 1 -- 172.21.15.2:0/57732572 >> v1:172.21.15.66:6789/0 conn(0x7f5f20160b70 legacy=0x7f5f200ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.480+0000 7f5f266e5640 1 -- 172.21.15.2:0/57732572 >> v1:172.21.15.2:6789/0 conn(0x7f5f200d1570 legacy=0x7f5f200cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.480+0000 7f5f266e5640 1 -- 172.21.15.2:0/57732572 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f200b2ed0 con 0x7f5f200b2aa0 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.480+0000 7f5f266e5640 1 --2- 172.21.15.2:0/57732572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200b2aa0 0x7f5f20168560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009d90 tx=0x7f5f1002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46256c6bed4de9c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f24ee2640 1 -- 172.21.15.2:0/57732572 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1002cc60 con 0x7f5f200b2aa0 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f24ee2640 1 -- 172.21.15.2:0/57732572 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1002cdc0 con 0x7f5f200b2aa0 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f24ee2640 1 -- 172.21.15.2:0/57732572 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10034660 con 0x7f5f200b2aa0 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f28148640 1 -- 172.21.15.2:0/57732572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200b2aa0 msgr2=0x7f5f20168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f28148640 1 --2- 172.21.15.2:0/57732572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200b2aa0 0x7f5f20168560 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009d90 tx=0x7f5f1002beb0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f28148640 1 -- 172.21.15.2:0/57732572 shutdown_connections 2023-11-25T04:09:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f28148640 1 --2- 172.21.15.2:0/57732572 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200b2aa0 0x7f5f20168560 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f28148640 1 -- 172.21.15.2:0/57732572 >> 172.21.15.2:0/57732572 conn(0x7f5f2009c470 msgr2=0x7f5f200d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f28148640 1 -- 172.21.15.2:0/57732572 shutdown_connections 2023-11-25T04:09:09.485 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.481+0000 7f5f28148640 1 -- 172.21.15.2:0/57732572 wait complete. 2023-11-25T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.482+0000 7f5f28148640 1 Processor -- start 2023-11-25T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.482+0000 7f5f28148640 1 -- start start 2023-11-25T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.483+0000 7f5f28148640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f200b2aa0 0x7f5f200ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.483+0000 7f5f28148640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200d1570 0x7f5f2015b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.483+0000 7f5f28148640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f20160b70 0x7f5f200cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.483+0000 7f5f28148640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f200b8b20 con 0x7f5f200d1570 2023-11-25T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.483+0000 7f5f28148640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f200cc860 con 0x7f5f20160b70 2023-11-25T04:09:09.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.483+0000 7f5f28148640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f200ccb40 con 0x7f5f200b2aa0 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.483+0000 7f5f256e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200d1570 0x7f5f2015b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.483+0000 7f5f256e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200d1570 0x7f5f2015b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55948/0 (socket says 172.21.15.2:55948) 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.483+0000 7f5f256e3640 1 -- 172.21.15.2:0/2338037272 learned_addr learned my addr 172.21.15.2:0/2338037272 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f266e5640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f20160b70 0x7f5f200cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f25ee4640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f200b2aa0 0x7f5f200ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f256e3640 1 -- 172.21.15.2:0/2338037272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f200b2aa0 msgr2=0x7f5f200ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f256e3640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f200b2aa0 0x7f5f200ca210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f256e3640 1 -- 172.21.15.2:0/2338037272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f20160b70 msgr2=0x7f5f200cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f256e3640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f20160b70 0x7f5f200cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f256e3640 1 -- 172.21.15.2:0/2338037272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f10009a70 con 0x7f5f200d1570 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f256e3640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200d1570 0x7f5f2015b6f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400c4a0 tx=0x7f5f1400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f1e7fc640 1 -- 172.21.15.2:0/2338037272 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14005ce0 con 0x7f5f200d1570 2023-11-25T04:09:09.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f1e7fc640 1 -- 172.21.15.2:0/2338037272 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f14005e40 con 0x7f5f200d1570 2023-11-25T04:09:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f200cce20 con 0x7f5f200d1570 2023-11-25T04:09:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f1e7fc640 1 -- 172.21.15.2:0/2338037272 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f14007270 con 0x7f5f200d1570 2023-11-25T04:09:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.484+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f20149a50 con 0x7f5f200d1570 2023-11-25T04:09:09.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.485+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f200cd340 con 0x7f5f200d1570 2023-11-25T04:09:09.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.486+0000 7f5f1e7fc640 1 -- 172.21.15.2:0/2338037272 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f14007490 con 0x7f5f200d1570 2023-11-25T04:09:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.486+0000 7f5f1e7fc640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5f0c06ae40 0x7f5f0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.486+0000 7f5f1e7fc640 1 -- 172.21.15.2:0/2338037272 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f14088ab0 con 0x7f5f200d1570 2023-11-25T04:09:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.486+0000 7f5f25ee4640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5f0c06ae40 0x7f5f0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.491 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.486+0000 7f5f25ee4640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5f0c06ae40 0x7f5f0c06d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5f18004f60 tx=0x7f5f18007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:09.492 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.490+0000 7f5f1e7fc640 1 -- 172.21.15.2:0/2338037272 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f200cd340 con 0x7f5f200d1570 2023-11-25T04:09:09.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.665+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f200cd340 con 0x7f5f200d1570 2023-11-25T04:09:09.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.666+0000 7f5f1e7fc640 1 -- 172.21.15.2:0/2338037272 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f200cd340 con 0x7f5f200d1570 2023-11-25T04:09:09.668 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:09.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5f0c06ae40 msgr2=0x7f5f0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5f0c06ae40 0x7f5f0c06d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5f18004f60 tx=0x7f5f18007e30 comp rx=0 tx=0).stop 2023-11-25T04:09:09.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200d1570 msgr2=0x7f5f2015b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200d1570 0x7f5f2015b6f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400c4a0 tx=0x7f5f1400c960 comp rx=0 tx=0).stop 2023-11-25T04:09:09.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 shutdown_connections 2023-11-25T04:09:09.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5f0c06ae40 0x7f5f0c06d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f20160b70 0x7f5f200cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5f200d1570 0x7f5f2015b6f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 --2- 172.21.15.2:0/2338037272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f200b2aa0 0x7f5f200ca210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 >> 172.21.15.2:0/2338037272 conn(0x7f5f2009c470 msgr2=0x7f5f2006b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:09.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 shutdown_connections 2023-11-25T04:09:09.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.668+0000 7f5f28148640 1 -- 172.21.15.2:0/2338037272 wait complete. 2023-11-25T04:09:09.681 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-25T04:09:09.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.787+0000 7f2b33c61640 1 Processor -- start 2023-11-25T04:09:09.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.787+0000 7f2b33c61640 1 -- start start 2023-11-25T04:09:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.788+0000 7f2b33c61640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2b2c13f750 0x7f2b2c15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.788+0000 7f2b33c61640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b2c13fb30 0x7f2b2c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.788+0000 7f2b33c61640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2c0ce060 con 0x7f2b2c15db40 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.788+0000 7f2b33c61640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c0cec70 con 0x7f2b2c13fb30 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.788+0000 7f2b33c61640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2c0ce340 con 0x7f2b2c13f750 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.788+0000 7f2b311fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b2c13fb30 0x7f2b2c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.788+0000 7f2b311fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2b2c13fb30 0x7f2b2c0cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55950/0 (socket says 172.21.15.2:55950) 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.789+0000 7f2b311fc640 1 -- 172.21.15.2:0/1104219824 learned_addr learned my addr 172.21.15.2:0/1104219824 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.789+0000 7f2b319fd640 1 --2- 172.21.15.2:0/1104219824 >> v2:172.21.15.66:3300/0 conn(0x7f2b2c13f750 0x7f2b2c15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.789+0000 7f2b311fc640 1 -- 172.21.15.2:0/1104219824 >> v2:172.21.15.66:3300/0 conn(0x7f2b2c13f750 msgr2=0x7f2b2c15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.789+0000 7f2b311fc640 1 --2- 172.21.15.2:0/1104219824 >> v2:172.21.15.66:3300/0 conn(0x7f2b2c13f750 0x7f2b2c15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.789+0000 7f2b311fc640 1 -- 172.21.15.2:0/1104219824 >> v1:172.21.15.66:6789/0 conn(0x7f2b2c15db40 legacy=0x7f2b2c15dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.789+0000 7f2b311fc640 1 -- 172.21.15.2:0/1104219824 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c0ce620 con 0x7f2b2c13fb30 2023-11-25T04:09:09.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b311fc640 1 --2- 172.21.15.2:0/1104219824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c13fb30 0x7f2b2c0cd7c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c071f40 tx=0x7f2b1c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d0d78b8eae7c07 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:09.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b309fb640 1 -- 172.21.15.2:0/1104219824 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c030860 con 0x7f2b2c13fb30 2023-11-25T04:09:09.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b309fb640 1 -- 172.21.15.2:0/1104219824 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c0309c0 con 0x7f2b2c13fb30 2023-11-25T04:09:09.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b309fb640 1 -- 172.21.15.2:0/1104219824 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c030d50 con 0x7f2b2c13fb30 2023-11-25T04:09:09.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b33c61640 1 -- 172.21.15.2:0/1104219824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c13fb30 msgr2=0x7f2b2c0cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b33c61640 1 --2- 172.21.15.2:0/1104219824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c13fb30 0x7f2b2c0cd7c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c071f40 tx=0x7f2b1c02b9a0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b33c61640 1 -- 172.21.15.2:0/1104219824 shutdown_connections 2023-11-25T04:09:09.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b33c61640 1 --2- 172.21.15.2:0/1104219824 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c13fb30 0x7f2b2c0cd7c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b33c61640 1 --2- 172.21.15.2:0/1104219824 >> v2:172.21.15.66:3300/0 conn(0x7f2b2c13f750 0x7f2b2c15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b33c61640 1 -- 172.21.15.2:0/1104219824 >> 172.21.15.2:0/1104219824 conn(0x7f2b2c06a8f0 msgr2=0x7f2b2c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:09.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b33c61640 1 -- 172.21.15.2:0/1104219824 shutdown_connections 2023-11-25T04:09:09.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.790+0000 7f2b33c61640 1 -- 172.21.15.2:0/1104219824 wait complete. 2023-11-25T04:09:09.794 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.792+0000 7f2b33c61640 1 Processor -- start 2023-11-25T04:09:09.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.792+0000 7f2b33c61640 1 -- start start 2023-11-25T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.792+0000 7f2b33c61640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b2c13f750 0x7f2b2c0ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.792+0000 7f2b33c61640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b2c13fb30 0x7f2b2c14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.792+0000 7f2b33c61640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c15db40 0x7f2b2c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.792+0000 7f2b33c61640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c14d330 con 0x7f2b2c15db40 2023-11-25T04:09:09.796 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.792+0000 7f2b33c61640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c0ad6b0 con 0x7f2b2c13f750 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.792+0000 7f2b33c61640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2c0ad990 con 0x7f2b2c13fb30 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b321fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c15db40 0x7f2b2c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b321fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c15db40 0x7f2b2c15beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55958/0 (socket says 172.21.15.2:55958) 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b321fe640 1 -- 172.21.15.2:0/760275692 learned_addr learned my addr 172.21.15.2:0/760275692 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b319fd640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b2c13f750 0x7f2b2c0ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b311fc640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b2c13fb30 0x7f2b2c14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b321fe640 1 -- 172.21.15.2:0/760275692 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b2c13fb30 msgr2=0x7f2b2c14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b321fe640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b2c13fb30 0x7f2b2c14cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b321fe640 1 -- 172.21.15.2:0/760275692 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b2c13f750 msgr2=0x7f2b2c0ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b321fe640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b2c13f750 0x7f2b2c0ad080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b321fe640 1 -- 172.21.15.2:0/760275692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c0094d0 con 0x7f2b2c15db40 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b321fe640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c15db40 0x7f2b2c15beb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c7a0 tx=0x7f2b2400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:09.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b227fc640 1 -- 172.21.15.2:0/760275692 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24003b70 con 0x7f2b2c15db40 2023-11-25T04:09:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b227fc640 1 -- 172.21.15.2:0/760275692 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24003cf0 con 0x7f2b2c15db40 2023-11-25T04:09:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2c0adc70 con 0x7f2b2c15db40 2023-11-25T04:09:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b227fc640 1 -- 172.21.15.2:0/760275692 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24003ea0 con 0x7f2b2c15db40 2023-11-25T04:09:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.793+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b2c14d770 con 0x7f2b2c15db40 2023-11-25T04:09:09.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.794+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2c072ae0 con 0x7f2b2c15db40 2023-11-25T04:09:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.795+0000 7f2b227fc640 1 -- 172.21.15.2:0/760275692 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b2400aa90 con 0x7f2b2c15db40 2023-11-25T04:09:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.795+0000 7f2b227fc640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2b1006ae40 0x7f2b1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.795+0000 7f2b227fc640 1 -- 172.21.15.2:0/760275692 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b24089470 con 0x7f2b2c15db40 2023-11-25T04:09:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.795+0000 7f2b319fd640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2b1006ae40 0x7f2b1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:09.799 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.796+0000 7f2b319fd640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2b1006ae40 0x7f2b1006d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b28006fd0 tx=0x7f2b28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.799+0000 7f2b227fc640 1 -- 172.21.15.2:0/760275692 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b24054520 con 0x7f2b2c15db40 2023-11-25T04:09:09.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.989+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2b2c15d560 con 0x7f2b2c15db40 2023-11-25T04:09:09.991 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.989+0000 7f2b227fc640 1 -- 172.21.15.2:0/760275692 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2b24057b40 con 0x7f2b2c15db40 2023-11-25T04:09:09.992 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.991+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2b1006ae40 msgr2=0x7f2b1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.991+0000 7f2b33c61640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2b1006ae40 0x7f2b1006d300 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2b28006fd0 tx=0x7f2b28008040 comp rx=0 tx=0).stop 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.991+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c15db40 msgr2=0x7f2b2c15beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.991+0000 7f2b33c61640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c15db40 0x7f2b2c15beb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c7a0 tx=0x7f2b2400cc60 comp rx=0 tx=0).stop 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.991+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 shutdown_connections 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.991+0000 7f2b33c61640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2b2c15db40 0x7f2b2c15beb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.992+0000 7f2b33c61640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b2c13fb30 0x7f2b2c14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.992+0000 7f2b33c61640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2b1006ae40 0x7f2b1006d300 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.992+0000 7f2b33c61640 1 --2- 172.21.15.2:0/760275692 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b2c13f750 0x7f2b2c0ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.992+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 >> 172.21.15.2:0/760275692 conn(0x7f2b2c06a8f0 msgr2=0x7f2b2c06d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:09.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.992+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 shutdown_connections 2023-11-25T04:09:09.995 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:09.992+0000 7f2b33c61640 1 -- 172.21.15.2:0/760275692 wait complete. 2023-11-25T04:09:10.004 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-25T04:09:10.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:10.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-11-25T04:09:10.036 INFO:teuthology.orchestra.run:waiting for 300 2023-11-25T04:09:10.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T04:09:10.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:10.036 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-25T04:09:10.095 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:09:10.095 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:10.115 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:09:10.115 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:10.174 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:10.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.279+0000 7f5376290640 1 Processor -- start 2023-11-25T04:09:10.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.279+0000 7f5376290640 1 -- start start 2023-11-25T04:09:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.280+0000 7f5376290640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370071f00 0x7f53700b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.280+0000 7f5376290640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5370072390 con 0x7f537006dc30 2023-11-25T04:09:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.280+0000 7f5376290640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53700b3130 con 0x7f5370142d20 2023-11-25T04:09:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.280+0000 7f5376290640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53700b2330 con 0x7f5370071f00 2023-11-25T04:09:10.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.280+0000 7f536f7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f537006dc30 0x7f53700cc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48308/0 (socket says 172.21.15.2:48308) 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.280+0000 7f536f7fe640 1 -- 172.21.15.2:0/860593109 learned_addr learned my addr 172.21.15.2:0/860593109 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f537482d640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370071f00 0x7f53700b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180548826 0 0) 0x7f5364001110 con 0x7f537006dc30 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5358003520 con 0x7f537006dc30 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373320450 0 0) 0x7f53700b3130 con 0x7f5370142d20 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5364001110 con 0x7f5370142d20 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3134217902 0 0) 0x7f5358003520 con 0x7f537006dc30 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370071f00 msgr2=0x7f53700b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370071f00 0x7f53700b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 >> v1:172.21.15.66:6789/0 conn(0x7f5370142d20 legacy=0x7f537006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5370143100 con 0x7f537006dc30 2023-11-25T04:09:10.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f5364001800 con 0x7f537006dc30 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 >> v1:172.21.15.2:6789/0 conn(0x7f537006dc30 legacy=0x7f53700cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370071f00 0x7f5358003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358004090 0x7f53580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5358004d00 0x7f5358005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535800ba30 con 0x7f5358004090 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535800bba0 con 0x7f5358004d00 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535800bd60 con 0x7f5370071f00 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536f7fe640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358004090 0x7f53580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536ffff640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370071f00 0x7f5358003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f537482d640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5358004d00 0x7f5358005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536f7fe640 1 -- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370071f00 msgr2=0x7f5358003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.281+0000 7f536f7fe640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370071f00 0x7f5358003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.282+0000 7f536f7fe640 1 -- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5358004d00 msgr2=0x7f5358005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.282+0000 7f536f7fe640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5358004d00 0x7f5358005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.282+0000 7f536f7fe640 1 -- 172.21.15.2:0/860593109 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5358003520 con 0x7f5358004090 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.282+0000 7f536f7fe640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358004090 0x7f53580047c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f536400c110 tx=0x7f53580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce770ac898f9922 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.282+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364005ad0 con 0x7f5358004090 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.282+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5364005c30 con 0x7f5358004090 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.282+0000 7f536effd640 1 -- 172.21.15.2:0/860593109 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536402ca30 con 0x7f5358004090 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.283+0000 7f5376290640 1 -- 172.21.15.2:0/860593109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358004090 msgr2=0x7f53580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.283+0000 7f5376290640 1 --2- 172.21.15.2:0/860593109 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5358004090 0x7f53580047c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f536400c110 tx=0x7f53580057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.283+0000 7f537482d640 1 -- 172.21.15.2:0/860593109 reap_dead start 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.283+0000 7f5376290640 1 -- 172.21.15.2:0/860593109 shutdown_connections 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.283+0000 7f5376290640 1 -- 172.21.15.2:0/860593109 >> 172.21.15.2:0/860593109 conn(0x7f53700b0af0 msgr2=0x7f53700b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.283+0000 7f5376290640 1 -- 172.21.15.2:0/860593109 shutdown_connections 2023-11-25T04:09:10.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.283+0000 7f5376290640 1 -- 172.21.15.2:0/860593109 wait complete. 2023-11-25T04:09:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.284+0000 7f5376290640 1 Processor -- start 2023-11-25T04:09:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.284+0000 7f5376290640 1 -- start start 2023-11-25T04:09:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.285+0000 7f5376290640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5358004090 0x7f5370159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.285+0000 7f5376290640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53701396a0 0x7f53700ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.285+0000 7f5376290640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370139b20 0x7f53700cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.285+0000 7f5376290640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537013d830 con 0x7f53701396a0 2023-11-25T04:09:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.285+0000 7f5376290640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537013db10 con 0x7f5358004090 2023-11-25T04:09:10.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.285+0000 7f5376290640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f537013ddf0 con 0x7f5370139b20 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.285+0000 7f536f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53701396a0 0x7f53700ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.285+0000 7f536f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53701396a0 0x7f53700ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55974/0 (socket says 172.21.15.2:55974) 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.285+0000 7f536f7fe640 1 -- 172.21.15.2:0/3618751730 learned_addr learned my addr 172.21.15.2:0/3618751730 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f537482d640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370139b20 0x7f53700cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536f7fe640 1 -- 172.21.15.2:0/3618751730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370139b20 msgr2=0x7f53700cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536ffff640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5358004090 0x7f5370159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536f7fe640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370139b20 0x7f53700cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536f7fe640 1 -- 172.21.15.2:0/3618751730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5358004090 msgr2=0x7f5370159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536f7fe640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5358004090 0x7f5370159940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536f7fe640 1 -- 172.21.15.2:0/3618751730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f537013e0d0 con 0x7f53701396a0 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536f7fe640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53701396a0 0x7f53700ccd10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f536402c3b0 tx=0x7f53700b30a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536cff9640 1 -- 172.21.15.2:0/3618751730 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5364039070 con 0x7f53701396a0 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536cff9640 1 -- 172.21.15.2:0/3618751730 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f536402dcb0 con 0x7f53701396a0 2023-11-25T04:09:10.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f536cff9640 1 -- 172.21.15.2:0/3618751730 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f536403c040 con 0x7f53701396a0 2023-11-25T04:09:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537013e3b0 con 0x7f53701396a0 2023-11-25T04:09:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.286+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537013d3c0 con 0x7f53701396a0 2023-11-25T04:09:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.287+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537013df30 con 0x7f53701396a0 2023-11-25T04:09:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.287+0000 7f536cff9640 1 -- 172.21.15.2:0/3618751730 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5364032070 con 0x7f53701396a0 2023-11-25T04:09:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.288+0000 7f536cff9640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f535c06ae70 0x7f535c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.288+0000 7f536cff9640 1 -- 172.21.15.2:0/3618751730 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53640aa690 con 0x7f53701396a0 2023-11-25T04:09:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.288+0000 7f536ffff640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f535c06ae70 0x7f535c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.288+0000 7f536ffff640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f535c06ae70 0x7f535c06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5360005530 tx=0x7f5360009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:10.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.292+0000 7f536cff9640 1 -- 172.21.15.2:0/3618751730 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f537013df30 con 0x7f53701396a0 2023-11-25T04:09:10.470 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.468+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5370072390 con 0x7f53701396a0 2023-11-25T04:09:10.471 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.469+0000 7f536cff9640 1 -- 172.21.15.2:0/3618751730 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f5370072390 con 0x7f53701396a0 2023-11-25T04:09:10.472 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:10.472 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f535c06ae70 msgr2=0x7f535c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f535c06ae70 0x7f535c06d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5360005530 tx=0x7f5360009040 comp rx=0 tx=0).stop 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53701396a0 msgr2=0x7f53700ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53701396a0 0x7f53700ccd10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f536402c3b0 tx=0x7f53700b30a0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 shutdown_connections 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5370139b20 0x7f53700cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f53701396a0 0x7f53700ccd10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f535c06ae70 0x7f535c06d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 --2- 172.21.15.2:0/3618751730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5358004090 0x7f5370159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.471+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 >> 172.21.15.2:0/3618751730 conn(0x7f53700b0af0 msgr2=0x7f53700b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:10.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.472+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 shutdown_connections 2023-11-25T04:09:10.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.472+0000 7f5376290640 1 -- 172.21.15.2:0/3618751730 wait complete. 2023-11-25T04:09:10.485 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:10.485 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:10.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.592+0000 7f6cd7ce7640 1 Processor -- start 2023-11-25T04:09:10.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.593+0000 7f6cd7ce7640 1 -- start start 2023-11-25T04:09:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.593+0000 7f6cd7ce7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd00d1570 0x7f6cd00b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.593+0000 7f6cd7ce7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6cd00cef00 0x7f6cd0161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.593+0000 7f6cd7ce7640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd00ce360 con 0x7f6cd0160b70 2023-11-25T04:09:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.593+0000 7f6cd7ce7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd00d19f0 con 0x7f6cd00cef00 2023-11-25T04:09:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.593+0000 7f6cd7ce7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00cdd50 con 0x7f6cd00d1570 2023-11-25T04:09:10.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd6284640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6cd00cef00 0x7f6cd0161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd5a83640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6cd0160b70 0x7f6cd00ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48316/0 (socket says 172.21.15.2:48316) 2023-11-25T04:09:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd5a83640 1 -- 172.21.15.2:0/2049910266 learned_addr learned my addr 172.21.15.2:0/2049910266 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd5282640 1 --2- 172.21.15.2:0/2049910266 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd00d1570 0x7f6cd00b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd6284640 1 -- 172.21.15.2:0/2049910266 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd00d1570 msgr2=0x7f6cd00b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd6284640 1 --2- 172.21.15.2:0/2049910266 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd00d1570 0x7f6cd00b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd6284640 1 -- 172.21.15.2:0/2049910266 >> v1:172.21.15.2:6789/0 conn(0x7f6cd0160b70 legacy=0x7f6cd00ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd6284640 1 -- 172.21.15.2:0/2049910266 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd00d1c70 con 0x7f6cd00cef00 2023-11-25T04:09:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd4a81640 1 -- 172.21.15.2:0/2049910266 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971421342 0 0) 0x7f6cd00ce360 con 0x7f6cd0160b70 2023-11-25T04:09:10.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.594+0000 7f6cd5282640 1 --2- 172.21.15.2:0/2049910266 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd00d1570 0x7f6cd00b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd6284640 1 --2- 172.21.15.2:0/2049910266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 0x7f6cd0161230 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009d90 tx=0x7f6cc802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8844cfa09a4f8b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd4a81640 1 -- 172.21.15.2:0/2049910266 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc802cc50 con 0x7f6cd00cef00 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd4a81640 1 -- 172.21.15.2:0/2049910266 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc802cdb0 con 0x7f6cd00cef00 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd4a81640 1 -- 172.21.15.2:0/2049910266 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc8034660 con 0x7f6cd00cef00 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/2049910266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 msgr2=0x7f6cd0161230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd7ce7640 1 --2- 172.21.15.2:0/2049910266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 0x7f6cd0161230 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6cc8009d90 tx=0x7f6cc802bea0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/2049910266 shutdown_connections 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd7ce7640 1 --2- 172.21.15.2:0/2049910266 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 0x7f6cd0161230 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd7ce7640 1 --2- 172.21.15.2:0/2049910266 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd00d1570 0x7f6cd00b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/2049910266 >> 172.21.15.2:0/2049910266 conn(0x7f6cd009c470 msgr2=0x7f6cd00d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:10.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/2049910266 shutdown_connections 2023-11-25T04:09:10.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.595+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/2049910266 wait complete. 2023-11-25T04:09:10.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd7ce7640 1 Processor -- start 2023-11-25T04:09:10.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd7ce7640 1 -- start start 2023-11-25T04:09:10.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd7ce7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 0x7f6cd014b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd7ce7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd00d1570 0x7f6cd015fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd7ce7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd0160b70 0x7f6cd015ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd7ce7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd00c9500 con 0x7f6cd00cef00 2023-11-25T04:09:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd7ce7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd015dcc0 con 0x7f6cd00d1570 2023-11-25T04:09:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd7ce7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd015df60 con 0x7f6cd0160b70 2023-11-25T04:09:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd5a83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 0x7f6cd014b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd5a83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 0x7f6cd014b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55986/0 (socket says 172.21.15.2:55986) 2023-11-25T04:09:10.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.597+0000 7f6cd5a83640 1 -- 172.21.15.2:0/574793347 learned_addr learned my addr 172.21.15.2:0/574793347 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:10.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd5282640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd00d1570 0x7f6cd015fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd6284640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd0160b70 0x7f6cd015ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd5a83640 1 -- 172.21.15.2:0/574793347 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd0160b70 msgr2=0x7f6cd015ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd5a83640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd0160b70 0x7f6cd015ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd5a83640 1 -- 172.21.15.2:0/574793347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd00d1570 msgr2=0x7f6cd015fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd5a83640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd00d1570 0x7f6cd015fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd5a83640 1 -- 172.21.15.2:0/574793347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc8009a70 con 0x7f6cd00cef00 2023-11-25T04:09:10.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd5a83640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 0x7f6cd014b210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c430 tx=0x7f6ccc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:10.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cc67fc640 1 -- 172.21.15.2:0/574793347 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc0074e0 con 0x7f6cd00cef00 2023-11-25T04:09:10.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cc67fc640 1 -- 172.21.15.2:0/574793347 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ccc007660 con 0x7f6cd00cef00 2023-11-25T04:09:10.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cc67fc640 1 -- 172.21.15.2:0/574793347 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ccc004a20 con 0x7f6cd00cef00 2023-11-25T04:09:10.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd015e240 con 0x7f6cd00cef00 2023-11-25T04:09:10.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.598+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd015e800 con 0x7f6cd00cef00 2023-11-25T04:09:10.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.599+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd00a1150 con 0x7f6cd00cef00 2023-11-25T04:09:10.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.600+0000 7f6cc67fc640 1 -- 172.21.15.2:0/574793347 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ccc004b80 con 0x7f6cd00cef00 2023-11-25T04:09:10.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.600+0000 7f6cc67fc640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6cb406ae40 0x7f6cb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.600+0000 7f6cd5282640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6cb406ae40 0x7f6cb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.600+0000 7f6cc67fc640 1 -- 172.21.15.2:0/574793347 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ccc089380 con 0x7f6cd00cef00 2023-11-25T04:09:10.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.600+0000 7f6cd5282640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6cb406ae40 0x7f6cb406d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00b8e00 tx=0x7f6cc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:10.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.604+0000 7f6cc67fc640 1 -- 172.21.15.2:0/574793347 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ccc054450 con 0x7f6cd00cef00 2023-11-25T04:09:10.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.783+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6cd00b8e30 con 0x7f6cd00cef00 2023-11-25T04:09:10.785 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.783+0000 7f6cc67fc640 1 -- 172.21.15.2:0/574793347 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ccc057a70 con 0x7f6cd00cef00 2023-11-25T04:09:10.785 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6cb406ae40 msgr2=0x7f6cb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6cb406ae40 0x7f6cb406d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6cd00b8e00 tx=0x7f6cc0008040 comp rx=0 tx=0).stop 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 msgr2=0x7f6cd014b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 0x7f6cd014b210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc00c430 tx=0x7f6ccc00c8f0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 shutdown_connections 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6cd0160b70 0x7f6cd015ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6cb406ae40 0x7f6cb406d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6cd00d1570 0x7f6cd015fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 --2- 172.21.15.2:0/574793347 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6cd00cef00 0x7f6cd014b210 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.785+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 >> 172.21.15.2:0/574793347 conn(0x7f6cd009c470 msgr2=0x7f6cd006b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:10.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.786+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 shutdown_connections 2023-11-25T04:09:10.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.786+0000 7f6cd7ce7640 1 -- 172.21.15.2:0/574793347 wait complete. 2023-11-25T04:09:10.798 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.906+0000 7fb408031640 1 Processor -- start 2023-11-25T04:09:10.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.906+0000 7fb408031640 1 -- start start 2023-11-25T04:09:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb408031640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb400144a50 0x7fb40015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb408031640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb40006a4d0 0x7fb40006a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb408031640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4000cfde0 0x7fb4000d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb408031640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40006aea0 con 0x7fb400144a50 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb408031640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4000b2ee0 con 0x7fb40006a4d0 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb408031640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4000b34a0 con 0x7fb4000cfde0 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb405dcd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb400144a50 0x7fb40015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb405dcd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb400144a50 0x7fb40015f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55990/0 (socket says 172.21.15.2:55990) 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb405dcd640 1 -- 172.21.15.2:0/4045140597 learned_addr learned my addr 172.21.15.2:0/4045140597 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb4065ce640 1 --2- 172.21.15.2:0/4045140597 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4000cfde0 0x7fb4000d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb4055cc640 1 --2- 172.21.15.2:0/4045140597 >> v2:172.21.15.66:3300/0 conn(0x7fb40006a4d0 0x7fb40006a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb405dcd640 1 -- 172.21.15.2:0/4045140597 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4000cfde0 msgr2=0x7fb4000d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb405dcd640 1 --2- 172.21.15.2:0/4045140597 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4000cfde0 0x7fb4000d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb405dcd640 1 -- 172.21.15.2:0/4045140597 >> v2:172.21.15.66:3300/0 conn(0x7fb40006a4d0 msgr2=0x7fb40006a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb405dcd640 1 --2- 172.21.15.2:0/4045140597 >> v2:172.21.15.66:3300/0 conn(0x7fb40006a4d0 0x7fb40006a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.907+0000 7fb405dcd640 1 -- 172.21.15.2:0/4045140597 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb400144e30 con 0x7fb400144a50 2023-11-25T04:09:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.908+0000 7fb405dcd640 1 --2- 172.21.15.2:0/4045140597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb400144a50 0x7fb40015f680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb400072a70 tx=0x7fb3fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4396adae246f8a39 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.908+0000 7fb404dcb640 1 -- 172.21.15.2:0/4045140597 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc031870 con 0x7fb400144a50 2023-11-25T04:09:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.908+0000 7fb404dcb640 1 -- 172.21.15.2:0/4045140597 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0319d0 con 0x7fb400144a50 2023-11-25T04:09:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.908+0000 7fb404dcb640 1 -- 172.21.15.2:0/4045140597 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc031d60 con 0x7fb400144a50 2023-11-25T04:09:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.909+0000 7fb408031640 1 -- 172.21.15.2:0/4045140597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb400144a50 msgr2=0x7fb40015f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.909+0000 7fb408031640 1 --2- 172.21.15.2:0/4045140597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb400144a50 0x7fb40015f680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb400072a70 tx=0x7fb3fc02b910 comp rx=0 tx=0).stop 2023-11-25T04:09:10.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.909+0000 7fb408031640 1 -- 172.21.15.2:0/4045140597 shutdown_connections 2023-11-25T04:09:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.909+0000 7fb408031640 1 --2- 172.21.15.2:0/4045140597 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4000cfde0 0x7fb4000d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.909+0000 7fb408031640 1 --2- 172.21.15.2:0/4045140597 >> v2:172.21.15.66:3300/0 conn(0x7fb40006a4d0 0x7fb40006a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.909+0000 7fb408031640 1 --2- 172.21.15.2:0/4045140597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb400144a50 0x7fb40015f680 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.909+0000 7fb408031640 1 -- 172.21.15.2:0/4045140597 >> 172.21.15.2:0/4045140597 conn(0x7fb4000cc930 msgr2=0x7fb4000ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.909+0000 7fb408031640 1 -- 172.21.15.2:0/4045140597 shutdown_connections 2023-11-25T04:09:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.909+0000 7fb408031640 1 -- 172.21.15.2:0/4045140597 wait complete. 2023-11-25T04:09:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.910+0000 7fb408031640 1 Processor -- start 2023-11-25T04:09:10.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.910+0000 7fb408031640 1 -- start start 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb408031640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb40006a4d0 0x7fb40013d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb408031640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4000cfde0 0x7fb4000b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb408031640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb400144a50 0x7fb4000b1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb408031640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4001e64d0 con 0x7fb40006a4d0 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb408031640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4001e5850 con 0x7fb4000cfde0 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb408031640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4001e5b30 con 0x7fb400144a50 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb405dcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb40006a4d0 0x7fb40013d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb405dcd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb40006a4d0 0x7fb40013d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55998/0 (socket says 172.21.15.2:55998) 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb405dcd640 1 -- 172.21.15.2:0/210394936 learned_addr learned my addr 172.21.15.2:0/210394936 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb4065ce640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb400144a50 0x7fb4000b1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb4055cc640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4000cfde0 0x7fb4000b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb405dcd640 1 -- 172.21.15.2:0/210394936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb400144a50 msgr2=0x7fb4000b1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb405dcd640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb400144a50 0x7fb4000b1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb405dcd640 1 -- 172.21.15.2:0/210394936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4000cfde0 msgr2=0x7fb4000b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb405dcd640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4000cfde0 0x7fb4000b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb405dcd640 1 -- 172.21.15.2:0/210394936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc0094d0 con 0x7fb40006a4d0 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb4055cc640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4000cfde0 0x7fb4000b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.911+0000 7fb405dcd640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb40006a4d0 0x7fb40013d970 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc000c00 tx=0x7fb3fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.912+0000 7fb3f67fc640 1 -- 172.21.15.2:0/210394936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc03ac60 con 0x7fb40006a4d0 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.912+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4001e5e10 con 0x7fb40006a4d0 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.912+0000 7fb3f67fc640 1 -- 172.21.15.2:0/210394936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc03adc0 con 0x7fb40006a4d0 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.912+0000 7fb3f67fc640 1 -- 172.21.15.2:0/210394936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc044630 con 0x7fb40006a4d0 2023-11-25T04:09:10.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.912+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb40013deb0 con 0x7fb40006a4d0 2023-11-25T04:09:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.912+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb40006e6a0 con 0x7fb40006a4d0 2023-11-25T04:09:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.913+0000 7fb3f67fc640 1 -- 172.21.15.2:0/210394936 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb3fc04d450 con 0x7fb40006a4d0 2023-11-25T04:09:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.913+0000 7fb3f67fc640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb3e406ae40 0x7fb3e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.913+0000 7fb3f67fc640 1 -- 172.21.15.2:0/210394936 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3fc02d040 con 0x7fb40006a4d0 2023-11-25T04:09:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.913+0000 7fb4055cc640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb3e406ae40 0x7fb3e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.914+0000 7fb4055cc640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb3e406ae40 0x7fb3e406d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb40006fa10 tx=0x7fb3f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:10.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:10.918+0000 7fb3f67fc640 1 -- 172.21.15.2:0/210394936 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3fc076c70 con 0x7fb40006a4d0 2023-11-25T04:09:11.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.094+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb40004e920 con 0x7fb40006a4d0 2023-11-25T04:09:11.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.094+0000 7fb3f67fc640 1 -- 172.21.15.2:0/210394936 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3fc07a290 con 0x7fb40006a4d0 2023-11-25T04:09:11.096 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:11.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb3e406ae40 msgr2=0x7fb3e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb3e406ae40 0x7fb3e406d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb40006fa10 tx=0x7fb3f0008040 comp rx=0 tx=0).stop 2023-11-25T04:09:11.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb40006a4d0 msgr2=0x7fb40013d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb40006a4d0 0x7fb40013d970 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc000c00 tx=0x7fb3fc0046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 shutdown_connections 2023-11-25T04:09:11.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb400144a50 0x7fb4000b1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb3e406ae40 0x7fb3e406d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4000cfde0 0x7fb4000b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 --2- 172.21.15.2:0/210394936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb40006a4d0 0x7fb40013d970 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 >> 172.21.15.2:0/210394936 conn(0x7fb4000cc930 msgr2=0x7fb4000ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:11.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 shutdown_connections 2023-11-25T04:09:11.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.096+0000 7fb408031640 1 -- 172.21.15.2:0/210394936 wait complete. 2023-11-25T04:09:11.109 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.217+0000 7f476b733640 1 Processor -- start 2023-11-25T04:09:11.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.217+0000 7f476b733640 1 -- start start 2023-11-25T04:09:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f476b733640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f476413f750 0x7f476415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f476b733640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47640ce060 con 0x7f4764070630 2023-11-25T04:09:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f476b733640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47640ce340 con 0x7f476413fb30 2023-11-25T04:09:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f476b733640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47640cec70 con 0x7f476413f750 2023-11-25T04:09:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f47694cf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f476413f750 0x7f476415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f4769cd0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4764070630 0x7f4764070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48326/0 (socket says 172.21.15.2:48326) 2023-11-25T04:09:11.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f4769cd0640 1 -- 172.21.15.2:0/3274526906 learned_addr learned my addr 172.21.15.2:0/3274526906 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:11.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f47694cf640 1 -- 172.21.15.2:0/3274526906 >> v1:172.21.15.66:6789/0 conn(0x7f476413fb30 legacy=0x7f47640cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:11.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f47694cf640 1 -- 172.21.15.2:0/3274526906 >> v1:172.21.15.2:6789/0 conn(0x7f4764070630 legacy=0x7f4764070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.221 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.218+0000 7f47694cf640 1 -- 172.21.15.2:0/3274526906 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47640ce620 con 0x7f476413f750 2023-11-25T04:09:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.219+0000 7f47694cf640 1 --2- 172.21.15.2:0/3274526906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476413f750 0x7f476415b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47600097a0 tx=0x7f476002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c198af6197e4edc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.219+0000 7f475bfff640 1 -- 172.21.15.2:0/3274526906 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760031830 con 0x7f476413f750 2023-11-25T04:09:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.219+0000 7f475bfff640 1 -- 172.21.15.2:0/3274526906 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4760031990 con 0x7f476413f750 2023-11-25T04:09:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.219+0000 7f475bfff640 1 -- 172.21.15.2:0/3274526906 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4760031d20 con 0x7f476413f750 2023-11-25T04:09:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.220+0000 7f476b733640 1 -- 172.21.15.2:0/3274526906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476413f750 msgr2=0x7f476415b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.220+0000 7f476b733640 1 --2- 172.21.15.2:0/3274526906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476413f750 0x7f476415b0d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f47600097a0 tx=0x7f476002b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.220+0000 7f476b733640 1 -- 172.21.15.2:0/3274526906 shutdown_connections 2023-11-25T04:09:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.220+0000 7f476b733640 1 --2- 172.21.15.2:0/3274526906 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f476413f750 0x7f476415b0d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.222 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.220+0000 7f476b733640 1 -- 172.21.15.2:0/3274526906 >> 172.21.15.2:0/3274526906 conn(0x7f476406a8f0 msgr2=0x7f476406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:11.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.220+0000 7f476b733640 1 -- 172.21.15.2:0/3274526906 shutdown_connections 2023-11-25T04:09:11.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.220+0000 7f476b733640 1 -- 172.21.15.2:0/3274526906 wait complete. 2023-11-25T04:09:11.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.221+0000 7f476b733640 1 Processor -- start 2023-11-25T04:09:11.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.221+0000 7f476b733640 1 -- start start 2023-11-25T04:09:11.225 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f476b733640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4764070630 0x7f4764137840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f476b733640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f476413f750 0x7f47641f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f476b733640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476413fb30 0x7f4764152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f476b733640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47641f5820 con 0x7f4764070630 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f476b733640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4764137f00 con 0x7f476413f750 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f476b733640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47641381e0 con 0x7f476413fb30 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f47694cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4764070630 0x7f4764137840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f47694cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4764070630 0x7f4764137840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56012/0 (socket says 172.21.15.2:56012) 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f47694cf640 1 -- 172.21.15.2:0/3387911691 learned_addr learned my addr 172.21.15.2:0/3387911691 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f4769cd0640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476413fb30 0x7f4764152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f4768cce640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f476413f750 0x7f47641f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f47694cf640 1 -- 172.21.15.2:0/3387911691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476413fb30 msgr2=0x7f4764152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.226 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f47694cf640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476413fb30 0x7f4764152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f47694cf640 1 -- 172.21.15.2:0/3387911691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f476413f750 msgr2=0x7f47641f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f47694cf640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f476413f750 0x7f47641f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f47694cf640 1 -- 172.21.15.2:0/3387911691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4760009400 con 0x7f4764070630 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.222+0000 7f47694cf640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4764070630 0x7f4764137840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f47600098c0 tx=0x7f47600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.223+0000 7f4759ffb640 1 -- 172.21.15.2:0/3387911691 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476003ba70 con 0x7f4764070630 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.223+0000 7f4759ffb640 1 -- 172.21.15.2:0/3387911691 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f476003bbd0 con 0x7f4764070630 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.223+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47641384c0 con 0x7f4764070630 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.223+0000 7f4759ffb640 1 -- 172.21.15.2:0/3387911691 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47600453f0 con 0x7f4764070630 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.223+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4764138a80 con 0x7f4764070630 2023-11-25T04:09:11.227 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.224+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476413ff70 con 0x7f4764070630 2023-11-25T04:09:11.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.224+0000 7f4759ffb640 1 -- 172.21.15.2:0/3387911691 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4760045550 con 0x7f4764070630 2023-11-25T04:09:11.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.225+0000 7f4759ffb640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f474806ae40 0x7f474806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.225+0000 7f4759ffb640 1 -- 172.21.15.2:0/3387911691 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47600abbc0 con 0x7f4764070630 2023-11-25T04:09:11.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.225+0000 7f4768cce640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f474806ae40 0x7f474806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.225+0000 7f4768cce640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f474806ae40 0x7f474806d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47641f4880 tx=0x7f4754009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:11.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.229+0000 7f4759ffb640 1 -- 172.21.15.2:0/3387911691 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f476413ff70 con 0x7f4764070630 2023-11-25T04:09:11.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.409+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f476413ff70 con 0x7f4764070630 2023-11-25T04:09:11.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.410+0000 7f4759ffb640 1 -- 172.21.15.2:0/3387911691 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f476413ff70 con 0x7f4764070630 2023-11-25T04:09:11.412 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.411+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f474806ae40 msgr2=0x7f474806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.411+0000 7f476b733640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f474806ae40 0x7f474806d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f47641f4880 tx=0x7f4754009040 comp rx=0 tx=0).stop 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.411+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4764070630 msgr2=0x7f4764137840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.411+0000 7f476b733640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4764070630 0x7f4764137840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f47600098c0 tx=0x7f47600046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.412+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 shutdown_connections 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.412+0000 7f476b733640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f476413fb30 0x7f4764152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.412+0000 7f476b733640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f474806ae40 0x7f474806d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.412+0000 7f476b733640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f476413f750 0x7f47641f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.412+0000 7f476b733640 1 --2- 172.21.15.2:0/3387911691 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4764070630 0x7f4764137840 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.412+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 >> 172.21.15.2:0/3387911691 conn(0x7f476406a8f0 msgr2=0x7f47640af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:11.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.412+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 shutdown_connections 2023-11-25T04:09:11.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.412+0000 7f476b733640 1 -- 172.21.15.2:0/3387911691 wait complete. 2023-11-25T04:09:11.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-25T04:09:11.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.530+0000 7f2a6c223640 1 Processor -- start 2023-11-25T04:09:11.532 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.530+0000 7f2a6c223640 1 -- start start 2023-11-25T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.531+0000 7f2a6c223640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a6406fd30 0x7f2a640cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.531+0000 7f2a6c223640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2a64099970 0x7f2a64099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.531+0000 7f2a6c223640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a640cc080 con 0x7f2a6415ee80 2023-11-25T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.531+0000 7f2a6c223640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a64070110 con 0x7f2a64099970 2023-11-25T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.531+0000 7f2a6c223640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640ccec0 con 0x7f2a6406fd30 2023-11-25T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.531+0000 7f2a6a7c0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2a6415ee80 0x7f2a6415f310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48336/0 (socket says 172.21.15.2:48336) 2023-11-25T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.531+0000 7f2a6a7c0640 1 -- 172.21.15.2:0/2437889387 learned_addr learned my addr 172.21.15.2:0/2437889387 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a697be640 1 --2- 172.21.15.2:0/2437889387 >> v2:172.21.15.66:3300/0 conn(0x7f2a64099970 0x7f2a64099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.536 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a69fbf640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a6406fd30 0x7f2a640cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842453846 0 0) 0x7f2a640cc080 con 0x7f2a6415ee80 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a4c003520 con 0x7f2a6415ee80 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3058562757 0 0) 0x7f2a4c003520 con 0x7f2a6415ee80 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a6406fd30 msgr2=0x7f2a640cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a6406fd30 0x7f2a640cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 >> v2:172.21.15.66:3300/0 conn(0x7f2a64099970 msgr2=0x7f2a64099dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 --2- 172.21.15.2:0/2437889387 >> v2:172.21.15.66:3300/0 conn(0x7f2a64099970 0x7f2a64099dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a6409a310 con 0x7f2a6415ee80 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f2a540019f0 con 0x7f2a6415ee80 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 >> v1:172.21.15.2:6789/0 conn(0x7f2a6415ee80 legacy=0x7f2a6415f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a4c003970 0x7f2a4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a4c0047c0 0x7f2a4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.537 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a6406fd30 0x7f2a4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a64070110 con 0x7f2a4c003970 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640ccec0 con 0x7f2a4c0047c0 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c00b980 con 0x7f2a6406fd30 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a69fbf640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a4c003970 0x7f2a4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a6a7c0640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a6406fd30 0x7f2a4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a697be640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a4c0047c0 0x7f2a4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a69fbf640 1 -- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a6406fd30 msgr2=0x7f2a4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a69fbf640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a6406fd30 0x7f2a4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a69fbf640 1 -- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a4c0047c0 msgr2=0x7f2a4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a69fbf640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a4c0047c0 0x7f2a4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.532+0000 7f2a69fbf640 1 -- 172.21.15.2:0/2437889387 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c003520 con 0x7f2a4c003970 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.533+0000 7f2a69fbf640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a4c003970 0x7f2a4c003d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009ac0 tx=0x7f2a4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2364ac06bf21b4fb server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:11.538 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.533+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c02c6b0 con 0x7f2a4c003970 2023-11-25T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.533+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c02c810 con 0x7f2a4c003970 2023-11-25T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.533+0000 7f2a68fbd640 1 -- 172.21.15.2:0/2437889387 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c02cba0 con 0x7f2a4c003970 2023-11-25T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.534+0000 7f2a6c223640 1 -- 172.21.15.2:0/2437889387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a4c003970 msgr2=0x7f2a4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.534+0000 7f2a6c223640 1 --2- 172.21.15.2:0/2437889387 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a4c003970 0x7f2a4c003d90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c009ac0 tx=0x7f2a4c0057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.534+0000 7f2a6a7c0640 1 -- 172.21.15.2:0/2437889387 reap_dead start 2023-11-25T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.534+0000 7f2a6c223640 1 -- 172.21.15.2:0/2437889387 shutdown_connections 2023-11-25T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.534+0000 7f2a6c223640 1 -- 172.21.15.2:0/2437889387 >> 172.21.15.2:0/2437889387 conn(0x7f2a640b2a20 msgr2=0x7f2a640b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.534+0000 7f2a6c223640 1 -- 172.21.15.2:0/2437889387 shutdown_connections 2023-11-25T04:09:11.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.534+0000 7f2a6c223640 1 -- 172.21.15.2:0/2437889387 wait complete. 2023-11-25T04:09:11.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.535+0000 7f2a6c223640 1 Processor -- start 2023-11-25T04:09:11.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.535+0000 7f2a6c223640 1 -- start start 2023-11-25T04:09:11.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6c223640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a4c003970 0x7f2a640c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6c223640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a640b4a70 0x7f2a6415abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6c223640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a640ca5a0 0x7f2a64151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6c223640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640ca1a0 con 0x7f2a640ca5a0 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6c223640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640b3cf0 con 0x7f2a640b4a70 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6c223640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a640b3f90 con 0x7f2a4c003970 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6a7c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a640ca5a0 0x7f2a64151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6a7c0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a640ca5a0 0x7f2a64151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56032/0 (socket says 172.21.15.2:56032) 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6a7c0640 1 -- 172.21.15.2:0/3163610811 learned_addr learned my addr 172.21.15.2:0/3163610811 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a69fbf640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a4c003970 0x7f2a640c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a697be640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a640b4a70 0x7f2a6415abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6a7c0640 1 -- 172.21.15.2:0/3163610811 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a4c003970 msgr2=0x7f2a640c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6a7c0640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a4c003970 0x7f2a640c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6a7c0640 1 -- 172.21.15.2:0/3163610811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a640b4a70 msgr2=0x7f2a6415abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.544 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6a7c0640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a640b4a70 0x7f2a6415abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6a7c0640 1 -- 172.21.15.2:0/3163610811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a640b4270 con 0x7f2a640ca5a0 2023-11-25T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.536+0000 7f2a6a7c0640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a640ca5a0 0x7f2a64151fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2a54001330 tx=0x7f2a5400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.537+0000 7f2a627fc640 1 -- 172.21.15.2:0/3163610811 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5400ec10 con 0x7f2a640ca5a0 2023-11-25T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.537+0000 7f2a627fc640 1 -- 172.21.15.2:0/3163610811 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5400ed90 con 0x7f2a640ca5a0 2023-11-25T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.537+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a640b4550 con 0x7f2a640ca5a0 2023-11-25T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.537+0000 7f2a627fc640 1 -- 172.21.15.2:0/3163610811 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a54013660 con 0x7f2a640ca5a0 2023-11-25T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.537+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6415b120 con 0x7f2a640ca5a0 2023-11-25T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.538+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a640b4740 con 0x7f2a640ca5a0 2023-11-25T04:09:11.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.538+0000 7f2a627fc640 1 -- 172.21.15.2:0/3163610811 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a540137c0 con 0x7f2a640ca5a0 2023-11-25T04:09:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.538+0000 7f2a627fc640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a5006ae40 0x7f2a5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.538+0000 7f2a627fc640 1 -- 172.21.15.2:0/3163610811 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a54089940 con 0x7f2a640ca5a0 2023-11-25T04:09:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.539+0000 7f2a69fbf640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a5006ae40 0x7f2a5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.539+0000 7f2a69fbf640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a5006ae40 0x7f2a5006d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c036000 tx=0x7f2a5c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:11.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.543+0000 7f2a627fc640 1 -- 172.21.15.2:0/3163610811 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a54054a10 con 0x7f2a640ca5a0 2023-11-25T04:09:11.734 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.732+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a6409f040 con 0x7f2a640ca5a0 2023-11-25T04:09:11.735 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.733+0000 7f2a627fc640 1 -- 172.21.15.2:0/3163610811 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a54058030 con 0x7f2a640ca5a0 2023-11-25T04:09:11.735 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.734+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a5006ae40 msgr2=0x7f2a5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.734+0000 7f2a6c223640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a5006ae40 0x7f2a5006d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c036000 tx=0x7f2a5c030000 comp rx=0 tx=0).stop 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.734+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a640ca5a0 msgr2=0x7f2a64151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.734+0000 7f2a6c223640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a640ca5a0 0x7f2a64151fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2a54001330 tx=0x7f2a5400e530 comp rx=0 tx=0).stop 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.735+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 shutdown_connections 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.735+0000 7f2a6c223640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a640ca5a0 0x7f2a64151fd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.735+0000 7f2a6c223640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a5006ae40 0x7f2a5006d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.735+0000 7f2a6c223640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a640b4a70 0x7f2a6415abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.735+0000 7f2a6c223640 1 --2- 172.21.15.2:0/3163610811 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a4c003970 0x7f2a640c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.735+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 >> 172.21.15.2:0/3163610811 conn(0x7f2a640b2a20 msgr2=0x7f2a6415d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:11.737 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.735+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 shutdown_connections 2023-11-25T04:09:11.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.735+0000 7f2a6c223640 1 -- 172.21.15.2:0/3163610811 wait complete. 2023-11-25T04:09:11.747 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:09:11.747 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:11.768 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.872+0000 7f258e84b640 1 Processor -- start 2023-11-25T04:09:11.874 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.872+0000 7f258e84b640 1 -- start start 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.873+0000 7f258e84b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f25880d1720 0x7f25880d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.873+0000 7f258e84b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f25880b3db0 0x7f25880b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.873+0000 7f258e84b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25880b5f90 con 0x7f258815d3e0 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.873+0000 7f258e84b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25880d20a0 con 0x7f25880d1720 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.873+0000 7f258e84b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25880b61e0 con 0x7f25880b3db0 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.873+0000 7f25877fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f25880d1720 0x7f25880d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.873+0000 7f25877fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f25880d1720 0x7f25880d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56040/0 (socket says 172.21.15.2:56040) 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.873+0000 7f25877fe640 1 -- 172.21.15.2:0/1669218709 learned_addr learned my addr 172.21.15.2:0/1669218709 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.874+0000 7f258cde8640 1 --2- 172.21.15.2:0/1669218709 >> v2:172.21.15.66:3300/0 conn(0x7f25880b3db0 0x7f25880b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.874+0000 7f25877fe640 1 -- 172.21.15.2:0/1669218709 >> v2:172.21.15.66:3300/0 conn(0x7f25880b3db0 msgr2=0x7f25880b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.874+0000 7f25877fe640 1 --2- 172.21.15.2:0/1669218709 >> v2:172.21.15.66:3300/0 conn(0x7f25880b3db0 0x7f25880b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.876 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.874+0000 7f25877fe640 1 -- 172.21.15.2:0/1669218709 >> v1:172.21.15.66:6789/0 conn(0x7f258815d3e0 legacy=0x7f25880ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:11.877 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.874+0000 7f25877fe640 1 -- 172.21.15.2:0/1669218709 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25880b64c0 con 0x7f25880d1720 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f25877fe640 1 --2- 172.21.15.2:0/1669218709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25880d1720 0x7f25880d1b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f25880cdc30 tx=0x7f257802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443049c1ebb4a2f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f2586ffd640 1 -- 172.21.15.2:0/1669218709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578031870 con 0x7f25880d1720 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f2586ffd640 1 -- 172.21.15.2:0/1669218709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25780319d0 con 0x7f25880d1720 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f2586ffd640 1 -- 172.21.15.2:0/1669218709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578031d60 con 0x7f25880d1720 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f258e84b640 1 -- 172.21.15.2:0/1669218709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25880d1720 msgr2=0x7f25880d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f258e84b640 1 --2- 172.21.15.2:0/1669218709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25880d1720 0x7f25880d1b60 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f25880cdc30 tx=0x7f257802b910 comp rx=0 tx=0).stop 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f258e84b640 1 -- 172.21.15.2:0/1669218709 shutdown_connections 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f258e84b640 1 --2- 172.21.15.2:0/1669218709 >> v2:172.21.15.66:3300/0 conn(0x7f25880b3db0 0x7f25880b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f258e84b640 1 --2- 172.21.15.2:0/1669218709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f25880d1720 0x7f25880d1b60 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f258e84b640 1 -- 172.21.15.2:0/1669218709 >> 172.21.15.2:0/1669218709 conn(0x7f258809c480 msgr2=0x7f25880d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:11.878 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f258e84b640 1 -- 172.21.15.2:0/1669218709 shutdown_connections 2023-11-25T04:09:11.879 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.875+0000 7f258e84b640 1 -- 172.21.15.2:0/1669218709 wait complete. 2023-11-25T04:09:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.876+0000 7f258e84b640 1 Processor -- start 2023-11-25T04:09:11.881 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.877+0000 7f258e84b640 1 -- start start 2023-11-25T04:09:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.877+0000 7f258e84b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25880b3db0 0x7f25880b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.877+0000 7f258e84b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25880d1720 0x7f25880b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.877+0000 7f258e84b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258815d3e0 0x7f25881506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.877+0000 7f258e84b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25880b0e10 con 0x7f258815d3e0 2023-11-25T04:09:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.877+0000 7f258e84b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258815e9c0 con 0x7f25880d1720 2023-11-25T04:09:11.882 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.877+0000 7f258e84b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258815eca0 con 0x7f25880b3db0 2023-11-25T04:09:11.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.877+0000 7f258cde8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258815d3e0 0x7f25881506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.877+0000 7f258cde8640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258815d3e0 0x7f25881506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56044/0 (socket says 172.21.15.2:56044) 2023-11-25T04:09:11.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f258cde8640 1 -- 172.21.15.2:0/3364680439 learned_addr learned my addr 172.21.15.2:0/3364680439 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:11.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f25877fe640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25880d1720 0x7f25880b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f2587fff640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25880b3db0 0x7f25880b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f258cde8640 1 -- 172.21.15.2:0/3364680439 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25880b3db0 msgr2=0x7f25880b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f258cde8640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25880b3db0 0x7f25880b2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f258cde8640 1 -- 172.21.15.2:0/3364680439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25880d1720 msgr2=0x7f25880b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:11.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f258cde8640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25880d1720 0x7f25880b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:11.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f258cde8640 1 -- 172.21.15.2:0/3364680439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25780094d0 con 0x7f258815d3e0 2023-11-25T04:09:11.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f25877fe640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25880d1720 0x7f25880b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:11.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f258cde8640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258815d3e0 0x7f25881506b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2580007e90 tx=0x7f258000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:11.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f2584ff9640 1 -- 172.21.15.2:0/3364680439 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580014420 con 0x7f258815d3e0 2023-11-25T04:09:11.894 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f2584ff9640 1 -- 172.21.15.2:0/3364680439 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2580014580 con 0x7f258815d3e0 2023-11-25T04:09:11.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25880b3450 con 0x7f258815d3e0 2023-11-25T04:09:11.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f2584ff9640 1 -- 172.21.15.2:0/3364680439 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2580014930 con 0x7f258815d3e0 2023-11-25T04:09:11.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.878+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25880b3a10 con 0x7f258815d3e0 2023-11-25T04:09:11.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.879+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2588067420 con 0x7f258815d3e0 2023-11-25T04:09:11.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.880+0000 7f2584ff9640 1 -- 172.21.15.2:0/3364680439 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2580014a90 con 0x7f258815d3e0 2023-11-25T04:09:11.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.880+0000 7f2584ff9640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f257406ae40 0x7f257406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:11.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.880+0000 7f2584ff9640 1 -- 172.21.15.2:0/3364680439 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2580089f70 con 0x7f258815d3e0 2023-11-25T04:09:11.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.880+0000 7f2587fff640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f257406ae40 0x7f257406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:11.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.881+0000 7f2587fff640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f257406ae40 0x7f257406d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f257c004ea0 tx=0x7f257c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:11.899 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:11.884+0000 7f2584ff9640 1 -- 172.21.15.2:0/3364680439 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25800bce90 con 0x7f258815d3e0 2023-11-25T04:09:12.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.064+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f258815ede0 con 0x7f258815d3e0 2023-11-25T04:09:12.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.065+0000 7f2584ff9640 1 -- 172.21.15.2:0/3364680439 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f2580054f90 con 0x7f258815d3e0 2023-11-25T04:09:12.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:12.068 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f257406ae40 msgr2=0x7f257406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f257406ae40 0x7f257406d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f257c004ea0 tx=0x7f257c009040 comp rx=0 tx=0).stop 2023-11-25T04:09:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258815d3e0 msgr2=0x7f25881506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258815d3e0 0x7f25881506b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2580007e90 tx=0x7f258000e4b0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 shutdown_connections 2023-11-25T04:09:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f258815d3e0 0x7f25881506b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f257406ae40 0x7f257406d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.070 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25880d1720 0x7f25880b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 --2- 172.21.15.2:0/3364680439 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25880b3db0 0x7f25880b2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 >> 172.21.15.2:0/3364680439 conn(0x7f258809c480 msgr2=0x7f25880b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:12.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.067+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 shutdown_connections 2023-11-25T04:09:12.071 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.068+0000 7f258e84b640 1 -- 172.21.15.2:0/3364680439 wait complete. 2023-11-25T04:09:12.080 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:12.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:12.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.188+0000 7f2ede29b640 1 Processor -- start 2023-11-25T04:09:12.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.188+0000 7f2ede29b640 1 -- start start 2023-11-25T04:09:12.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ede29b640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ed8144a50 0x7f2ed815f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ede29b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed80b5d60 0x7f2ed806a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ede29b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed80b2ee0 con 0x7f2ed806a4d0 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ede29b640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed806aea0 con 0x7f2ed8144a50 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ede29b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80b34a0 con 0x7f2ed80b5d60 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ed7fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2ed8144a50 0x7f2ed815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ed77fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2ed806a4d0 0x7f2ed80cfde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48342/0 (socket says 172.21.15.2:48342) 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ed77fe640 1 -- 172.21.15.2:0/154693111 learned_addr learned my addr 172.21.15.2:0/154693111 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2edc838640 1 --2- 172.21.15.2:0/154693111 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed80b5d60 0x7f2ed806a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ed7fff640 1 -- 172.21.15.2:0/154693111 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed80b5d60 msgr2=0x7f2ed806a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ed7fff640 1 --2- 172.21.15.2:0/154693111 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed80b5d60 0x7f2ed806a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ed7fff640 1 -- 172.21.15.2:0/154693111 >> v1:172.21.15.2:6789/0 conn(0x7f2ed806a4d0 legacy=0x7f2ed80cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.189+0000 7f2ed7fff640 1 -- 172.21.15.2:0/154693111 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed8144e30 con 0x7f2ed8144a50 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.190+0000 7f2ed7fff640 1 --2- 172.21.15.2:0/154693111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 0x7f2ed815f680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80097a0 tx=0x7f2ec802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f7e3151adc637a server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:12.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.190+0000 7f2ed6ffd640 1 -- 172.21.15.2:0/154693111 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8031830 con 0x7f2ed8144a50 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.190+0000 7f2ed6ffd640 1 -- 172.21.15.2:0/154693111 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec8031990 con 0x7f2ed8144a50 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.190+0000 7f2ed6ffd640 1 -- 172.21.15.2:0/154693111 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8031d20 con 0x7f2ed8144a50 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.190+0000 7f2ede29b640 1 -- 172.21.15.2:0/154693111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 msgr2=0x7f2ed815f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.190+0000 7f2ede29b640 1 --2- 172.21.15.2:0/154693111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 0x7f2ed815f680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2ec80097a0 tx=0x7f2ec802b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.191+0000 7f2ede29b640 1 -- 172.21.15.2:0/154693111 shutdown_connections 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.191+0000 7f2ede29b640 1 --2- 172.21.15.2:0/154693111 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed80b5d60 0x7f2ed806a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.191+0000 7f2ede29b640 1 --2- 172.21.15.2:0/154693111 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 0x7f2ed815f680 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.191+0000 7f2ede29b640 1 -- 172.21.15.2:0/154693111 >> 172.21.15.2:0/154693111 conn(0x7f2ed80cc930 msgr2=0x7f2ed80ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.191+0000 7f2ede29b640 1 -- 172.21.15.2:0/154693111 shutdown_connections 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.191+0000 7f2ede29b640 1 -- 172.21.15.2:0/154693111 wait complete. 2023-11-25T04:09:12.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.192+0000 7f2ede29b640 1 Processor -- start 2023-11-25T04:09:12.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.192+0000 7f2ede29b640 1 -- start start 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2ede29b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed806a4d0 0x7f2ed815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2ede29b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ed80b5d60 0x7f2ed80abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2ede29b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 0x7f2ed80ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2ede29b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed815afb0 con 0x7f2ed8144a50 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2ede29b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80a9350 con 0x7f2ed80b5d60 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2ede29b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80a9630 con 0x7f2ed806a4d0 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2edc838640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 0x7f2ed80ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2edc838640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 0x7f2ed80ac1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56054/0 (socket says 172.21.15.2:56054) 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2edc838640 1 -- 172.21.15.2:0/1218855338 learned_addr learned my addr 172.21.15.2:0/1218855338 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2ed7fff640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed806a4d0 0x7f2ed815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2ed77fe640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ed80b5d60 0x7f2ed80abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2edc838640 1 -- 172.21.15.2:0/1218855338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed806a4d0 msgr2=0x7f2ed815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2edc838640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed806a4d0 0x7f2ed815aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2edc838640 1 -- 172.21.15.2:0/1218855338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ed80b5d60 msgr2=0x7f2ed80abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2edc838640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ed80b5d60 0x7f2ed80abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2edc838640 1 -- 172.21.15.2:0/1218855338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8009400 con 0x7f2ed8144a50 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.193+0000 7f2edc838640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 0x7f2ed80ac1e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000efc0 tx=0x7f2ed000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.194+0000 7f2ed4ff9640 1 -- 172.21.15.2:0/1218855338 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0009ba0 con 0x7f2ed8144a50 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.194+0000 7f2ed4ff9640 1 -- 172.21.15.2:0/1218855338 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed000f040 con 0x7f2ed8144a50 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.194+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed80a9910 con 0x7f2ed8144a50 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.194+0000 7f2ed4ff9640 1 -- 172.21.15.2:0/1218855338 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed00146c0 con 0x7f2ed8144a50 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.194+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed80a9ed0 con 0x7f2ed8144a50 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.195+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed80aa0c0 con 0x7f2ed8144a50 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.195+0000 7f2ed4ff9640 1 -- 172.21.15.2:0/1218855338 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ed0014820 con 0x7f2ed8144a50 2023-11-25T04:09:12.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.196+0000 7f2ed4ff9640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2ec406ae70 0x7f2ec406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.196+0000 7f2ed4ff9640 1 -- 172.21.15.2:0/1218855338 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ed008a050 con 0x7f2ed8144a50 2023-11-25T04:09:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.196+0000 7f2ed7fff640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2ec406ae70 0x7f2ec406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.196+0000 7f2ed7fff640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2ec406ae70 0x7f2ec406d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8036000 tx=0x7f2ec803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:12.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.200+0000 7f2ed4ff9640 1 -- 172.21.15.2:0/1218855338 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ed0055120 con 0x7f2ed8144a50 2023-11-25T04:09:12.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.377+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ed806ee60 con 0x7f2ed8144a50 2023-11-25T04:09:12.380 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.378+0000 7f2ed4ff9640 1 -- 172.21.15.2:0/1218855338 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ed00180a0 con 0x7f2ed8144a50 2023-11-25T04:09:12.380 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:12.382 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2ec406ae70 msgr2=0x7f2ec406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2ec406ae70 0x7f2ec406d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8036000 tx=0x7f2ec803c040 comp rx=0 tx=0).stop 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 msgr2=0x7f2ed80ac1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 0x7f2ed80ac1e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000efc0 tx=0x7f2ed000c490 comp rx=0 tx=0).stop 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 shutdown_connections 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2ed8144a50 0x7f2ed80ac1e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2ec406ae70 0x7f2ec406d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ed80b5d60 0x7f2ed80abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 --2- 172.21.15.2:0/1218855338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ed806a4d0 0x7f2ed815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 >> 172.21.15.2:0/1218855338 conn(0x7f2ed80cc930 msgr2=0x7f2ed815d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 shutdown_connections 2023-11-25T04:09:12.383 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.380+0000 7f2ede29b640 1 -- 172.21.15.2:0/1218855338 wait complete. 2023-11-25T04:09:12.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.500+0000 7f902223d640 1 Processor -- start 2023-11-25T04:09:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.500+0000 7f902223d640 1 -- start start 2023-11-25T04:09:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f902223d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f901c15b0d0 0x7f901c0cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f902223d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c15b530 con 0x7f901c070630 2023-11-25T04:09:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f902223d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c0ce060 con 0x7f901c13f750 2023-11-25T04:09:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f902223d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f901c0cec70 con 0x7f901c15b0d0 2023-11-25T04:09:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f901bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f901c070630 0x7f901c070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48346/0 (socket says 172.21.15.2:48346) 2023-11-25T04:09:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f901bfff640 1 -- 172.21.15.2:0/1255116102 learned_addr learned my addr 172.21.15.2:0/1255116102 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:12.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f9013fff640 1 --2- 172.21.15.2:0/1255116102 >> v2:172.21.15.66:3300/0 conn(0x7f901c15b0d0 0x7f901c0cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281757685 0 0) 0x7f901c15b530 con 0x7f901c070630 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9008003520 con 0x7f901c070630 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.501+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958380324 0 0) 0x7f9008003520 con 0x7f901c070630 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 >> v2:172.21.15.66:3300/0 conn(0x7f901c15b0d0 msgr2=0x7f901c0cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 --2- 172.21.15.2:0/1255116102 >> v2:172.21.15.66:3300/0 conn(0x7f901c15b0d0 0x7f901c0cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 >> v1:172.21.15.66:6789/0 conn(0x7f901c13f750 legacy=0x7f901c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c0ce340 con 0x7f901c070630 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f90140019f0 con 0x7f901c070630 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 >> v1:172.21.15.2:6789/0 conn(0x7f901c070630 legacy=0x7f901c070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9008003970 0x7f9008003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f9008004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9008005180 0x7f900800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0cec70 con 0x7f90080047c0 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900800c020 con 0x7f9008003970 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900800c1e0 con 0x7f9008005180 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f9013fff640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f9008004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901b7fe640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9008003970 0x7f9008003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901bfff640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9008005180 0x7f900800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f9013fff640 1 -- 172.21.15.2:0/1255116102 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9008005180 msgr2=0x7f900800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f9013fff640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9008005180 0x7f900800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f9013fff640 1 -- 172.21.15.2:0/1255116102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9008003970 msgr2=0x7f9008003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f9013fff640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9008003970 0x7f9008003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f9013fff640 1 -- 172.21.15.2:0/1255116102 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9008003520 con 0x7f90080047c0 2023-11-25T04:09:12.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.502+0000 7f901bfff640 1 -- 172.21.15.2:0/1255116102 reap_dead start 2023-11-25T04:09:12.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.503+0000 7f9013fff640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f9008004c40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9004009ac0 tx=0x7f90080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1277f8ccbaff26db server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:12.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.503+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900402c6d0 con 0x7f90080047c0 2023-11-25T04:09:12.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.503+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900402c830 con 0x7f90080047c0 2023-11-25T04:09:12.508 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.503+0000 7f901affd640 1 -- 172.21.15.2:0/1255116102 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900402cbc0 con 0x7f90080047c0 2023-11-25T04:09:12.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.504+0000 7f902223d640 1 -- 172.21.15.2:0/1255116102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 msgr2=0x7f9008004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.504+0000 7f902223d640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f9008004c40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9004009ac0 tx=0x7f90080057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.511 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.504+0000 7f902223d640 1 -- 172.21.15.2:0/1255116102 shutdown_connections 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.504+0000 7f902223d640 1 --2- 172.21.15.2:0/1255116102 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f9008004c40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.504+0000 7f902223d640 1 -- 172.21.15.2:0/1255116102 >> 172.21.15.2:0/1255116102 conn(0x7f901c06a8f0 msgr2=0x7f901c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.504+0000 7f902223d640 1 -- 172.21.15.2:0/1255116102 shutdown_connections 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.504+0000 7f902223d640 1 -- 172.21.15.2:0/1255116102 wait complete. 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.505+0000 7f902223d640 1 Processor -- start 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.505+0000 7f902223d640 1 -- start start 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f902223d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f901c151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f902223d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901c15d830 0x7f901c137280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f902223d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f901c15dcb0 0x7f901c1377c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f902223d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c139ac0 con 0x7f90080047c0 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f902223d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c1e5030 con 0x7f901c15dcb0 2023-11-25T04:09:12.512 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f902223d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c139d60 con 0x7f901c15d830 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f901c151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f901c151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56084/0 (socket says 172.21.15.2:56084) 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901b7fe640 1 -- 172.21.15.2:0/2957231501 learned_addr learned my addr 172.21.15.2:0/2957231501 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901bfff640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f901c15dcb0 0x7f901c1377c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f9013fff640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901c15d830 0x7f901c137280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901b7fe640 1 -- 172.21.15.2:0/2957231501 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901c15d830 msgr2=0x7f901c137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901b7fe640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901c15d830 0x7f901c137280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901b7fe640 1 -- 172.21.15.2:0/2957231501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f901c15dcb0 msgr2=0x7f901c1377c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901b7fe640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f901c15dcb0 0x7f901c1377c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901b7fe640 1 -- 172.21.15.2:0/2957231501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c13a040 con 0x7f90080047c0 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901bfff640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f901c15dcb0 0x7f901c1377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f901b7fe640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f901c151330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f900c007fd0 tx=0x7f900c00e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:12.513 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f9018ff9640 1 -- 172.21.15.2:0/2957231501 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c0052e0 con 0x7f90080047c0 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f9018ff9640 1 -- 172.21.15.2:0/2957231501 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c005440 con 0x7f90080047c0 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901c137d00 con 0x7f90080047c0 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f9018ff9640 1 -- 172.21.15.2:0/2957231501 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c003810 con 0x7f90080047c0 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.506+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901c1e42c0 con 0x7f90080047c0 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.507+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901c04e920 con 0x7f90080047c0 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.508+0000 7f9018ff9640 1 -- 172.21.15.2:0/2957231501 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f900c003970 con 0x7f90080047c0 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.508+0000 7f9018ff9640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ffc06ae70 0x7f8ffc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.508+0000 7f9018ff9640 1 -- 172.21.15.2:0/2957231501 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f900c088d40 con 0x7f90080047c0 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.508+0000 7f9013fff640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ffc06ae70 0x7f8ffc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.514 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.509+0000 7f9013fff640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ffc06ae70 0x7f8ffc06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9004036000 tx=0x7f9004030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:12.515 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.512+0000 7f9018ff9640 1 -- 172.21.15.2:0/2957231501 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f900c053f30 con 0x7f90080047c0 2023-11-25T04:09:12.690 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.688+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f901c13a1d0 con 0x7f90080047c0 2023-11-25T04:09:12.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.689+0000 7f9018ff9640 1 -- 172.21.15.2:0/2957231501 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f900c0190a0 con 0x7f90080047c0 2023-11-25T04:09:12.691 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ffc06ae70 msgr2=0x7f8ffc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ffc06ae70 0x7f8ffc06d330 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9004036000 tx=0x7f9004030000 comp rx=0 tx=0).stop 2023-11-25T04:09:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 msgr2=0x7f901c151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f901c151330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f900c007fd0 tx=0x7f900c00e8a0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 shutdown_connections 2023-11-25T04:09:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ffc06ae70 0x7f8ffc06d330 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f901c15dcb0 0x7f901c1377c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901c15d830 0x7f901c137280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 --2- 172.21.15.2:0/2957231501 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f90080047c0 0x7f901c151330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 >> 172.21.15.2:0/2957231501 conn(0x7f901c06a8f0 msgr2=0x7f901c1540a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 shutdown_connections 2023-11-25T04:09:12.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.691+0000 7f902223d640 1 -- 172.21.15.2:0/2957231501 wait complete. 2023-11-25T04:09:12.705 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.812+0000 7f0eb30e0640 1 Processor -- start 2023-11-25T04:09:12.814 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.812+0000 7f0eb30e0640 1 -- start start 2023-11-25T04:09:12.815 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb30e0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15e810 0x7f0eac0ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb30e0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac0cd170 con 0x7f0eac0cd540 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb30e0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eac0b37b0 con 0x7f0eac15ebf0 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb30e0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0b2260 con 0x7f0eac15e810 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb167d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0eac0cd540 0x7f0eac0b0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48362/0 (socket says 172.21.15.2:48362) 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb167d640 1 -- 172.21.15.2:0/2144469328 learned_addr learned my addr 172.21.15.2:0/2144469328 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb0e7c640 1 --2- 172.21.15.2:0/2144469328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15e810 0x7f0eac0ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eab7fe640 1 -- 172.21.15.2:0/2144469328 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990194161 0 0) 0x7f0eac0cd170 con 0x7f0eac0cd540 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eab7fe640 1 -- 172.21.15.2:0/2144469328 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e9c003520 con 0x7f0eac0cd540 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eab7fe640 1 -- 172.21.15.2:0/2144469328 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224214739 0 0) 0x7f0eac0b37b0 con 0x7f0eac15ebf0 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eab7fe640 1 -- 172.21.15.2:0/2144469328 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eac0cd170 con 0x7f0eac15ebf0 2023-11-25T04:09:12.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb0e7c640 1 -- 172.21.15.2:0/2144469328 >> v1:172.21.15.66:6789/0 conn(0x7f0eac15ebf0 legacy=0x7f0eac099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb0e7c640 1 -- 172.21.15.2:0/2144469328 >> v1:172.21.15.2:6789/0 conn(0x7f0eac0cd540 legacy=0x7f0eac0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.813+0000 7f0eb0e7c640 1 -- 172.21.15.2:0/2144469328 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eac0cc720 con 0x7f0eac15e810 2023-11-25T04:09:12.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.814+0000 7f0eb0e7c640 1 --2- 172.21.15.2:0/2144469328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15e810 0x7f0eac0ccc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00097d0 tx=0x7f0ea002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6666f2d8c808ad5d server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:12.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.814+0000 7f0eab7fe640 1 -- 172.21.15.2:0/2144469328 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0030880 con 0x7f0eac15e810 2023-11-25T04:09:12.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.814+0000 7f0eab7fe640 1 -- 172.21.15.2:0/2144469328 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea00309e0 con 0x7f0eac15e810 2023-11-25T04:09:12.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.815+0000 7f0eab7fe640 1 -- 172.21.15.2:0/2144469328 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0030d50 con 0x7f0eac15e810 2023-11-25T04:09:12.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.815+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2144469328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15e810 msgr2=0x7f0eac0ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.815+0000 7f0eb30e0640 1 --2- 172.21.15.2:0/2144469328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15e810 0x7f0eac0ccc30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00097d0 tx=0x7f0ea002b9c0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.818 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.815+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2144469328 shutdown_connections 2023-11-25T04:09:12.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.815+0000 7f0eb30e0640 1 --2- 172.21.15.2:0/2144469328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15e810 0x7f0eac0ccc30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.815+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2144469328 >> 172.21.15.2:0/2144469328 conn(0x7f0eac0b2a70 msgr2=0x7f0eac0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:12.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.815+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2144469328 shutdown_connections 2023-11-25T04:09:12.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.815+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2144469328 wait complete. 2023-11-25T04:09:12.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.816+0000 7f0eb30e0640 1 Processor -- start 2023-11-25T04:09:12.819 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.816+0000 7f0eb30e0640 1 -- start start 2023-11-25T04:09:12.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eb30e0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac0cd540 0x7f0eac15a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eb30e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eac15e810 0x7f0eac0c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eb30e0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15ebf0 0x7f0eac0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eb30e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0c8d90 con 0x7f0eac15e810 2023-11-25T04:09:12.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eb30e0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0c8180 con 0x7f0eac0cd540 2023-11-25T04:09:12.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eb30e0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eac0c8460 con 0x7f0eac15ebf0 2023-11-25T04:09:12.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eac15e810 0x7f0eac0c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eabfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eac15e810 0x7f0eac0c54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56096/0 (socket says 172.21.15.2:56096) 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eabfff640 1 -- 172.21.15.2:0/2137582202 learned_addr learned my addr 172.21.15.2:0/2137582202 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.817+0000 7f0eb167d640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15ebf0 0x7f0eac0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eb0e7c640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac0cd540 0x7f0eac15a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eabfff640 1 -- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15ebf0 msgr2=0x7f0eac0b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eabfff640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15ebf0 0x7f0eac0b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eabfff640 1 -- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac0cd540 msgr2=0x7f0eac15a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eabfff640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac0cd540 0x7f0eac15a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eabfff640 1 -- 172.21.15.2:0/2137582202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0009400 con 0x7f0eac15e810 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eb167d640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15ebf0 0x7f0eac0b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eb0e7c640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac0cd540 0x7f0eac15a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:12.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eabfff640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eac15e810 0x7f0eac0c54a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e98001eb0 tx=0x7f0e9800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0ea97fa640 1 -- 172.21.15.2:0/2137582202 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980052d0 con 0x7f0eac15e810 2023-11-25T04:09:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0ea97fa640 1 -- 172.21.15.2:0/2137582202 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e98005430 con 0x7f0eac15e810 2023-11-25T04:09:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac0c8740 con 0x7f0eac15e810 2023-11-25T04:09:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0ea97fa640 1 -- 172.21.15.2:0/2137582202 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98003810 con 0x7f0eac15e810 2023-11-25T04:09:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.818+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eac0c59e0 con 0x7f0eac15e810 2023-11-25T04:09:12.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.819+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eac0c8f00 con 0x7f0eac15e810 2023-11-25T04:09:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.820+0000 7f0ea97fa640 1 -- 172.21.15.2:0/2137582202 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0e98003970 con 0x7f0eac15e810 2023-11-25T04:09:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.820+0000 7f0ea97fa640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0e9006ae40 0x7f0e9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.820+0000 7f0ea97fa640 1 -- 172.21.15.2:0/2137582202 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e98088b00 con 0x7f0eac15e810 2023-11-25T04:09:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.820+0000 7f0eb0e7c640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0e9006ae40 0x7f0e9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:12.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.820+0000 7f0eb0e7c640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0e9006ae40 0x7f0e9006d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0036000 tx=0x7f0ea0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:12.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:12.824+0000 7f0ea97fa640 1 -- 172.21.15.2:0/2137582202 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0e98053c40 con 0x7f0eac15e810 2023-11-25T04:09:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.003+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0eac0b3590 con 0x7f0eac15e810 2023-11-25T04:09:13.005 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.003+0000 7f0ea97fa640 1 -- 172.21.15.2:0/2137582202 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e980170a0 con 0x7f0eac15e810 2023-11-25T04:09:13.005 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:13.007 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0e9006ae40 msgr2=0x7f0e9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0e9006ae40 0x7f0e9006d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0036000 tx=0x7f0ea0008030 comp rx=0 tx=0).stop 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eac15e810 msgr2=0x7f0eac0c54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eac15e810 0x7f0eac0c54a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0e98001eb0 tx=0x7f0e9800c820 comp rx=0 tx=0).stop 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 shutdown_connections 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eac15ebf0 0x7f0eac0b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0eac15e810 0x7f0eac0c54a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0e9006ae40 0x7f0e9006d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 --2- 172.21.15.2:0/2137582202 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eac0cd540 0x7f0eac15a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 >> 172.21.15.2:0/2137582202 conn(0x7f0eac0b2a70 msgr2=0x7f0eac0b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 shutdown_connections 2023-11-25T04:09:13.008 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.005+0000 7f0eb30e0640 1 -- 172.21.15.2:0/2137582202 wait complete. 2023-11-25T04:09:13.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-25T04:09:13.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.124+0000 7fe13f8da640 1 Processor -- start 2023-11-25T04:09:13.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.124+0000 7fe13f8da640 1 -- start start 2023-11-25T04:09:13.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13f8da640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe13813f750 0x7fe13815b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13f8da640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1380cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13f8da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1380ce060 con 0x7fe13815db40 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13f8da640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1380cec70 con 0x7fe13813f750 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13f8da640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1380ce340 con 0x7fe13813fb30 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13d676640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe13813f750 0x7fe13815b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13ce75640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1380cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13d676640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe13813f750 0x7fe13815b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:37334/0 (socket says 172.21.15.2:37334) 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13d676640 1 -- 172.21.15.2:0/1985765433 learned_addr learned my addr 172.21.15.2:0/1985765433 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13ce75640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1380cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:44864/0 (socket says 172.21.15.2:44864) 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13ce75640 1 -- 172.21.15.2:0/1985765433 >> v2:172.21.15.66:3300/0 conn(0x7fe13813f750 msgr2=0x7fe13815b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13ce75640 1 --2- 172.21.15.2:0/1985765433 >> v2:172.21.15.66:3300/0 conn(0x7fe13813f750 0x7fe13815b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13ce75640 1 -- 172.21.15.2:0/1985765433 >> v1:172.21.15.66:6789/0 conn(0x7fe13815db40 legacy=0x7fe13815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13ce75640 1 -- 172.21.15.2:0/1985765433 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1380ce620 con 0x7fe13813fb30 2023-11-25T04:09:13.129 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.125+0000 7fe13d676640 1 --2- 172.21.15.2:0/1985765433 >> v2:172.21.15.66:3300/0 conn(0x7fe13813f750 0x7fe13815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:09:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.126+0000 7fe13ce75640 1 --2- 172.21.15.2:0/1985765433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1380cd7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe1280097a0 tx=0x7fe12802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9ca790390773566 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.126+0000 7fe12ffff640 1 -- 172.21.15.2:0/1985765433 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128031830 con 0x7fe13813fb30 2023-11-25T04:09:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.126+0000 7fe12ffff640 1 -- 172.21.15.2:0/1985765433 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe128031990 con 0x7fe13813fb30 2023-11-25T04:09:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.126+0000 7fe12ffff640 1 -- 172.21.15.2:0/1985765433 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe128031d20 con 0x7fe13813fb30 2023-11-25T04:09:13.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.127+0000 7fe13f8da640 1 -- 172.21.15.2:0/1985765433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 msgr2=0x7fe1380cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.127+0000 7fe13f8da640 1 --2- 172.21.15.2:0/1985765433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1380cd7c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe1280097a0 tx=0x7fe12802b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.127+0000 7fe13f8da640 1 -- 172.21.15.2:0/1985765433 shutdown_connections 2023-11-25T04:09:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.127+0000 7fe13f8da640 1 --2- 172.21.15.2:0/1985765433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1380cd7c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.127+0000 7fe13f8da640 1 --2- 172.21.15.2:0/1985765433 >> v2:172.21.15.66:3300/0 conn(0x7fe13813f750 0x7fe13815b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.127+0000 7fe13f8da640 1 -- 172.21.15.2:0/1985765433 >> 172.21.15.2:0/1985765433 conn(0x7fe13806a8f0 msgr2=0x7fe13806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.127+0000 7fe13f8da640 1 -- 172.21.15.2:0/1985765433 shutdown_connections 2023-11-25T04:09:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.127+0000 7fe13f8da640 1 -- 172.21.15.2:0/1985765433 wait complete. 2023-11-25T04:09:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.128+0000 7fe13f8da640 1 Processor -- start 2023-11-25T04:09:13.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.128+0000 7fe13f8da640 1 -- start start 2023-11-25T04:09:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13f8da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13813f750 0x7fe1381f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13f8da640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1381ef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13f8da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13815db40 0x7fe1381f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13f8da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1381f3680 con 0x7fe13815db40 2023-11-25T04:09:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13f8da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1381ef630 con 0x7fe13813f750 2023-11-25T04:09:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13f8da640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1381569d0 con 0x7fe13813fb30 2023-11-25T04:09:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13de77640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13815db40 0x7fe1381f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.134 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13de77640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13815db40 0x7fe1381f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56106/0 (socket says 172.21.15.2:56106) 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13de77640 1 -- 172.21.15.2:0/536165360 learned_addr learned my addr 172.21.15.2:0/536165360 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13ce75640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1381ef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13d676640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13813f750 0x7fe1381f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13de77640 1 -- 172.21.15.2:0/536165360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 msgr2=0x7fe1381ef0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13de77640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1381ef0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13de77640 1 -- 172.21.15.2:0/536165360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13813f750 msgr2=0x7fe1381f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13de77640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13813f750 0x7fe1381f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.129+0000 7fe13de77640 1 -- 172.21.15.2:0/536165360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340094d0 con 0x7fe13815db40 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.130+0000 7fe13de77640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13815db40 0x7fe1381f1eb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe13000c6b0 tx=0x7fe13000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.130+0000 7fe12dffb640 1 -- 172.21.15.2:0/536165360 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130003b70 con 0x7fe13815db40 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.130+0000 7fe12dffb640 1 -- 172.21.15.2:0/536165360 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe130003cf0 con 0x7fe13815db40 2023-11-25T04:09:13.135 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.130+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe128009400 con 0x7fe13815db40 2023-11-25T04:09:13.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.130+0000 7fe12dffb640 1 -- 172.21.15.2:0/536165360 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130003ea0 con 0x7fe13815db40 2023-11-25T04:09:13.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.130+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1381f30c0 con 0x7fe13815db40 2023-11-25T04:09:13.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.131+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe138072ae0 con 0x7fe13815db40 2023-11-25T04:09:13.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.131+0000 7fe12dffb640 1 -- 172.21.15.2:0/536165360 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe130005310 con 0x7fe13815db40 2023-11-25T04:09:13.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.132+0000 7fe12dffb640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe11c06ae40 0x7fe11c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.132+0000 7fe12dffb640 1 -- 172.21.15.2:0/536165360 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1300893c0 con 0x7fe13815db40 2023-11-25T04:09:13.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.132+0000 7fe13d676640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe11c06ae40 0x7fe11c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.136 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.132+0000 7fe13d676640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe11c06ae40 0x7fe11c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe134009cf0 tx=0x7fe134008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:13.138 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.136+0000 7fe12dffb640 1 -- 172.21.15.2:0/536165360 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe130054470 con 0x7fe13815db40 2023-11-25T04:09:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.326+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe13804e920 con 0x7fe13815db40 2023-11-25T04:09:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.326+0000 7fe12dffb640 1 -- 172.21.15.2:0/536165360 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe130057a90 con 0x7fe13815db40 2023-11-25T04:09:13.328 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-25T04:09:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe11c06ae40 msgr2=0x7fe11c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe11c06ae40 0x7fe11c06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe134009cf0 tx=0x7fe134008040 comp rx=0 tx=0).stop 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13815db40 msgr2=0x7fe1381f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13815db40 0x7fe1381f1eb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe13000c6b0 tx=0x7fe13000cb70 comp rx=0 tx=0).stop 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 shutdown_connections 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe13815db40 0x7fe1381f1eb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13813fb30 0x7fe1381ef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe11c06ae40 0x7fe11c06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 --2- 172.21.15.2:0/536165360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13813f750 0x7fe1381f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 >> 172.21.15.2:0/536165360 conn(0x7fe13806a8f0 msgr2=0x7fe13815ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 shutdown_connections 2023-11-25T04:09:13.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.328+0000 7fe13f8da640 1 -- 172.21.15.2:0/536165360 wait complete. 2023-11-25T04:09:13.341 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi066.front.sepia.ceph.com... 2023-11-25T04:09:13.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:13.341 DEBUG:teuthology.orchestra.run.smithi066:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-11-25T04:09:13.379 INFO:teuthology.orchestra.run:waiting for 300 2023-11-25T04:09:13.379 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T04:09:13.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:13.380 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-25T04:09:13.447 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:09:13.448 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:13.463 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:09:13.464 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:13.520 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.664+0000 7f020a66b640 1 Processor -- start 2023-11-25T04:09:13.666 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.664+0000 7f020a66b640 1 -- start start 2023-11-25T04:09:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.665+0000 7f020a66b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020406dc30 0x7f0204071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.665+0000 7f020a66b640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02040b3130 con 0x7f02040b1df0 2023-11-25T04:09:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.665+0000 7f020a66b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02040b2280 con 0x7f0204142d20 2023-11-25T04:09:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.665+0000 7f020a66b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0204143100 con 0x7f020406dc30 2023-11-25T04:09:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.665+0000 7f0208c08640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f02040b1df0 0x7f02040cc610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48366/0 (socket says 172.21.15.2:48366) 2023-11-25T04:09:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.665+0000 7f0208c08640 1 -- 172.21.15.2:0/1561838217 learned_addr learned my addr 172.21.15.2:0/1561838217 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:13.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.665+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1068223739 0 0) 0x7f02040b3130 con 0x7f02040b1df0 2023-11-25T04:09:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.665+0000 7f02037fe640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020406dc30 0x7f0204071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.665+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01ec003520 con 0x7f02040b1df0 2023-11-25T04:09:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 825194625 0 0) 0x7f01ec003520 con 0x7f02040b1df0 2023-11-25T04:09:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020406dc30 msgr2=0x7f0204071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020406dc30 0x7f0204071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 >> v1:172.21.15.66:6789/0 conn(0x7f0204142d20 legacy=0x7f020406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02040b2520 con 0x7f02040b1df0 2023-11-25T04:09:13.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f01fc0019f0 con 0x7f02040b1df0 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 >> v1:172.21.15.2:6789/0 conn(0x7f02040b1df0 legacy=0x7f02040cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020406dc30 0x7f01ec0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec003f70 0x7f01ec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ec004d00 0x7f01ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0204143100 con 0x7f01ec004d00 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec00bac0 con 0x7f01ec003f70 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec00de90 con 0x7f020406dc30 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0208c08640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ec004d00 0x7f01ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0203fff640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020406dc30 0x7f01ec0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f02037fe640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec003f70 0x7f01ec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.671 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0208c08640 1 -- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020406dc30 msgr2=0x7f01ec0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0208c08640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020406dc30 0x7f01ec0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0208c08640 1 -- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec003f70 msgr2=0x7f01ec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0208c08640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01ec003f70 0x7f01ec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.666+0000 7f0208c08640 1 -- 172.21.15.2:0/1561838217 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec003520 con 0x7f01ec004d00 2023-11-25T04:09:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.667+0000 7f0208c08640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ec004d00 0x7f01ec005180 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a750 tx=0x7f01ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06d73afe1d8f0fa server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.667+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc034630 con 0x7f01ec004d00 2023-11-25T04:09:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.667+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc02f070 con 0x7f01ec004d00 2023-11-25T04:09:13.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.667+0000 7f0202ffd640 1 -- 172.21.15.2:0/1561838217 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc0349f0 con 0x7f01ec004d00 2023-11-25T04:09:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.668+0000 7f020a66b640 1 -- 172.21.15.2:0/1561838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ec004d00 msgr2=0x7f01ec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.668+0000 7f020a66b640 1 --2- 172.21.15.2:0/1561838217 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f01ec004d00 0x7f01ec005180 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00a750 tx=0x7f01ec0057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.668+0000 7f0208c08640 1 -- 172.21.15.2:0/1561838217 reap_dead start 2023-11-25T04:09:13.675 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.668+0000 7f020a66b640 1 -- 172.21.15.2:0/1561838217 shutdown_connections 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.668+0000 7f020a66b640 1 -- 172.21.15.2:0/1561838217 >> 172.21.15.2:0/1561838217 conn(0x7f02040b0af0 msgr2=0x7f02040b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.668+0000 7f020a66b640 1 -- 172.21.15.2:0/1561838217 shutdown_connections 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.668+0000 7f020a66b640 1 -- 172.21.15.2:0/1561838217 wait complete. 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.669+0000 7f020a66b640 1 Processor -- start 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.669+0000 7f020a66b640 1 -- start start 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f020a66b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020414ec50 0x7f020415be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f020a66b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02040c4070 0x7f02040c66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f020a66b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02040c6c10 0x7f02041ed880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f020a66b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02040c7090 con 0x7f02040c4070 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f020a66b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0204149610 con 0x7f02040c6c10 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f020a66b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020415c6c0 con 0x7f020414ec50 2023-11-25T04:09:13.676 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f02037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02040c4070 0x7f02040c66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f02037fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02040c4070 0x7f02040c66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56120/0 (socket says 172.21.15.2:56120) 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f02037fe640 1 -- 172.21.15.2:0/1897439172 learned_addr learned my addr 172.21.15.2:0/1897439172 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f0203fff640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020414ec50 0x7f020415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f02037fe640 1 -- 172.21.15.2:0/1897439172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020414ec50 msgr2=0x7f020415be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f02037fe640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020414ec50 0x7f020415be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f0208c08640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02040c6c10 0x7f02041ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f02037fe640 1 -- 172.21.15.2:0/1897439172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02040c6c10 msgr2=0x7f02041ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f02037fe640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02040c6c10 0x7f02041ed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f02037fe640 1 -- 172.21.15.2:0/1897439172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020415c9a0 con 0x7f02040c4070 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f0208c08640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02040c6c10 0x7f02041ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f02037fe640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02040c4070 0x7f02040c66d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f01f80119a0 tx=0x7f01f8011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:13.677 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.670+0000 7f0200ff9640 1 -- 172.21.15.2:0/1897439172 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f800faf0 con 0x7f02040c4070 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.671+0000 7f0200ff9640 1 -- 172.21.15.2:0/1897439172 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f800fc50 con 0x7f02040c4070 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.671+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020415cc80 con 0x7f02040c4070 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.671+0000 7f0200ff9640 1 -- 172.21.15.2:0/1897439172 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8014440 con 0x7f02040c4070 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.671+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f020415c3d0 con 0x7f02040c4070 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.672+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0204149780 con 0x7f02040c4070 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.672+0000 7f0200ff9640 1 -- 172.21.15.2:0/1897439172 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01f801d400 con 0x7f02040c4070 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.672+0000 7f0200ff9640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f01f006ae70 0x7f01f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.673+0000 7f0200ff9640 1 -- 172.21.15.2:0/1897439172 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01f8089e00 con 0x7f02040c4070 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.673+0000 7f0203fff640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f01f006ae70 0x7f01f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.673+0000 7f0203fff640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f01f006ae70 0x7f01f006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f01f4000c00 tx=0x7f01f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:13.679 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.677+0000 7f0200ff9640 1 -- 172.21.15.2:0/1897439172 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f01f8054eb0 con 0x7f02040c4070 2023-11-25T04:09:13.854 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.852+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0204067420 con 0x7f02040c4070 2023-11-25T04:09:13.855 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.853+0000 7f0200ff9640 1 -- 172.21.15.2:0/1897439172 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f01f80584d0 con 0x7f02040c4070 2023-11-25T04:09:13.855 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:13.856 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.855+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f01f006ae70 msgr2=0x7f01f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.855+0000 7f020a66b640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f01f006ae70 0x7f01f006d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f01f4000c00 tx=0x7f01f4009040 comp rx=0 tx=0).stop 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.855+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02040c4070 msgr2=0x7f02040c66d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.855+0000 7f020a66b640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02040c4070 0x7f02040c66d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f01f80119a0 tx=0x7f01f8011e60 comp rx=0 tx=0).stop 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.855+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 shutdown_connections 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.855+0000 7f020a66b640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f01f006ae70 0x7f01f006d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.856+0000 7f020a66b640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02040c6c10 0x7f02041ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.856+0000 7f020a66b640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f02040c4070 0x7f02040c66d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.856+0000 7f020a66b640 1 --2- 172.21.15.2:0/1897439172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f020414ec50 0x7f020415be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.858 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.856+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 >> 172.21.15.2:0/1897439172 conn(0x7f02040b0af0 msgr2=0x7f0204140520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.856+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 shutdown_connections 2023-11-25T04:09:13.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.856+0000 7f020a66b640 1 -- 172.21.15.2:0/1897439172 wait complete. 2023-11-25T04:09:13.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:13.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.977+0000 7f342a4d3640 1 Processor -- start 2023-11-25T04:09:13.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.977+0000 7f342a4d3640 1 -- start start 2023-11-25T04:09:13.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f342a4d3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f342409a080 0x7f34240cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f342a4d3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f342406bc50 0x7f342406c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f342a4d3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34240b3590 con 0x7f34240b6b50 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f342a4d3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f342406b310 con 0x7f342409a080 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f342a4d3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34240cd3a0 con 0x7f342406bc50 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f34237fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f342409a080 0x7f34240cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f34237fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f342409a080 0x7f34240cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56132/0 (socket says 172.21.15.2:56132) 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f34237fe640 1 -- 172.21.15.2:0/1537127066 learned_addr learned my addr 172.21.15.2:0/1537127066 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f3428a70640 1 --2- 172.21.15.2:0/1537127066 >> v2:172.21.15.66:3300/0 conn(0x7f342406bc50 0x7f342406c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f34237fe640 1 -- 172.21.15.2:0/1537127066 >> v2:172.21.15.66:3300/0 conn(0x7f342406bc50 msgr2=0x7f342406c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f34237fe640 1 --2- 172.21.15.2:0/1537127066 >> v2:172.21.15.66:3300/0 conn(0x7f342406bc50 0x7f342406c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f34237fe640 1 -- 172.21.15.2:0/1537127066 >> v1:172.21.15.66:6789/0 conn(0x7f34240b6b50 legacy=0x7f3424099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f34237fe640 1 -- 172.21.15.2:0/1537127066 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34240b37c0 con 0x7f342409a080 2023-11-25T04:09:13.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.978+0000 7f3428a70640 1 --2- 172.21.15.2:0/1537127066 >> v2:172.21.15.66:3300/0 conn(0x7f342406bc50 0x7f342406c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:13.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.979+0000 7f34237fe640 1 --2- 172.21.15.2:0/1537127066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 0x7f34240cfd40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3424072410 tx=0x7f341402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41e027aabf4d0fa server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:13.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.979+0000 7f3422ffd640 1 -- 172.21.15.2:0/1537127066 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414030860 con 0x7f342409a080 2023-11-25T04:09:13.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.979+0000 7f3422ffd640 1 -- 172.21.15.2:0/1537127066 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34140309c0 con 0x7f342409a080 2023-11-25T04:09:13.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.979+0000 7f3422ffd640 1 -- 172.21.15.2:0/1537127066 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414030d50 con 0x7f342409a080 2023-11-25T04:09:13.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.980+0000 7f342a4d3640 1 -- 172.21.15.2:0/1537127066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 msgr2=0x7f34240cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.980+0000 7f342a4d3640 1 --2- 172.21.15.2:0/1537127066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 0x7f34240cfd40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3424072410 tx=0x7f341402b9a0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.983 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.980+0000 7f342a4d3640 1 -- 172.21.15.2:0/1537127066 shutdown_connections 2023-11-25T04:09:13.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.980+0000 7f342a4d3640 1 --2- 172.21.15.2:0/1537127066 >> v2:172.21.15.66:3300/0 conn(0x7f342406bc50 0x7f342406c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.980+0000 7f342a4d3640 1 --2- 172.21.15.2:0/1537127066 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 0x7f34240cfd40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.980+0000 7f342a4d3640 1 -- 172.21.15.2:0/1537127066 >> 172.21.15.2:0/1537127066 conn(0x7f34240b2a70 msgr2=0x7f34240b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:13.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.980+0000 7f342a4d3640 1 -- 172.21.15.2:0/1537127066 shutdown_connections 2023-11-25T04:09:13.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.980+0000 7f342a4d3640 1 -- 172.21.15.2:0/1537127066 wait complete. 2023-11-25T04:09:13.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.981+0000 7f342a4d3640 1 Processor -- start 2023-11-25T04:09:13.984 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.981+0000 7f342a4d3640 1 -- start start 2023-11-25T04:09:13.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f342a4d3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f342406bc50 0x7f342414f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.986 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f342a4d3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 0x7f34240ae740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f342a4d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34240b6b50 0x7f34240af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f342a4d3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342414f9b0 con 0x7f342409a080 2023-11-25T04:09:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f342a4d3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34240b19b0 con 0x7f34240b6b50 2023-11-25T04:09:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f342a4d3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34240b16d0 con 0x7f342406bc50 2023-11-25T04:09:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f34237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 0x7f34240ae740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f34237fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 0x7f34240ae740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56148/0 (socket says 172.21.15.2:56148) 2023-11-25T04:09:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f34237fe640 1 -- 172.21.15.2:0/3963877879 learned_addr learned my addr 172.21.15.2:0/3963877879 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f3423fff640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f342406bc50 0x7f342414f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.987 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f3428a70640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34240b6b50 0x7f34240af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f34237fe640 1 -- 172.21.15.2:0/3963877879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f342406bc50 msgr2=0x7f342414f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f34237fe640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f342406bc50 0x7f342414f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f34237fe640 1 -- 172.21.15.2:0/3963877879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34240b6b50 msgr2=0x7f34240af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f34237fe640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34240b6b50 0x7f34240af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f34237fe640 1 -- 172.21.15.2:0/3963877879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34140094d0 con 0x7f342409a080 2023-11-25T04:09:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f3428a70640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34240b6b50 0x7f34240af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f34237fe640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 0x7f34240ae740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3414000c00 tx=0x7f3414004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f3420ff9640 1 -- 172.21.15.2:0/3963877879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414039d40 con 0x7f342409a080 2023-11-25T04:09:13.988 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f3420ff9640 1 -- 172.21.15.2:0/3963877879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3414043400 con 0x7f342409a080 2023-11-25T04:09:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.982+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34240adc60 con 0x7f342409a080 2023-11-25T04:09:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.983+0000 7f3420ff9640 1 -- 172.21.15.2:0/3963877879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3414039ea0 con 0x7f342409a080 2023-11-25T04:09:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.983+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34240ae220 con 0x7f342409a080 2023-11-25T04:09:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.983+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34240d0b40 con 0x7f342409a080 2023-11-25T04:09:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.984+0000 7f3420ff9640 1 -- 172.21.15.2:0/3963877879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34140437b0 con 0x7f342409a080 2023-11-25T04:09:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.984+0000 7f3420ff9640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f341006ae70 0x7f341006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.984+0000 7f3420ff9640 1 -- 172.21.15.2:0/3963877879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f341403e070 con 0x7f342409a080 2023-11-25T04:09:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.984+0000 7f3423fff640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f341006ae70 0x7f341006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:13.989 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.985+0000 7f3423fff640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f341006ae70 0x7f341006d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3418006fd0 tx=0x7f3418009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:13.990 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:13.989+0000 7f3420ff9640 1 -- 172.21.15.2:0/3963877879 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34140778a0 con 0x7f342409a080 2023-11-25T04:09:14.164 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.163+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f342409ef40 con 0x7f342409a080 2023-11-25T04:09:14.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.163+0000 7f3420ff9640 1 -- 172.21.15.2:0/3963877879 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f341407aec0 con 0x7f342409a080 2023-11-25T04:09:14.165 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f341006ae70 msgr2=0x7f341006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.167 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f341006ae70 0x7f341006d330 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3418006fd0 tx=0x7f3418009060 comp rx=0 tx=0).stop 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 msgr2=0x7f34240ae740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 0x7f34240ae740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3414000c00 tx=0x7f3414004730 comp rx=0 tx=0).stop 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 shutdown_connections 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f341006ae70 0x7f341006d330 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34240b6b50 0x7f34240af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f342409a080 0x7f34240ae740 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 --2- 172.21.15.2:0/3963877879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f342406bc50 0x7f342414f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 >> 172.21.15.2:0/3963877879 conn(0x7f34240b2a70 msgr2=0x7f34240b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 shutdown_connections 2023-11-25T04:09:14.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.165+0000 7f342a4d3640 1 -- 172.21.15.2:0/3963877879 wait complete. 2023-11-25T04:09:14.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:14.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.286+0000 7f79e1a0e640 1 Processor -- start 2023-11-25T04:09:14.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.286+0000 7f79e1a0e640 1 -- start start 2023-11-25T04:09:14.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.286+0000 7f79e1a0e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79dc15d690 0x7f79dc15e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.286+0000 7f79e1a0e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f79dc06e460 0x7f79dc0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.286+0000 7f79e1a0e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc09a720 con 0x7f79dc06ec60 2023-11-25T04:09:14.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.286+0000 7f79e1a0e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc15e9d0 con 0x7f79dc15d690 2023-11-25T04:09:14.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.286+0000 7f79e1a0e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc099b10 con 0x7f79dc06e460 2023-11-25T04:09:14.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.287+0000 7f79da7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79dc15d690 0x7f79dc15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.287+0000 7f79da7fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f79dc15d690 0x7f79dc15e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56152/0 (socket says 172.21.15.2:56152) 2023-11-25T04:09:14.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.287+0000 7f79da7fc640 1 -- 172.21.15.2:0/3576554527 learned_addr learned my addr 172.21.15.2:0/3576554527 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:14.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.287+0000 7f79db7fe640 1 --2- 172.21.15.2:0/3576554527 >> v2:172.21.15.66:3300/0 conn(0x7f79dc06e460 0x7f79dc0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.287+0000 7f79da7fc640 1 -- 172.21.15.2:0/3576554527 >> v2:172.21.15.66:3300/0 conn(0x7f79dc06e460 msgr2=0x7f79dc0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:14.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.287+0000 7f79da7fc640 1 --2- 172.21.15.2:0/3576554527 >> v2:172.21.15.66:3300/0 conn(0x7f79dc06e460 0x7f79dc0cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.287+0000 7f79da7fc640 1 -- 172.21.15.2:0/3576554527 >> v1:172.21.15.66:6789/0 conn(0x7f79dc06ec60 legacy=0x7f79dc06f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.287+0000 7f79da7fc640 1 -- 172.21.15.2:0/3576554527 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc099df0 con 0x7f79dc15d690 2023-11-25T04:09:14.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.288+0000 7f79da7fc640 1 --2- 172.21.15.2:0/3576554527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc15d690 0x7f79dc15e490 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f79dc072930 tx=0x7f79d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ebfa47814cae2c server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:14.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.289+0000 7f79d9ffb640 1 -- 172.21.15.2:0/3576554527 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0031870 con 0x7f79dc15d690 2023-11-25T04:09:14.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.289+0000 7f79d9ffb640 1 -- 172.21.15.2:0/3576554527 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00319d0 con 0x7f79dc15d690 2023-11-25T04:09:14.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.289+0000 7f79d9ffb640 1 -- 172.21.15.2:0/3576554527 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0031d60 con 0x7f79dc15d690 2023-11-25T04:09:14.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.289+0000 7f79e1a0e640 1 -- 172.21.15.2:0/3576554527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc15d690 msgr2=0x7f79dc15e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.289+0000 7f79e1a0e640 1 --2- 172.21.15.2:0/3576554527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc15d690 0x7f79dc15e490 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f79dc072930 tx=0x7f79d002b910 comp rx=0 tx=0).stop 2023-11-25T04:09:14.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.289+0000 7f79e1a0e640 1 -- 172.21.15.2:0/3576554527 shutdown_connections 2023-11-25T04:09:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.289+0000 7f79e1a0e640 1 --2- 172.21.15.2:0/3576554527 >> v2:172.21.15.66:3300/0 conn(0x7f79dc06e460 0x7f79dc0cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.289+0000 7f79e1a0e640 1 --2- 172.21.15.2:0/3576554527 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc15d690 0x7f79dc15e490 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.289+0000 7f79e1a0e640 1 -- 172.21.15.2:0/3576554527 >> 172.21.15.2:0/3576554527 conn(0x7f79dc0b2a20 msgr2=0x7f79dc0b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.290+0000 7f79e1a0e640 1 -- 172.21.15.2:0/3576554527 shutdown_connections 2023-11-25T04:09:14.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.290+0000 7f79e1a0e640 1 -- 172.21.15.2:0/3576554527 wait complete. 2023-11-25T04:09:14.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.291+0000 7f79e1a0e640 1 Processor -- start 2023-11-25T04:09:14.295 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.291+0000 7f79e1a0e640 1 -- start start 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.291+0000 7f79e1a0e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79dc06e460 0x7f79dc0b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79e1a0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc06ec60 0x7f79dc0b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79e1a0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79dc154d90 0x7f79dc1f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79e1a0e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc161a50 con 0x7f79dc06ec60 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79e1a0e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc1f44b0 con 0x7f79dc154d90 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79e1a0e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc15fc90 con 0x7f79dc06e460 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79da7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc06ec60 0x7f79dc0b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79da7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc06ec60 0x7f79dc0b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56168/0 (socket says 172.21.15.2:56168) 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79da7fc640 1 -- 172.21.15.2:0/1454054934 learned_addr learned my addr 172.21.15.2:0/1454054934 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:14.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79daffd640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79dc06e460 0x7f79dc0b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79db7fe640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79dc154d90 0x7f79dc1f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79da7fc640 1 -- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79dc06e460 msgr2=0x7f79dc0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79da7fc640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79dc06e460 0x7f79dc0b1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79da7fc640 1 -- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79dc154d90 msgr2=0x7f79dc1f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79da7fc640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79dc154d90 0x7f79dc1f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79da7fc640 1 -- 172.21.15.2:0/1454054934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00094d0 con 0x7f79dc06ec60 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79daffd640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79dc06e460 0x7f79dc0b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79db7fe640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79dc154d90 0x7f79dc1f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79da7fc640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc06ec60 0x7f79dc0b1f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f79d002b950 tx=0x7f79d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79c3fff640 1 -- 172.21.15.2:0/1454054934 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d003abe0 con 0x7f79dc06ec60 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79c3fff640 1 -- 172.21.15.2:0/1454054934 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d003ad60 con 0x7f79dc06ec60 2023-11-25T04:09:14.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc15ff70 con 0x7f79dc06ec60 2023-11-25T04:09:14.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79c3fff640 1 -- 172.21.15.2:0/1454054934 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0044630 con 0x7f79dc06ec60 2023-11-25T04:09:14.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.292+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc160530 con 0x7f79dc06ec60 2023-11-25T04:09:14.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.293+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc09f040 con 0x7f79dc06ec60 2023-11-25T04:09:14.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.294+0000 7f79c3fff640 1 -- 172.21.15.2:0/1454054934 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79d0044790 con 0x7f79dc06ec60 2023-11-25T04:09:14.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.294+0000 7f79c3fff640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f79c806ae70 0x7f79c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.294+0000 7f79c3fff640 1 -- 172.21.15.2:0/1454054934 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79d002d040 con 0x7f79dc06ec60 2023-11-25T04:09:14.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.294+0000 7f79daffd640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f79c806ae70 0x7f79c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.295+0000 7f79daffd640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f79c806ae70 0x7f79c806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79cc007fd0 tx=0x7f79cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:14.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.298+0000 7f79c3fff640 1 -- 172.21.15.2:0/1454054934 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79d0076ca0 con 0x7f79dc06ec60 2023-11-25T04:09:14.474 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.472+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79dc0ce410 con 0x7f79dc06ec60 2023-11-25T04:09:14.475 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.473+0000 7f79c3fff640 1 -- 172.21.15.2:0/1454054934 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79d00350a0 con 0x7f79dc06ec60 2023-11-25T04:09:14.475 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f79c806ae70 msgr2=0x7f79c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f79c806ae70 0x7f79c806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79cc007fd0 tx=0x7f79cc009040 comp rx=0 tx=0).stop 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc06ec60 msgr2=0x7f79dc0b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc06ec60 0x7f79dc0b1f50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f79d002b950 tx=0x7f79d00046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 shutdown_connections 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f79c806ae70 0x7f79c806d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79dc154d90 0x7f79dc1f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f79dc06ec60 0x7f79dc0b1f50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 --2- 172.21.15.2:0/1454054934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79dc06e460 0x7f79dc0b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 >> 172.21.15.2:0/1454054934 conn(0x7f79dc0b2a20 msgr2=0x7f79dc06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:14.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 shutdown_connections 2023-11-25T04:09:14.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.475+0000 7f79e1a0e640 1 -- 172.21.15.2:0/1454054934 wait complete. 2023-11-25T04:09:14.488 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:14.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.595+0000 7fb5f249b640 1 Processor -- start 2023-11-25T04:09:14.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.596+0000 7fb5f249b640 1 -- start start 2023-11-25T04:09:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.596+0000 7fb5f249b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec160b70 0x7fb5ec0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.596+0000 7fb5f249b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb5ec0b2aa0 0x7fb5ec0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.596+0000 7fb5f249b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec0ce360 con 0x7fb5ec0ced30 2023-11-25T04:09:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.596+0000 7fb5f249b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5ec0b2f20 con 0x7fb5ec0b2aa0 2023-11-25T04:09:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.596+0000 7fb5f249b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0cdd50 con 0x7fb5ec160b70 2023-11-25T04:09:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5ebfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec160b70 0x7fb5ec0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5eb7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb5ec0b2aa0 0x7fb5ec0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5ebfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec160b70 0x7fb5ec0d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:44936/0 (socket says 172.21.15.2:44936) 2023-11-25T04:09:14.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5eb7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb5ec0b2aa0 0x7fb5ec0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:37422/0 (socket says 172.21.15.2:37422) 2023-11-25T04:09:14.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5ebfff640 1 -- 172.21.15.2:0/2940383100 learned_addr learned my addr 172.21.15.2:0/2940383100 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:14.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5eb7fe640 1 -- 172.21.15.2:0/2940383100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec160b70 msgr2=0x7fb5ec0d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:14.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5eb7fe640 1 --2- 172.21.15.2:0/2940383100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec160b70 0x7fb5ec0d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5eb7fe640 1 -- 172.21.15.2:0/2940383100 >> v1:172.21.15.66:6789/0 conn(0x7fb5ec0ced30 legacy=0x7fb5ec0cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5eb7fe640 1 -- 172.21.15.2:0/2940383100 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec0d1c70 con 0x7fb5ec0b2aa0 2023-11-25T04:09:14.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.597+0000 7fb5ebfff640 1 --2- 172.21.15.2:0/2940383100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec160b70 0x7fb5ec0d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:09:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.598+0000 7fb5eb7fe640 1 --2- 172.21.15.2:0/2940383100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5ec0b2aa0 0x7fb5ec0ce7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00097a0 tx=0x7fb5e002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6295079ec230d05 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.598+0000 7fb5eaffd640 1 -- 172.21.15.2:0/2940383100 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0031830 con 0x7fb5ec0b2aa0 2023-11-25T04:09:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.598+0000 7fb5eaffd640 1 -- 172.21.15.2:0/2940383100 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e0031990 con 0x7fb5ec0b2aa0 2023-11-25T04:09:14.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.598+0000 7fb5eaffd640 1 -- 172.21.15.2:0/2940383100 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e0031d20 con 0x7fb5ec0b2aa0 2023-11-25T04:09:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.599+0000 7fb5f249b640 1 -- 172.21.15.2:0/2940383100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5ec0b2aa0 msgr2=0x7fb5ec0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.599+0000 7fb5f249b640 1 --2- 172.21.15.2:0/2940383100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5ec0b2aa0 0x7fb5ec0ce7f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5e00097a0 tx=0x7fb5e002b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.599+0000 7fb5f249b640 1 -- 172.21.15.2:0/2940383100 shutdown_connections 2023-11-25T04:09:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.599+0000 7fb5f249b640 1 --2- 172.21.15.2:0/2940383100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5ec0b2aa0 0x7fb5ec0ce7f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.599+0000 7fb5f249b640 1 --2- 172.21.15.2:0/2940383100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec160b70 0x7fb5ec0d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.599+0000 7fb5f249b640 1 -- 172.21.15.2:0/2940383100 >> 172.21.15.2:0/2940383100 conn(0x7fb5ec09c470 msgr2=0x7fb5ec0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.599+0000 7fb5f249b640 1 -- 172.21.15.2:0/2940383100 shutdown_connections 2023-11-25T04:09:14.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.599+0000 7fb5f249b640 1 -- 172.21.15.2:0/2940383100 wait complete. 2023-11-25T04:09:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.600+0000 7fb5f249b640 1 Processor -- start 2023-11-25T04:09:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.600+0000 7fb5f249b640 1 -- start start 2023-11-25T04:09:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f249b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec0b2aa0 0x7fb5ec156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f249b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5ec0ced30 0x7fb5ec0a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.604 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f249b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec160b70 0x7fb5ec0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f249b640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0a0da0 con 0x7fb5ec160b70 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f249b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec09d6f0 con 0x7fb5ec0ced30 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f249b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec09cee0 con 0x7fb5ec0b2aa0 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f0a38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec160b70 0x7fb5ec0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f0a38640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec160b70 0x7fb5ec0cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56180/0 (socket says 172.21.15.2:56180) 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f0a38640 1 -- 172.21.15.2:0/1208271913 learned_addr learned my addr 172.21.15.2:0/1208271913 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5ebfff640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec0b2aa0 0x7fb5ec156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5eb7fe640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5ec0ced30 0x7fb5ec0a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f0a38640 1 -- 172.21.15.2:0/1208271913 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec0b2aa0 msgr2=0x7fb5ec156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f0a38640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec0b2aa0 0x7fb5ec156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f0a38640 1 -- 172.21.15.2:0/1208271913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5ec0ced30 msgr2=0x7fb5ec0a0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f0a38640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5ec0ced30 0x7fb5ec0a0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f0a38640 1 -- 172.21.15.2:0/1208271913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0094d0 con 0x7fb5ec160b70 2023-11-25T04:09:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.601+0000 7fb5f0a38640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec160b70 0x7fb5ec0cc680 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c7a0 tx=0x7fb5e400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.602+0000 7fb5e8ff9640 1 -- 172.21.15.2:0/1208271913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4003b70 con 0x7fb5ec160b70 2023-11-25T04:09:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.602+0000 7fb5e8ff9640 1 -- 172.21.15.2:0/1208271913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4003cf0 con 0x7fb5ec160b70 2023-11-25T04:09:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.602+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e0009400 con 0x7fb5ec160b70 2023-11-25T04:09:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.602+0000 7fb5e8ff9640 1 -- 172.21.15.2:0/1208271913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4003ea0 con 0x7fb5ec160b70 2023-11-25T04:09:14.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.602+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec0cbc20 con 0x7fb5ec160b70 2023-11-25T04:09:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.603+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec0cc370 con 0x7fb5ec160b70 2023-11-25T04:09:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.603+0000 7fb5e8ff9640 1 -- 172.21.15.2:0/1208271913 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb5e400aa90 con 0x7fb5ec160b70 2023-11-25T04:09:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.603+0000 7fb5e8ff9640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5d806ae70 0x7fb5d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.604+0000 7fb5e8ff9640 1 -- 172.21.15.2:0/1208271913 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5e40894b0 con 0x7fb5ec160b70 2023-11-25T04:09:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.604+0000 7fb5ebfff640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5d806ae70 0x7fb5d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.604+0000 7fb5ebfff640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5d806ae70 0x7fb5d806d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009c50 tx=0x7fb5dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:14.609 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.608+0000 7fb5e8ff9640 1 -- 172.21.15.2:0/1208271913 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb5e40544e0 con 0x7fb5ec160b70 2023-11-25T04:09:14.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.785+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5ec0a1150 con 0x7fb5ec160b70 2023-11-25T04:09:14.789 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.785+0000 7fb5e8ff9640 1 -- 172.21.15.2:0/1208271913 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5e4057b00 con 0x7fb5ec160b70 2023-11-25T04:09:14.790 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:14.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5d806ae70 msgr2=0x7fb5d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5d806ae70 0x7fb5d806d330 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc009c50 tx=0x7fb5dc008040 comp rx=0 tx=0).stop 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec160b70 msgr2=0x7fb5ec0cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec160b70 0x7fb5ec0cc680 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c7a0 tx=0x7fb5e400cc60 comp rx=0 tx=0).stop 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 shutdown_connections 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb5ec160b70 0x7fb5ec0cc680 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5d806ae70 0x7fb5d806d330 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5ec0ced30 0x7fb5ec0a0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 --2- 172.21.15.2:0/1208271913 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5ec0b2aa0 0x7fb5ec156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 >> 172.21.15.2:0/1208271913 conn(0x7fb5ec09c470 msgr2=0x7fb5ec06b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 shutdown_connections 2023-11-25T04:09:14.791 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.787+0000 7fb5f249b640 1 -- 172.21.15.2:0/1208271913 wait complete. 2023-11-25T04:09:14.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-25T04:09:14.907 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.906+0000 7fe41cdd5640 1 Processor -- start 2023-11-25T04:09:14.908 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.906+0000 7fe41cdd5640 1 -- start start 2023-11-25T04:09:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.906+0000 7fe41cdd5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe418144310 0x7fe418144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.906+0000 7fe41cdd5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4180ce7e0 0x7fe4180b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.906+0000 7fe41cdd5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe41806c890 0x7fe41806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.906+0000 7fe41cdd5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4180b3980 con 0x7fe418144310 2023-11-25T04:09:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.906+0000 7fe41cdd5640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4180cec60 con 0x7fe41806c890 2023-11-25T04:09:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.906+0000 7fe41cdd5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41806d240 con 0x7fe4180ce7e0 2023-11-25T04:09:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe41659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe418144310 0x7fe418144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe41659c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe418144310 0x7fe418144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56186/0 (socket says 172.21.15.2:56186) 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe41659c640 1 -- 172.21.15.2:0/1252144957 learned_addr learned my addr 172.21.15.2:0/1252144957 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe416d9d640 1 --2- 172.21.15.2:0/1252144957 >> v2:172.21.15.66:3300/0 conn(0x7fe41806c890 0x7fe41806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe40ffff640 1 --2- 172.21.15.2:0/1252144957 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4180ce7e0 0x7fe4180b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe41659c640 1 -- 172.21.15.2:0/1252144957 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4180ce7e0 msgr2=0x7fe4180b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe41659c640 1 --2- 172.21.15.2:0/1252144957 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4180ce7e0 0x7fe4180b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe41659c640 1 -- 172.21.15.2:0/1252144957 >> v2:172.21.15.66:3300/0 conn(0x7fe41806c890 msgr2=0x7fe41806cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe41659c640 1 --2- 172.21.15.2:0/1252144957 >> v2:172.21.15.66:3300/0 conn(0x7fe41806c890 0x7fe41806cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe41659c640 1 -- 172.21.15.2:0/1252144957 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4181446f0 con 0x7fe418144310 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe416d9d640 1 --2- 172.21.15.2:0/1252144957 >> v2:172.21.15.66:3300/0 conn(0x7fe41806c890 0x7fe41806cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.907+0000 7fe40ffff640 1 --2- 172.21.15.2:0/1252144957 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4180ce7e0 0x7fe4180b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41659c640 1 --2- 172.21.15.2:0/1252144957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe418144310 0x7fe418144950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe4180700a0 tx=0x7fe40802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccd1da029785cc server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe415d9b640 1 -- 172.21.15.2:0/1252144957 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408031640 con 0x7fe418144310 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe415d9b640 1 -- 172.21.15.2:0/1252144957 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4080317a0 con 0x7fe418144310 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe415d9b640 1 -- 172.21.15.2:0/1252144957 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408031b30 con 0x7fe418144310 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41cdd5640 1 -- 172.21.15.2:0/1252144957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe418144310 msgr2=0x7fe418144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/1252144957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe418144310 0x7fe418144950 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe4180700a0 tx=0x7fe40802b8f0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41cdd5640 1 -- 172.21.15.2:0/1252144957 shutdown_connections 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/1252144957 >> v2:172.21.15.66:3300/0 conn(0x7fe41806c890 0x7fe41806cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/1252144957 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4180ce7e0 0x7fe4180b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/1252144957 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe418144310 0x7fe418144950 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41cdd5640 1 -- 172.21.15.2:0/1252144957 >> 172.21.15.2:0/1252144957 conn(0x7fe41806a8f0 msgr2=0x7fe41806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41cdd5640 1 -- 172.21.15.2:0/1252144957 shutdown_connections 2023-11-25T04:09:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.908+0000 7fe41cdd5640 1 -- 172.21.15.2:0/1252144957 wait complete. 2023-11-25T04:09:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.910+0000 7fe41cdd5640 1 Processor -- start 2023-11-25T04:09:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.910+0000 7fe41cdd5640 1 -- start start 2023-11-25T04:09:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.910+0000 7fe41cdd5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe41806c890 0x7fe4181542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.910+0000 7fe41cdd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180ce7e0 0x7fe418156d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.910+0000 7fe41cdd5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe418144310 0x7fe418157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.910+0000 7fe41cdd5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe418070480 con 0x7fe4180ce7e0 2023-11-25T04:09:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.910+0000 7fe41cdd5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4181581b0 con 0x7fe41806c890 2023-11-25T04:09:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.910+0000 7fe41cdd5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe418157910 con 0x7fe418144310 2023-11-25T04:09:14.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180ce7e0 0x7fe418156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40ffff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180ce7e0 0x7fe418156d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56200/0 (socket says 172.21.15.2:56200) 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40ffff640 1 -- 172.21.15.2:0/2389758038 learned_addr learned my addr 172.21.15.2:0/2389758038 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe41659c640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe41806c890 0x7fe4181542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe416d9d640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe418144310 0x7fe418157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40ffff640 1 -- 172.21.15.2:0/2389758038 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe418144310 msgr2=0x7fe418157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40ffff640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe418144310 0x7fe418157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40ffff640 1 -- 172.21.15.2:0/2389758038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe41806c890 msgr2=0x7fe4181542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40ffff640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe41806c890 0x7fe4181542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40ffff640 1 -- 172.21.15.2:0/2389758038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080094d0 con 0x7fe4180ce7e0 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40ffff640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180ce7e0 0x7fe418156d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe40000c7f0 tx=0x7fe40000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40effd640 1 -- 172.21.15.2:0/2389758038 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe400007a30 con 0x7fe4180ce7e0 2023-11-25T04:09:14.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40effd640 1 -- 172.21.15.2:0/2389758038 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe400007b90 con 0x7fe4180ce7e0 2023-11-25T04:09:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe40effd640 1 -- 172.21.15.2:0/2389758038 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40000ce40 con 0x7fe4180ce7e0 2023-11-25T04:09:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe418157bf0 con 0x7fe4180ce7e0 2023-11-25T04:09:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.911+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4180adcb0 con 0x7fe4180ce7e0 2023-11-25T04:09:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.912+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4180705c0 con 0x7fe4180ce7e0 2023-11-25T04:09:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.913+0000 7fe40effd640 1 -- 172.21.15.2:0/2389758038 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe4000113f0 con 0x7fe4180ce7e0 2023-11-25T04:09:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.913+0000 7fe40effd640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3f806ae40 0x7fe3f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.913+0000 7fe40effd640 1 -- 172.21.15.2:0/2389758038 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4000897e0 con 0x7fe4180ce7e0 2023-11-25T04:09:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.914+0000 7fe41659c640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3f806ae40 0x7fe3f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:14.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.914+0000 7fe41659c640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3f806ae40 0x7fe3f806d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe408036000 tx=0x7fe40803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:14.919 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:14.918+0000 7fe40effd640 1 -- 172.21.15.2:0/2389758038 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe4180705c0 con 0x7fe4180ce7e0 2023-11-25T04:09:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.105+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe4180705c0 con 0x7fe4180ce7e0 2023-11-25T04:09:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.106+0000 7fe40effd640 1 -- 172.21.15.2:0/2389758038 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe4180705c0 con 0x7fe4180ce7e0 2023-11-25T04:09:15.108 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-25T04:09:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3f806ae40 msgr2=0x7fe3f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3f806ae40 0x7fe3f806d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe408036000 tx=0x7fe40803c040 comp rx=0 tx=0).stop 2023-11-25T04:09:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180ce7e0 msgr2=0x7fe418156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180ce7e0 0x7fe418156d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe40000c7f0 tx=0x7fe40000cbf0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 shutdown_connections 2023-11-25T04:09:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe418144310 0x7fe418157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.110 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe4180ce7e0 0x7fe418156d50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe3f806ae40 0x7fe3f806d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 --2- 172.21.15.2:0/2389758038 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe41806c890 0x7fe4181542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 >> 172.21.15.2:0/2389758038 conn(0x7fe41806a8f0 msgr2=0x7fe41815d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.107+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 shutdown_connections 2023-11-25T04:09:15.111 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.108+0000 7fe41cdd5640 1 -- 172.21.15.2:0/2389758038 wait complete. 2023-11-25T04:09:15.123 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:09:15.123 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:15.139 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:15.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.284+0000 7f855272c640 1 Processor -- start 2023-11-25T04:09:15.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.284+0000 7f855272c640 1 -- start start 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.285+0000 7f855272c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f854c06abe0 0x7f854c0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.285+0000 7f855272c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f854c071d40 0x7f854c160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.285+0000 7f855272c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854c0cf790 con 0x7f854c1465d0 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.285+0000 7f855272c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c161d80 con 0x7f854c06abe0 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.285+0000 7f855272c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c1612d0 con 0x7f854c071d40 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.285+0000 7f854b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f854c06abe0 0x7f854c0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.285+0000 7f854b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f854c06abe0 0x7f854c0b2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56210/0 (socket says 172.21.15.2:56210) 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.285+0000 7f854b7fe640 1 -- 172.21.15.2:0/1760427068 learned_addr learned my addr 172.21.15.2:0/1760427068 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.285+0000 7f8550cc9640 1 --2- 172.21.15.2:0/1760427068 >> v2:172.21.15.66:3300/0 conn(0x7f854c071d40 0x7f854c160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.286+0000 7f854b7fe640 1 -- 172.21.15.2:0/1760427068 >> v2:172.21.15.66:3300/0 conn(0x7f854c071d40 msgr2=0x7f854c160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.286+0000 7f854b7fe640 1 --2- 172.21.15.2:0/1760427068 >> v2:172.21.15.66:3300/0 conn(0x7f854c071d40 0x7f854c160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.286+0000 7f854b7fe640 1 -- 172.21.15.2:0/1760427068 >> v1:172.21.15.66:6789/0 conn(0x7f854c1465d0 legacy=0x7f854c06a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.286+0000 7f854b7fe640 1 -- 172.21.15.2:0/1760427068 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c072160 con 0x7f854c06abe0 2023-11-25T04:09:15.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.286+0000 7f854b7fe640 1 --2- 172.21.15.2:0/1760427068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c06abe0 0x7f854c0b2ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f854c0d0ee0 tx=0x7f853c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b60138c73eedaa server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:15.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f854affd640 1 -- 172.21.15.2:0/1760427068 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c030860 con 0x7f854c06abe0 2023-11-25T04:09:15.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f854affd640 1 -- 172.21.15.2:0/1760427068 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c0309c0 con 0x7f854c06abe0 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f854affd640 1 -- 172.21.15.2:0/1760427068 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c030d50 con 0x7f854c06abe0 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f855272c640 1 -- 172.21.15.2:0/1760427068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c06abe0 msgr2=0x7f854c0b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f855272c640 1 --2- 172.21.15.2:0/1760427068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c06abe0 0x7f854c0b2ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f854c0d0ee0 tx=0x7f853c02b9a0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f855272c640 1 -- 172.21.15.2:0/1760427068 shutdown_connections 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f855272c640 1 --2- 172.21.15.2:0/1760427068 >> v2:172.21.15.66:3300/0 conn(0x7f854c071d40 0x7f854c160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f855272c640 1 --2- 172.21.15.2:0/1760427068 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c06abe0 0x7f854c0b2ee0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f855272c640 1 -- 172.21.15.2:0/1760427068 >> 172.21.15.2:0/1760427068 conn(0x7f854c0cc930 msgr2=0x7f854c0ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f855272c640 1 -- 172.21.15.2:0/1760427068 shutdown_connections 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.287+0000 7f855272c640 1 -- 172.21.15.2:0/1760427068 wait complete. 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.288+0000 7f855272c640 1 Processor -- start 2023-11-25T04:09:15.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.289+0000 7f855272c640 1 -- start start 2023-11-25T04:09:15.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.289+0000 7f855272c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c06abe0 0x7f854c13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.293 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.289+0000 7f855272c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c071d40 0x7f854c13e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.289+0000 7f855272c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f854c1465d0 0x7f854c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.289+0000 7f855272c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c13fe70 con 0x7f854c071d40 2023-11-25T04:09:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.289+0000 7f855272c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c13f1f0 con 0x7f854c06abe0 2023-11-25T04:09:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.289+0000 7f855272c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c13f4d0 con 0x7f854c1465d0 2023-11-25T04:09:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.289+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c071d40 0x7f854c13e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f854b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c071d40 0x7f854c13e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56220/0 (socket says 172.21.15.2:56220) 2023-11-25T04:09:15.294 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f854b7fe640 1 -- 172.21.15.2:0/3495588875 learned_addr learned my addr 172.21.15.2:0/3495588875 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f854bfff640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c06abe0 0x7f854c13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f8550cc9640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f854c1465d0 0x7f854c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f854b7fe640 1 -- 172.21.15.2:0/3495588875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f854c1465d0 msgr2=0x7f854c0b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f854b7fe640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f854c1465d0 0x7f854c0b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f854b7fe640 1 -- 172.21.15.2:0/3495588875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c06abe0 msgr2=0x7f854c13e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f854b7fe640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c06abe0 0x7f854c13e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f854b7fe640 1 -- 172.21.15.2:0/3495588875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0094d0 con 0x7f854c071d40 2023-11-25T04:09:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f854b7fe640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c071d40 0x7f854c13e9a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f853c02b9e0 tx=0x7f853c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f8548ff9640 1 -- 172.21.15.2:0/3495588875 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c039d60 con 0x7f854c071d40 2023-11-25T04:09:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f8548ff9640 1 -- 172.21.15.2:0/3495588875 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c043400 con 0x7f854c071d40 2023-11-25T04:09:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c13f7b0 con 0x7f854c071d40 2023-11-25T04:09:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f8548ff9640 1 -- 172.21.15.2:0/3495588875 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0437b0 con 0x7f854c071d40 2023-11-25T04:09:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.290+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c13eee0 con 0x7f854c071d40 2023-11-25T04:09:15.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.291+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c073ee0 con 0x7f854c071d40 2023-11-25T04:09:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.292+0000 7f8548ff9640 1 -- 172.21.15.2:0/3495588875 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f853c043910 con 0x7f854c071d40 2023-11-25T04:09:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.292+0000 7f8548ff9640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f852c06ae40 0x7f852c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.292+0000 7f8548ff9640 1 -- 172.21.15.2:0/3495588875 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f853c03e070 con 0x7f854c071d40 2023-11-25T04:09:15.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.292+0000 7f854bfff640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f852c06ae40 0x7f852c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.293+0000 7f854bfff640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f852c06ae40 0x7f852c06d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8534000f60 tx=0x7f8534009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:15.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.296+0000 7f8548ff9640 1 -- 172.21.15.2:0/3495588875 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f853c0779b0 con 0x7f854c071d40 2023-11-25T04:09:15.477 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.475+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f854c06b250 con 0x7f854c071d40 2023-11-25T04:09:15.478 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.476+0000 7f8548ff9640 1 -- 172.21.15.2:0/3495588875 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16397 (secure 0 0 0) 0x7f853c07afd0 con 0x7f854c071d40 2023-11-25T04:09:15.478 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:15.479 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":20,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:08:37.136621+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:15.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f852c06ae40 msgr2=0x7f852c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f852c06ae40 0x7f852c06d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8534000f60 tx=0x7f8534009040 comp rx=0 tx=0).stop 2023-11-25T04:09:15.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c071d40 msgr2=0x7f854c13e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c071d40 0x7f854c13e9a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f853c02b9e0 tx=0x7f853c004730 comp rx=0 tx=0).stop 2023-11-25T04:09:15.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 shutdown_connections 2023-11-25T04:09:15.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f854c1465d0 0x7f854c0b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f854c071d40 0x7f854c13e9a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f852c06ae40 0x7f852c06d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 --2- 172.21.15.2:0/3495588875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f854c06abe0 0x7f854c13e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 >> 172.21.15.2:0/3495588875 conn(0x7f854c0cc930 msgr2=0x7f854c06e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:15.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 shutdown_connections 2023-11-25T04:09:15.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.478+0000 7f855272c640 1 -- 172.21.15.2:0/3495588875 wait complete. 2023-11-25T04:09:15.492 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:15.492 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:15.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.601+0000 7f35e0dd5640 1 Processor -- start 2023-11-25T04:09:15.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.601+0000 7f35e0dd5640 1 -- start start 2023-11-25T04:09:15.605 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.601+0000 7f35e0dd5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35dc160b70 0x7f35dc0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.601+0000 7f35e0dd5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35dc0ce360 con 0x7f35dc0b2aa0 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.601+0000 7f35e0dd5640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35dc0b2f20 con 0x7f35dc0cef00 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.601+0000 7f35e0dd5640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc0cdd50 con 0x7f35dc160b70 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d3fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f35dc0b2aa0 0x7f35dc0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48372/0 (socket says 172.21.15.2:48372) 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d3fff640 1 -- 172.21.15.2:0/1197671436 learned_addr learned my addr 172.21.15.2:0/1197671436 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35da59c640 1 --2- 172.21.15.2:0/1197671436 >> v2:172.21.15.66:3300/0 conn(0x7f35dc160b70 0x7f35dc0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3605081265 0 0) 0x7f35dc0ce360 con 0x7f35dc0b2aa0 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c8003520 con 0x7f35dc0b2aa0 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4038154853 0 0) 0x7f35c8003520 con 0x7f35dc0b2aa0 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 >> v2:172.21.15.66:3300/0 conn(0x7f35dc160b70 msgr2=0x7f35dc0d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 --2- 172.21.15.2:0/1197671436 >> v2:172.21.15.66:3300/0 conn(0x7f35dc160b70 0x7f35dc0d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.606 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 >> v1:172.21.15.66:6789/0 conn(0x7f35dc0cef00 legacy=0x7f35dc161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc0d1c70 con 0x7f35dc0b2aa0 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f35c4001670 con 0x7f35dc0b2aa0 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 >> v1:172.21.15.2:6789/0 conn(0x7f35dc0b2aa0 legacy=0x7f35dc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35c8003970 0x7f35c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35c80047c0 0x7f35c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c8005180 0x7f35c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0cdd50 con 0x7f35c8005180 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c800c020 con 0x7f35c8003970 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35c800c1e0 con 0x7f35c80047c0 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35dad9d640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c8005180 0x7f35c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35da59c640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35c8003970 0x7f35c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.602+0000 7f35d3fff640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35c80047c0 0x7f35c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.607 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.603+0000 7f35dad9d640 1 -- 172.21.15.2:0/1197671436 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35c80047c0 msgr2=0x7f35c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:15.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.603+0000 7f35dad9d640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35c80047c0 0x7f35c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.603+0000 7f35dad9d640 1 -- 172.21.15.2:0/1197671436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35c8003970 msgr2=0x7f35c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:15.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.603+0000 7f35dad9d640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35c8003970 0x7f35c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.603+0000 7f35dad9d640 1 -- 172.21.15.2:0/1197671436 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c8003520 con 0x7f35c8005180 2023-11-25T04:09:15.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.603+0000 7f35dad9d640 1 -- 172.21.15.2:0/1197671436 reap_dead start 2023-11-25T04:09:15.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.603+0000 7f35dad9d640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c8005180 0x7f35c800b980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f35d4001e50 tx=0x7f35c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673765d62f21a3fa server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:15.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4003b70 con 0x7f35c8005180 2023-11-25T04:09:15.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d4003d10 con 0x7f35c8005180 2023-11-25T04:09:15.608 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35d9d9b640 1 -- 172.21.15.2:0/1197671436 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4005310 con 0x7f35c8005180 2023-11-25T04:09:15.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35e0dd5640 1 -- 172.21.15.2:0/1197671436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c8005180 msgr2=0x7f35c800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35e0dd5640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c8005180 0x7f35c800b980 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f35d4001e50 tx=0x7f35c80057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35e0dd5640 1 -- 172.21.15.2:0/1197671436 shutdown_connections 2023-11-25T04:09:15.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35e0dd5640 1 --2- 172.21.15.2:0/1197671436 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35c8005180 0x7f35c800b980 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35e0dd5640 1 -- 172.21.15.2:0/1197671436 >> 172.21.15.2:0/1197671436 conn(0x7f35dc09c470 msgr2=0x7f35dc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:15.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35e0dd5640 1 -- 172.21.15.2:0/1197671436 shutdown_connections 2023-11-25T04:09:15.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.604+0000 7f35e0dd5640 1 -- 172.21.15.2:0/1197671436 wait complete. 2023-11-25T04:09:15.611 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.605+0000 7f35e0dd5640 1 Processor -- start 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35e0dd5640 1 -- start start 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35e0dd5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35c8005180 0x7f35dc0b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35e0dd5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35dc149240 0x7f35dc15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35e0dd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc1485f0 0x7f35dc148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35e0dd5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0cd050 con 0x7f35dc1485f0 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35e0dd5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc148fb0 con 0x7f35dc149240 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35e0dd5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc0b72a0 con 0x7f35c8005180 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35dad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc1485f0 0x7f35dc148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35dad9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc1485f0 0x7f35dc148a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56236/0 (socket says 172.21.15.2:56236) 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.606+0000 7f35dad9d640 1 -- 172.21.15.2:0/3755811859 learned_addr learned my addr 172.21.15.2:0/3755811859 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35d3fff640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35dc149240 0x7f35dc15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.612 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35da59c640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35c8005180 0x7f35dc0b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35dad9d640 1 -- 172.21.15.2:0/3755811859 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35c8005180 msgr2=0x7f35dc0b6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35dad9d640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35c8005180 0x7f35dc0b6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35dad9d640 1 -- 172.21.15.2:0/3755811859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35dc149240 msgr2=0x7f35dc15cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35dad9d640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35dc149240 0x7f35dc15cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35dad9d640 1 -- 172.21.15.2:0/3755811859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc0b7580 con 0x7f35dc1485f0 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35dad9d640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc1485f0 0x7f35dc148a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35d4001f70 tx=0x7f35d40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35d2ffd640 1 -- 172.21.15.2:0/3755811859 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d4006d50 con 0x7f35dc1485f0 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35d2ffd640 1 -- 172.21.15.2:0/3755811859 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d4007030 con 0x7f35dc1485f0 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc0b7860 con 0x7f35dc1485f0 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35d2ffd640 1 -- 172.21.15.2:0/3755811859 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d40073e0 con 0x7f35dc1485f0 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.607+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc0b7e20 con 0x7f35dc1485f0 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.608+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc0a1150 con 0x7f35dc1485f0 2023-11-25T04:09:15.613 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.608+0000 7f35d2ffd640 1 -- 172.21.15.2:0/3755811859 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35d4007540 con 0x7f35dc1485f0 2023-11-25T04:09:15.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.609+0000 7f35d2ffd640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f35bc06ae40 0x7f35bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.609+0000 7f35d2ffd640 1 -- 172.21.15.2:0/3755811859 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35d40ab6f0 con 0x7f35dc1485f0 2023-11-25T04:09:15.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.609+0000 7f35da59c640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f35bc06ae40 0x7f35bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.614 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.609+0000 7f35da59c640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f35bc06ae40 0x7f35bc06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009980 tx=0x7f35cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:15.615 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.613+0000 7f35d2ffd640 1 -- 172.21.15.2:0/3755811859 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35d40767a0 con 0x7f35dc1485f0 2023-11-25T04:09:15.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.788+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35dc0b8340 con 0x7f35dc1485f0 2023-11-25T04:09:15.790 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.788+0000 7f35d2ffd640 1 -- 172.21.15.2:0/3755811859 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35dc0b8340 con 0x7f35dc1485f0 2023-11-25T04:09:15.790 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f35bc06ae40 msgr2=0x7f35bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f35bc06ae40 0x7f35bc06d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f35cc009980 tx=0x7f35cc008040 comp rx=0 tx=0).stop 2023-11-25T04:09:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc1485f0 msgr2=0x7f35dc148a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc1485f0 0x7f35dc148a70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f35d4001f70 tx=0x7f35d40014a0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.792 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 shutdown_connections 2023-11-25T04:09:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f35dc1485f0 0x7f35dc148a70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f35bc06ae40 0x7f35bc06d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35dc149240 0x7f35dc15cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 --2- 172.21.15.2:0/3755811859 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35c8005180 0x7f35dc0b6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 >> 172.21.15.2:0/3755811859 conn(0x7f35dc09c470 msgr2=0x7f35dc06b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 shutdown_connections 2023-11-25T04:09:15.793 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.790+0000 7f35e0dd5640 1 -- 172.21.15.2:0/3755811859 wait complete. 2023-11-25T04:09:15.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.910+0000 7f0cacb05640 1 Processor -- start 2023-11-25T04:09:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.910+0000 7f0cacb05640 1 -- start start 2023-11-25T04:09:15.915 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.911+0000 7f0cacb05640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0ca809a080 0x7f0ca80cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.911+0000 7f0cacb05640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0ca815ab80 0x7f0ca815af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.911+0000 7f0cacb05640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80cc080 con 0x7f0ca806fd30 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.911+0000 7f0cacb05640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca8070110 con 0x7f0ca815ab80 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.911+0000 7f0cacb05640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca80ccec0 con 0x7f0ca809a080 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.911+0000 7f0ca6d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0ca815ab80 0x7f0ca815af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.911+0000 7f0ca659c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f0ca806fd30 0x7f0ca8099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48382/0 (socket says 172.21.15.2:48382) 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.911+0000 7f0ca659c640 1 -- 172.21.15.2:0/1526518909 learned_addr learned my addr 172.21.15.2:0/1526518909 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.911+0000 7f0ca5d9b640 1 --2- 172.21.15.2:0/1526518909 >> v2:172.21.15.66:3300/0 conn(0x7f0ca809a080 0x7f0ca80cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.912+0000 7f0ca6d9d640 1 -- 172.21.15.2:0/1526518909 >> v2:172.21.15.66:3300/0 conn(0x7f0ca809a080 msgr2=0x7f0ca80cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.912+0000 7f0ca6d9d640 1 --2- 172.21.15.2:0/1526518909 >> v2:172.21.15.66:3300/0 conn(0x7f0ca809a080 0x7f0ca80cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.916 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.912+0000 7f0ca6d9d640 1 -- 172.21.15.2:0/1526518909 >> v1:172.21.15.2:6789/0 conn(0x7f0ca806fd30 legacy=0x7f0ca8099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.912+0000 7f0ca6d9d640 1 -- 172.21.15.2:0/1526518909 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80cc2b0 con 0x7f0ca815ab80 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.912+0000 7f0ca6d9d640 1 --2- 172.21.15.2:0/1526518909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca815ab80 0x7f0ca815af90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8072040 tx=0x7f0c9802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=822948d8c03a366 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.912+0000 7f0ca559a640 1 -- 172.21.15.2:0/1526518909 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9802cc80 con 0x7f0ca815ab80 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.912+0000 7f0ca559a640 1 -- 172.21.15.2:0/1526518909 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9802cde0 con 0x7f0ca815ab80 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.912+0000 7f0ca559a640 1 -- 172.21.15.2:0/1526518909 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98034660 con 0x7f0ca815ab80 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.913+0000 7f0cacb05640 1 -- 172.21.15.2:0/1526518909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca815ab80 msgr2=0x7f0ca815af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.913+0000 7f0cacb05640 1 --2- 172.21.15.2:0/1526518909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca815ab80 0x7f0ca815af90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8072040 tx=0x7f0c9802bed0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.913+0000 7f0cacb05640 1 -- 172.21.15.2:0/1526518909 shutdown_connections 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.913+0000 7f0cacb05640 1 --2- 172.21.15.2:0/1526518909 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca815ab80 0x7f0ca815af90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.913+0000 7f0cacb05640 1 --2- 172.21.15.2:0/1526518909 >> v2:172.21.15.66:3300/0 conn(0x7f0ca809a080 0x7f0ca80cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.913+0000 7f0cacb05640 1 -- 172.21.15.2:0/1526518909 >> 172.21.15.2:0/1526518909 conn(0x7f0ca80b2a20 msgr2=0x7f0ca80b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:15.917 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.913+0000 7f0cacb05640 1 -- 172.21.15.2:0/1526518909 shutdown_connections 2023-11-25T04:09:15.918 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.913+0000 7f0cacb05640 1 -- 172.21.15.2:0/1526518909 wait complete. 2023-11-25T04:09:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.914+0000 7f0cacb05640 1 Processor -- start 2023-11-25T04:09:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0cacb05640 1 -- start start 2023-11-25T04:09:15.920 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0cacb05640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ca806fd30 0x7f0ca8153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0cacb05640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca809a080 0x7f0ca80b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0cacb05640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ca815ab80 0x7f0ca80b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0cacb05640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81547f0 con 0x7f0ca809a080 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0cacb05640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81542c0 con 0x7f0ca815ab80 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0cacb05640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8157fa0 con 0x7f0ca806fd30 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0ca5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca809a080 0x7f0ca80b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0ca5d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca809a080 0x7f0ca80b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56256/0 (socket says 172.21.15.2:56256) 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.915+0000 7f0ca5d9b640 1 -- 172.21.15.2:0/2018278292 learned_addr learned my addr 172.21.15.2:0/2018278292 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0ca659c640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ca806fd30 0x7f0ca8153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0ca6d9d640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ca815ab80 0x7f0ca80b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0ca5d9b640 1 -- 172.21.15.2:0/2018278292 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ca806fd30 msgr2=0x7f0ca8153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.921 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0ca5d9b640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ca806fd30 0x7f0ca8153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0ca5d9b640 1 -- 172.21.15.2:0/2018278292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ca815ab80 msgr2=0x7f0ca80b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0ca5d9b640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ca815ab80 0x7f0ca80b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0ca5d9b640 1 -- 172.21.15.2:0/2018278292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c98009a70 con 0x7f0ca809a080 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0ca659c640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ca806fd30 0x7f0ca8153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0ca5d9b640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca809a080 0x7f0ca80b03c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00d5f0 tx=0x7f0c9c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0c96ffd640 1 -- 172.21.15.2:0/2018278292 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0125f0 con 0x7f0ca809a080 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0c96ffd640 1 -- 172.21.15.2:0/2018278292 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c012750 con 0x7f0ca809a080 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0c96ffd640 1 -- 172.21.15.2:0/2018278292 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c012b00 con 0x7f0ca809a080 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca80b6bd0 con 0x7f0ca809a080 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.916+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca80b3e30 con 0x7f0ca809a080 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.917+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca809f040 con 0x7f0ca809a080 2023-11-25T04:09:15.922 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.918+0000 7f0c96ffd640 1 -- 172.21.15.2:0/2018278292 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0c9c012c60 con 0x7f0ca809a080 2023-11-25T04:09:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.918+0000 7f0c96ffd640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c8806ae40 0x7f0c8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.918+0000 7f0c96ffd640 1 -- 172.21.15.2:0/2018278292 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c9c089ae0 con 0x7f0ca809a080 2023-11-25T04:09:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.918+0000 7f0ca659c640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c8806ae40 0x7f0c8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:15.923 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.919+0000 7f0ca659c640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c8806ae40 0x7f0c8806d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005880 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:15.925 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:15.922+0000 7f0c96ffd640 1 -- 172.21.15.2:0/2018278292 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0c9c054b90 con 0x7f0ca809a080 2023-11-25T04:09:16.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.101+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ca80cd440 con 0x7f0ca809a080 2023-11-25T04:09:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.102+0000 7f0c96ffd640 1 -- 172.21.15.2:0/2018278292 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c9c0581b0 con 0x7f0ca809a080 2023-11-25T04:09:16.104 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:16.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c8806ae40 msgr2=0x7f0c8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c8806ae40 0x7f0c8806d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005880 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2023-11-25T04:09:16.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca809a080 msgr2=0x7f0ca80b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca809a080 0x7f0ca80b03c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c00d5f0 tx=0x7f0c9c00dab0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 shutdown_connections 2023-11-25T04:09:16.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0c8806ae40 0x7f0c8806d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0ca815ab80 0x7f0ca80b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0ca809a080 0x7f0ca80b03c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 --2- 172.21.15.2:0/2018278292 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ca806fd30 0x7f0ca8153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 >> 172.21.15.2:0/2018278292 conn(0x7f0ca80b2a20 msgr2=0x7f0ca815bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:16.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 shutdown_connections 2023-11-25T04:09:16.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.104+0000 7f0cacb05640 1 -- 172.21.15.2:0/2018278292 wait complete. 2023-11-25T04:09:16.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:16.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.227+0000 7ffa3a6e0640 1 Processor -- start 2023-11-25T04:09:16.229 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.227+0000 7ffa3a6e0640 1 -- start start 2023-11-25T04:09:16.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa3a6e0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340d0220 0x7ffa340cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa3a6e0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340b04d0 con 0x7ffa3415d7b0 2023-11-25T04:09:16.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa3a6e0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340d1e40 con 0x7ffa340b1970 2023-11-25T04:09:16.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa3a6e0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340afe80 con 0x7ffa340d0220 2023-11-25T04:09:16.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa33fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ffa3415d7b0 0x7ffa340cfb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48390/0 (socket says 172.21.15.2:48390) 2023-11-25T04:09:16.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa33fff640 1 -- 172.21.15.2:0/1686449394 learned_addr learned my addr 172.21.15.2:0/1686449394 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:16.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa337fe640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340d0220 0x7ffa340cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036910336 0 0) 0x7ffa340b04d0 con 0x7ffa3415d7b0 2023-11-25T04:09:16.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa1c003520 con 0x7ffa3415d7b0 2023-11-25T04:09:16.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3147839410 0 0) 0x7ffa1c003520 con 0x7ffa3415d7b0 2023-11-25T04:09:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340d0220 msgr2=0x7ffa340cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340d0220 0x7ffa340cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 >> v1:172.21.15.66:6789/0 conn(0x7ffa340b1970 legacy=0x7ffa340ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340b0160 con 0x7ffa3415d7b0 2023-11-25T04:09:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7ffa24001670 con 0x7ffa3415d7b0 2023-11-25T04:09:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 >> v1:172.21.15.2:6789/0 conn(0x7ffa3415d7b0 legacy=0x7ffa340cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340d0220 0x7ffa1c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa1c003ee0 0x7ffa1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c004d00 0x7ffa1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340afe80 con 0x7ffa1c004d00 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c00b9e0 con 0x7ffa1c003ee0 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.228+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c00bba0 con 0x7ffa340d0220 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.229+0000 7ffa38c7d640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c004d00 0x7ffa1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.229+0000 7ffa33fff640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340d0220 0x7ffa1c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.229+0000 7ffa337fe640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa1c003ee0 0x7ffa1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.229+0000 7ffa38c7d640 1 -- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340d0220 msgr2=0x7ffa1c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.229+0000 7ffa38c7d640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340d0220 0x7ffa1c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.229+0000 7ffa38c7d640 1 -- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa1c003ee0 msgr2=0x7ffa1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:16.235 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.229+0000 7ffa38c7d640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa1c003ee0 0x7ffa1c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.229+0000 7ffa38c7d640 1 -- 172.21.15.2:0/1686449394 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c003520 con 0x7ffa1c004d00 2023-11-25T04:09:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa38c7d640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c004d00 0x7ffa1c005180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c001fe0 tx=0x7ffa1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90536782664334f server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c02c730 con 0x7ffa1c004d00 2023-11-25T04:09:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2c02c890 con 0x7ffa1c004d00 2023-11-25T04:09:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa32ffd640 1 -- 172.21.15.2:0/1686449394 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2c02cc60 con 0x7ffa1c004d00 2023-11-25T04:09:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/1686449394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c004d00 msgr2=0x7ffa1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa3a6e0640 1 --2- 172.21.15.2:0/1686449394 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa1c004d00 0x7ffa1c005180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c001fe0 tx=0x7ffa1c0057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa38c7d640 1 -- 172.21.15.2:0/1686449394 reap_dead start 2023-11-25T04:09:16.236 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/1686449394 shutdown_connections 2023-11-25T04:09:16.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/1686449394 >> 172.21.15.2:0/1686449394 conn(0x7ffa3409c480 msgr2=0x7ffa340d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:16.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/1686449394 shutdown_connections 2023-11-25T04:09:16.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.230+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/1686449394 wait complete. 2023-11-25T04:09:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.232+0000 7ffa3a6e0640 1 Processor -- start 2023-11-25T04:09:16.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.232+0000 7ffa3a6e0640 1 -- start start 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.232+0000 7ffa3a6e0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa34157c80 0x7ffa340b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.232+0000 7ffa3a6e0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa340b5520 0x7ffa340cea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.232+0000 7ffa3a6e0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa340cefb0 0x7ffa3409df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.232+0000 7ffa3a6e0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340cf430 con 0x7ffa340b5520 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.232+0000 7ffa3a6e0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3409f3d0 con 0x7ffa340cefb0 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.232+0000 7ffa3a6e0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3415ac80 con 0x7ffa34157c80 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa340b5520 0x7ffa340cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa337fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa340b5520 0x7ffa340cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56260/0 (socket says 172.21.15.2:56260) 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa337fe640 1 -- 172.21.15.2:0/874734498 learned_addr learned my addr 172.21.15.2:0/874734498 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:16.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa33fff640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa34157c80 0x7ffa340b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa38c7d640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa340cefb0 0x7ffa3409df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa337fe640 1 -- 172.21.15.2:0/874734498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa34157c80 msgr2=0x7ffa340b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa337fe640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa34157c80 0x7ffa340b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa337fe640 1 -- 172.21.15.2:0/874734498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa340cefb0 msgr2=0x7ffa3409df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa337fe640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa340cefb0 0x7ffa3409df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa337fe640 1 -- 172.21.15.2:0/874734498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340b5b50 con 0x7ffa340b5520 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa33fff640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa34157c80 0x7ffa340b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa337fe640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa340b5520 0x7ffa340cea70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa280119d0 tx=0x7ffa28011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa30ff9640 1 -- 172.21.15.2:0/874734498 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800faf0 con 0x7ffa340b5520 2023-11-25T04:09:16.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa30ff9640 1 -- 172.21.15.2:0/874734498 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800fc50 con 0x7ffa340b5520 2023-11-25T04:09:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa30ff9640 1 -- 172.21.15.2:0/874734498 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28014440 con 0x7ffa340b5520 2023-11-25T04:09:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa340b5e30 con 0x7ffa340b5520 2023-11-25T04:09:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.233+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa340b63f0 con 0x7ffa340b5520 2023-11-25T04:09:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.234+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa340b6610 con 0x7ffa340b5520 2023-11-25T04:09:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.235+0000 7ffa30ff9640 1 -- 172.21.15.2:0/874734498 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffa280145a0 con 0x7ffa340b5520 2023-11-25T04:09:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.235+0000 7ffa30ff9640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa2006ae70 0x7ffa2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.235+0000 7ffa30ff9640 1 -- 172.21.15.2:0/874734498 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa28089e80 con 0x7ffa340b5520 2023-11-25T04:09:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.235+0000 7ffa33fff640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa2006ae70 0x7ffa2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.236+0000 7ffa33fff640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa2006ae70 0x7ffa2006d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa24004840 tx=0x7ffa24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:16.243 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.240+0000 7ffa30ff9640 1 -- 172.21.15.2:0/874734498 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffa28054ea0 con 0x7ffa340b5520 2023-11-25T04:09:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.420+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffa340d19e0 con 0x7ffa340b5520 2023-11-25T04:09:16.422 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.420+0000 7ffa30ff9640 1 -- 172.21.15.2:0/874734498 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffa280220a0 con 0x7ffa340b5520 2023-11-25T04:09:16.422 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa2006ae70 msgr2=0x7ffa2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa2006ae70 0x7ffa2006d330 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ffa24004840 tx=0x7ffa24009040 comp rx=0 tx=0).stop 2023-11-25T04:09:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa340b5520 msgr2=0x7ffa340cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa340b5520 0x7ffa340cea70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffa280119d0 tx=0x7ffa28011e90 comp rx=0 tx=0).stop 2023-11-25T04:09:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 shutdown_connections 2023-11-25T04:09:16.424 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ffa2006ae70 0x7ffa2006d330 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa340cefb0 0x7ffa3409df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ffa340b5520 0x7ffa340cea70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 --2- 172.21.15.2:0/874734498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa34157c80 0x7ffa340b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 >> 172.21.15.2:0/874734498 conn(0x7ffa3409c480 msgr2=0x7ffa340cc230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:16.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 shutdown_connections 2023-11-25T04:09:16.425 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.422+0000 7ffa3a6e0640 1 -- 172.21.15.2:0/874734498 wait complete. 2023-11-25T04:09:16.436 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-25T04:09:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.541+0000 7f2a9e133640 1 Processor -- start 2023-11-25T04:09:16.543 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.541+0000 7f2a9e133640 1 -- start start 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.542+0000 7f2a9e133640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2a9815ebf0 0x7f2a9809a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.542+0000 7f2a9e133640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a980b37b0 con 0x7f2a980cd540 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.542+0000 7f2a9e133640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a980cc720 con 0x7f2a9815e810 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.542+0000 7f2a9e133640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a980b2260 con 0x7f2a9815ebf0 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.542+0000 7f2a96ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f2a9815ebf0 0x7f2a9809a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.542+0000 7f2a97fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f2a980cd540 0x7f2a980b0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48398/0 (socket says 172.21.15.2:48398) 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.542+0000 7f2a97fff640 1 -- 172.21.15.2:0/2226407485 learned_addr learned my addr 172.21.15.2:0/2226407485 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.543+0000 7f2a96ffd640 1 -- 172.21.15.2:0/2226407485 >> v1:172.21.15.66:6789/0 conn(0x7f2a9815e810 legacy=0x7f2a98099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.543+0000 7f2a96ffd640 1 -- 172.21.15.2:0/2226407485 >> v1:172.21.15.2:6789/0 conn(0x7f2a980cd540 legacy=0x7f2a980b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.545 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.543+0000 7f2a967fc640 1 -- 172.21.15.2:0/2226407485 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527401581 0 0) 0x7f2a980b37b0 con 0x7f2a980cd540 2023-11-25T04:09:16.546 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.543+0000 7f2a96ffd640 1 -- 172.21.15.2:0/2226407485 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9809a6f0 con 0x7f2a9815ebf0 2023-11-25T04:09:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.543+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/2226407485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 0x7f2a9809a080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0097a0 tx=0x7f2a8c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a917e4601ada56 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a967fc640 1 -- 172.21.15.2:0/2226407485 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c030610 con 0x7f2a9815ebf0 2023-11-25T04:09:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a967fc640 1 -- 172.21.15.2:0/2226407485 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c030770 con 0x7f2a9815ebf0 2023-11-25T04:09:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a967fc640 1 -- 172.21.15.2:0/2226407485 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c030b00 con 0x7f2a9815ebf0 2023-11-25T04:09:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a9e133640 1 -- 172.21.15.2:0/2226407485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 msgr2=0x7f2a9809a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a9e133640 1 --2- 172.21.15.2:0/2226407485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 0x7f2a9809a080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0097a0 tx=0x7f2a8c02b960 comp rx=0 tx=0).stop 2023-11-25T04:09:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a9e133640 1 -- 172.21.15.2:0/2226407485 shutdown_connections 2023-11-25T04:09:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a9e133640 1 --2- 172.21.15.2:0/2226407485 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 0x7f2a9809a080 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a9e133640 1 -- 172.21.15.2:0/2226407485 >> 172.21.15.2:0/2226407485 conn(0x7f2a980b2a70 msgr2=0x7f2a980b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a9e133640 1 -- 172.21.15.2:0/2226407485 shutdown_connections 2023-11-25T04:09:16.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.544+0000 7f2a9e133640 1 -- 172.21.15.2:0/2226407485 wait complete. 2023-11-25T04:09:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.545+0000 7f2a9e133640 1 Processor -- start 2023-11-25T04:09:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a9e133640 1 -- start start 2023-11-25T04:09:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a9e133640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a980cd540 0x7f2a980b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a9e133640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a9815e810 0x7f2a980b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a9e133640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 0x7f2a980b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.550 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a9e133640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9814fd40 con 0x7f2a9815ebf0 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a9e133640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a981557d0 con 0x7f2a980cd540 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a9e133640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a98155340 con 0x7f2a9815e810 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 0x7f2a980b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a97fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 0x7f2a980b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56272/0 (socket says 172.21.15.2:56272) 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.546+0000 7f2a97fff640 1 -- 172.21.15.2:0/3713428861 learned_addr learned my addr 172.21.15.2:0/3713428861 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a97fff640 1 -- 172.21.15.2:0/3713428861 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a9815e810 msgr2=0x7f2a980b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a96ffd640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a9815e810 0x7f2a980b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a9815e810 0x7f2a980b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a97fff640 1 -- 172.21.15.2:0/3713428861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a980cd540 msgr2=0x7f2a980b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a980cd540 0x7f2a980b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a97fff640 1 -- 172.21.15.2:0/3713428861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c009400 con 0x7f2a9815ebf0 2023-11-25T04:09:16.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a97fff640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 0x7f2a980b3a60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000c7d0 tx=0x7f2a9000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a7ffff640 1 -- 172.21.15.2:0/3713428861 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000ce80 con 0x7f2a9815ebf0 2023-11-25T04:09:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a7ffff640 1 -- 172.21.15.2:0/3713428861 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9000a5e0 con 0x7f2a9815ebf0 2023-11-25T04:09:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a98154730 con 0x7f2a9815ebf0 2023-11-25T04:09:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a7ffff640 1 -- 172.21.15.2:0/3713428861 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000a9b0 con 0x7f2a9815ebf0 2023-11-25T04:09:16.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.547+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a98154cf0 con 0x7f2a9815ebf0 2023-11-25T04:09:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.548+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9809ef40 con 0x7f2a9815ebf0 2023-11-25T04:09:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.548+0000 7f2a7ffff640 1 -- 172.21.15.2:0/3713428861 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a9000ab10 con 0x7f2a9815ebf0 2023-11-25T04:09:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.549+0000 7f2a7ffff640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a8406ae40 0x7f2a8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.549+0000 7f2a7ffff640 1 -- 172.21.15.2:0/3713428861 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2a90088b30 con 0x7f2a9815ebf0 2023-11-25T04:09:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.549+0000 7f2a977fe640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a8406ae40 0x7f2a8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:16.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.549+0000 7f2a977fe640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a8406ae40 0x7f2a8406d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2a88000f60 tx=0x7f2a880079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:16.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.553+0000 7f2a7ffff640 1 -- 172.21.15.2:0/3713428861 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a90053b50 con 0x7f2a9815ebf0 2023-11-25T04:09:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.741+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2a9804e920 con 0x7f2a9815ebf0 2023-11-25T04:09:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.741+0000 7f2a7ffff640 1 -- 172.21.15.2:0/3713428861 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2a90018070 con 0x7f2a9815ebf0 2023-11-25T04:09:16.743 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-25T04:09:16.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a8406ae40 msgr2=0x7f2a8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a8406ae40 0x7f2a8406d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2a88000f60 tx=0x7f2a880079b0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 msgr2=0x7f2a980b3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 0x7f2a980b3a60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000c7d0 tx=0x7f2a9000cc90 comp rx=0 tx=0).stop 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 shutdown_connections 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f2a9815ebf0 0x7f2a980b3a60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a9815e810 0x7f2a980b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2a8406ae40 0x7f2a8406d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 --2- 172.21.15.2:0/3713428861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a980cd540 0x7f2a980b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 >> 172.21.15.2:0/3713428861 conn(0x7f2a980b2a70 msgr2=0x7f2a980b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 shutdown_connections 2023-11-25T04:09:16.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:16.743+0000 7f2a9e133640 1 -- 172.21.15.2:0/3713428861 wait complete. 2023-11-25T04:09:16.756 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi002.front.sepia.ceph.com... 2023-11-25T04:09:16.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:16.756 DEBUG:teuthology.orchestra.run.smithi002:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-11-25T04:09:16.787 INFO:teuthology.orchestra.run:waiting for 300 2023-11-25T04:09:16.787 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T04:09:16.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:16.788 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-25T04:09:16.844 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:09:16.844 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:16.864 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:09:16.864 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:16.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:17.029 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.027+0000 7f8b526da640 1 Processor -- start 2023-11-25T04:09:17.030 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.027+0000 7f8b526da640 1 -- start start 2023-11-25T04:09:17.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.028+0000 7f8b526da640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c09a080 0x7f8b4c0b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.028+0000 7f8b526da640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c0b0660 con 0x7f8b4c0b2610 2023-11-25T04:09:17.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.028+0000 7f8b526da640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c06c900 con 0x7f8b4c15d900 2023-11-25T04:09:17.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.028+0000 7f8b526da640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c06cbe0 con 0x7f8b4c09a080 2023-11-25T04:09:17.032 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.028+0000 7f8b50c77640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8b4c0b2610 0x7f8b4c0b1310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48410/0 (socket says 172.21.15.2:48410) 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.028+0000 7f8b50c77640 1 -- 172.21.15.2:0/2180575521 learned_addr learned my addr 172.21.15.2:0/2180575521 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696248110 0 0) 0x7f8b4c0b0660 con 0x7f8b4c0b2610 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b34003520 con 0x7f8b4c0b2610 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4b7fe640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c09a080 0x7f8b4c0b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 329530023 0 0) 0x7f8b34003520 con 0x7f8b4c0b2610 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c09a080 msgr2=0x7f8b4c0b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c09a080 0x7f8b4c0b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 >> v1:172.21.15.66:6789/0 conn(0x7f8b4c15d900 legacy=0x7f8b4c099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c06cec0 con 0x7f8b4c0b2610 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f8b440019f0 con 0x7f8b4c0b2610 2023-11-25T04:09:17.033 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 >> v1:172.21.15.2:6789/0 conn(0x7f8b4c0b2610 legacy=0x7f8b4c0b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c09a080 0x7f8b340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b34003fd0 0x7f8b340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c06cbe0 con 0x7f8b34004d00 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3400bb40 con 0x7f8b34003fd0 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3400bd00 con 0x7f8b4c09a080 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b50c77640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4bfff640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c09a080 0x7f8b340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b4b7fe640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b34003fd0 0x7f8b340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.034 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b50c77640 1 -- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c09a080 msgr2=0x7f8b340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b50c77640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c09a080 0x7f8b340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b50c77640 1 -- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b34003fd0 msgr2=0x7f8b340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b50c77640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b34003fd0 0x7f8b340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.029+0000 7f8b50c77640 1 -- 172.21.15.2:0/2180575521 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b34003520 con 0x7f8b34004d00 2023-11-25T04:09:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.030+0000 7f8b50c77640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b34005180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400a800 tx=0x7f8b340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d030776efb479ff server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.030+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440072d0 con 0x7f8b34004d00 2023-11-25T04:09:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.030+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4402f070 con 0x7f8b34004d00 2023-11-25T04:09:17.035 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.030+0000 7f8b4affd640 1 -- 172.21.15.2:0/2180575521 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440076f0 con 0x7f8b34004d00 2023-11-25T04:09:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.031+0000 7f8b526da640 1 -- 172.21.15.2:0/2180575521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 msgr2=0x7f8b34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.038 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.031+0000 7f8b526da640 1 --2- 172.21.15.2:0/2180575521 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b34005180 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400a800 tx=0x7f8b340057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.031+0000 7f8b50c77640 1 -- 172.21.15.2:0/2180575521 reap_dead start 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.031+0000 7f8b526da640 1 -- 172.21.15.2:0/2180575521 shutdown_connections 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.031+0000 7f8b526da640 1 -- 172.21.15.2:0/2180575521 >> 172.21.15.2:0/2180575521 conn(0x7f8b4c0b2a70 msgr2=0x7f8b4c0b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.031+0000 7f8b526da640 1 -- 172.21.15.2:0/2180575521 shutdown_connections 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.031+0000 7f8b526da640 1 -- 172.21.15.2:0/2180575521 wait complete. 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.032+0000 7f8b526da640 1 Processor -- start 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.032+0000 7f8b526da640 1 -- start start 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b526da640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b4c0c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b526da640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c1477c0 0x7f8b4c147c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b526da640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c144a70 0x7f8b4c144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.039 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b526da640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c15b770 con 0x7f8b34004d00 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b526da640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c148180 con 0x7f8b4c144a70 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b526da640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c145460 con 0x7f8b4c1477c0 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b4c0c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b4bfff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b4c0c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56292/0 (socket says 172.21.15.2:56292) 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b4bfff640 1 -- 172.21.15.2:0/1726896617 learned_addr learned my addr 172.21.15.2:0/1726896617 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b4b7fe640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c1477c0 0x7f8b4c147c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b50c77640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c144a70 0x7f8b4c144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b4bfff640 1 -- 172.21.15.2:0/1726896617 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c1477c0 msgr2=0x7f8b4c147c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b4bfff640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c1477c0 0x7f8b4c147c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b4bfff640 1 -- 172.21.15.2:0/1726896617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c144a70 msgr2=0x7f8b4c144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.040 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b4bfff640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c144a70 0x7f8b4c144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.033+0000 7f8b4bfff640 1 -- 172.21.15.2:0/1726896617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c15b980 con 0x7f8b34004d00 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.034+0000 7f8b4bfff640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b4c0c4ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000f850 tx=0x7f8b4000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.034+0000 7f8b48ff9640 1 -- 172.21.15.2:0/1726896617 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000fe40 con 0x7f8b34004d00 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.034+0000 7f8b48ff9640 1 -- 172.21.15.2:0/1726896617 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b400052e0 con 0x7f8b34004d00 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.034+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c15bc60 con 0x7f8b34004d00 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.034+0000 7f8b48ff9640 1 -- 172.21.15.2:0/1726896617 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4000d970 con 0x7f8b34004d00 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.034+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c15c220 con 0x7f8b34004d00 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.035+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c067420 con 0x7f8b34004d00 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.035+0000 7f8b48ff9640 1 -- 172.21.15.2:0/1726896617 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b4000dad0 con 0x7f8b34004d00 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.036+0000 7f8b48ff9640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8b3806ae70 0x7f8b3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.036+0000 7f8b48ff9640 1 -- 172.21.15.2:0/1726896617 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8b40089530 con 0x7f8b34004d00 2023-11-25T04:09:17.041 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.036+0000 7f8b4b7fe640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8b3806ae70 0x7f8b3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.036+0000 7f8b4b7fe640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8b3806ae70 0x7f8b3806d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c06d720 tx=0x7f8b3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.042 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.040+0000 7f8b48ff9640 1 -- 172.21.15.2:0/1726896617 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b40054540 con 0x7f8b34004d00 2023-11-25T04:09:17.219 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.217+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b4c0ccf50 con 0x7f8b34004d00 2023-11-25T04:09:17.220 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.218+0000 7f8b48ff9640 1 -- 172.21.15.2:0/1726896617 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16691 (secure 0 0 0) 0x7f8b40057b60 con 0x7f8b34004d00 2023-11-25T04:09:17.221 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:17.221 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:09:16.289711+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.220+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8b3806ae70 msgr2=0x7f8b3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.220+0000 7f8b526da640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8b3806ae70 0x7f8b3806d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c06d720 tx=0x7f8b3c008040 comp rx=0 tx=0).stop 2023-11-25T04:09:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.220+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 msgr2=0x7f8b4c0c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.220+0000 7f8b526da640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b4c0c4ab0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8b4000f850 tx=0x7f8b4000fd10 comp rx=0 tx=0).stop 2023-11-25T04:09:17.223 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.221+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 shutdown_connections 2023-11-25T04:09:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.221+0000 7f8b526da640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8b3806ae70 0x7f8b3806d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.221+0000 7f8b526da640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c144a70 0x7f8b4c144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.221+0000 7f8b526da640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c1477c0 0x7f8b4c147c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.221+0000 7f8b526da640 1 --2- 172.21.15.2:0/1726896617 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8b34004d00 0x7f8b4c0c4ab0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.221+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 >> 172.21.15.2:0/1726896617 conn(0x7f8b4c0b2a70 msgr2=0x7f8b4c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.221+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 shutdown_connections 2023-11-25T04:09:17.224 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.221+0000 7f8b526da640 1 -- 172.21.15.2:0/1726896617 wait complete. 2023-11-25T04:09:17.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:17.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.346+0000 7fc1f873c640 1 Processor -- start 2023-11-25T04:09:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.346+0000 7fc1f873c640 1 -- start start 2023-11-25T04:09:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.347+0000 7fc1f873c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1f015ea80 0x7fc1f00cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.347+0000 7fc1f873c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f00afee0 0x7fc1f00cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.347+0000 7fc1f873c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1f00cbbd0 0x7fc1f00cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.347+0000 7fc1f873c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f015ee60 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.347+0000 7fc1f873c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f00cef60 con 0x7fc1f015ea80 2023-11-25T04:09:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.347+0000 7fc1f873c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0099a10 con 0x7fc1f00afee0 2023-11-25T04:09:17.351 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.347+0000 7fc1f6cd9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1f00cbbd0 0x7fc1f00cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.348+0000 7fc1f6cd9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc1f00cbbd0 0x7fc1f00cc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56306/0 (socket says 172.21.15.2:56306) 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.348+0000 7fc1f6cd9640 1 -- 172.21.15.2:0/2968363751 learned_addr learned my addr 172.21.15.2:0/2968363751 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.348+0000 7fc1f5cd7640 1 --2- 172.21.15.2:0/2968363751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f00afee0 0x7fc1f00cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.348+0000 7fc1f64d8640 1 --2- 172.21.15.2:0/2968363751 >> v2:172.21.15.66:3300/0 conn(0x7fc1f015ea80 0x7fc1f00cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.348+0000 7fc1f6cd9640 1 -- 172.21.15.2:0/2968363751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f00afee0 msgr2=0x7fc1f00cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.348+0000 7fc1f6cd9640 1 --2- 172.21.15.2:0/2968363751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f00afee0 0x7fc1f00cf780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.348+0000 7fc1f6cd9640 1 -- 172.21.15.2:0/2968363751 >> v2:172.21.15.66:3300/0 conn(0x7fc1f015ea80 msgr2=0x7fc1f00cf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.348+0000 7fc1f6cd9640 1 --2- 172.21.15.2:0/2968363751 >> v2:172.21.15.66:3300/0 conn(0x7fc1f015ea80 0x7fc1f00cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.348+0000 7fc1f6cd9640 1 -- 172.21.15.2:0/2968363751 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0099cf0 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f6cd9640 1 --2- 172.21.15.2:0/2968363751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 0x7fc1f00cc020 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0066c60 tx=0x7fc1e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161cf418354770eb server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f54d6640 1 -- 172.21.15.2:0/2968363751 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8031870 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f54d6640 1 -- 172.21.15.2:0/2968363751 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e80319d0 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f54d6640 1 -- 172.21.15.2:0/2968363751 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8031d60 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f873c640 1 -- 172.21.15.2:0/2968363751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 msgr2=0x7fc1f00cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2968363751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 0x7fc1f00cc020 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc1f0066c60 tx=0x7fc1e802b910 comp rx=0 tx=0).stop 2023-11-25T04:09:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f873c640 1 -- 172.21.15.2:0/2968363751 shutdown_connections 2023-11-25T04:09:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2968363751 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 0x7fc1f00cc020 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2968363751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f00afee0 0x7fc1f00cf780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2968363751 >> v2:172.21.15.66:3300/0 conn(0x7fc1f015ea80 0x7fc1f00cf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f873c640 1 -- 172.21.15.2:0/2968363751 >> 172.21.15.2:0/2968363751 conn(0x7fc1f00b2ab0 msgr2=0x7fc1f00b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f873c640 1 -- 172.21.15.2:0/2968363751 shutdown_connections 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.349+0000 7fc1f873c640 1 -- 172.21.15.2:0/2968363751 wait complete. 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f873c640 1 Processor -- start 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f873c640 1 -- start start 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f873c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1f00afee0 0x7fc1f014bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f873c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 0x7fc1f00c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f873c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f015ea80 0x7fc1f014ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f873c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00c7380 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f873c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f014f360 con 0x7fc1f00afee0 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f873c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00c6770 con 0x7fc1f015ea80 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f5cd7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 0x7fc1f00c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f5cd7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 0x7fc1f00c60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56314/0 (socket says 172.21.15.2:56314) 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.351+0000 7fc1f5cd7640 1 -- 172.21.15.2:0/2527964345 learned_addr learned my addr 172.21.15.2:0/2527964345 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f6cd9640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f015ea80 0x7fc1f014ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f64d8640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1f00afee0 0x7fc1f014bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f5cd7640 1 -- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f015ea80 msgr2=0x7fc1f014ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f5cd7640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f015ea80 0x7fc1f014ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f5cd7640 1 -- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1f00afee0 msgr2=0x7fc1f014bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f5cd7640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1f00afee0 0x7fc1f014bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f5cd7640 1 -- 172.21.15.2:0/2527964345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e80094d0 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f6cd9640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f015ea80 0x7fc1f014ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f64d8640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1f00afee0 0x7fc1f014bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f5cd7640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 0x7fc1f00c60d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec007e60 tx=0x7fc1ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1e6ffd640 1 -- 172.21.15.2:0/2527964345 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec014620 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1e6ffd640 1 -- 172.21.15.2:0/2527964345 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ec00ee90 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f00c6a50 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1e6ffd640 1 -- 172.21.15.2:0/2527964345 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ec0149a0 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.352+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f00c7010 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.353+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f009f0b0 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.353+0000 7fc1e6ffd640 1 -- 172.21.15.2:0/2527964345 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1ec014b00 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.354+0000 7fc1e6ffd640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1d406ae40 0x7fc1d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.354+0000 7fc1e6ffd640 1 -- 172.21.15.2:0/2527964345 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc1ec089f80 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.354+0000 7fc1f64d8640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1d406ae40 0x7fc1d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.354+0000 7fc1f64d8640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1d406ae40 0x7fc1d406d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000a9d0 tx=0x7fc1e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.358+0000 7fc1e6ffd640 1 -- 172.21.15.2:0/2527964345 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1ec0bce90 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.536+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1f00c71d0 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.539 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.537+0000 7fc1e6ffd640 1 -- 172.21.15.2:0/2527964345 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1ec054fa0 con 0x7fc1f00cbbd0 2023-11-25T04:09:17.539 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:17.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1d406ae40 msgr2=0x7fc1d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.541 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1d406ae40 0x7fc1d406d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000a9d0 tx=0x7fc1e0008040 comp rx=0 tx=0).stop 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 msgr2=0x7fc1f00c60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 0x7fc1f00c60d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec007e60 tx=0x7fc1ec00e4b0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 shutdown_connections 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1f015ea80 0x7fc1f014ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc1f00cbbd0 0x7fc1f00c60d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc1d406ae40 0x7fc1d406d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 --2- 172.21.15.2:0/2527964345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1f00afee0 0x7fc1f014bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 >> 172.21.15.2:0/2527964345 conn(0x7fc1f00b2ab0 msgr2=0x7fc1f006c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 shutdown_connections 2023-11-25T04:09:17.542 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.539+0000 7fc1f873c640 1 -- 172.21.15.2:0/2527964345 wait complete. 2023-11-25T04:09:17.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.659+0000 7fb60eb4c640 1 Processor -- start 2023-11-25T04:09:17.661 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.659+0000 7fb60eb4c640 1 -- start start 2023-11-25T04:09:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60eb4c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb608144950 0x7fb6080ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60eb4c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6081446f0 con 0x7fb608144310 2023-11-25T04:09:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60eb4c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60815ba80 con 0x7fb60806cfa0 2023-11-25T04:09:17.662 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60eb4c640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60815bd60 con 0x7fb608144950 2023-11-25T04:09:17.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60d0e9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb608144950 0x7fb6080ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60c8e8640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb608144310 0x7fb60806c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48422/0 (socket says 172.21.15.2:48422) 2023-11-25T04:09:17.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60c8e8640 1 -- 172.21.15.2:0/579729335 learned_addr learned my addr 172.21.15.2:0/579729335 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:17.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60d0e9640 1 -- 172.21.15.2:0/579729335 >> v1:172.21.15.66:6789/0 conn(0x7fb60806cfa0 legacy=0x7fb60815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:17.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60d0e9640 1 -- 172.21.15.2:0/579729335 >> v1:172.21.15.2:6789/0 conn(0x7fb608144310 legacy=0x7fb60806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb6077fe640 1 -- 172.21.15.2:0/579729335 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322663648 0 0) 0x7fb6081446f0 con 0x7fb608144310 2023-11-25T04:09:17.663 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.660+0000 7fb60d0e9640 1 -- 172.21.15.2:0/579729335 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60815c040 con 0x7fb608144950 2023-11-25T04:09:17.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.661+0000 7fb60d0e9640 1 --2- 172.21.15.2:0/579729335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 0x7fb6080ce7e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb600009d90 tx=0x7fb60002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9125159bf1688e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.661+0000 7fb6077fe640 1 -- 172.21.15.2:0/579729335 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60002cc60 con 0x7fb608144950 2023-11-25T04:09:17.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.661+0000 7fb6077fe640 1 -- 172.21.15.2:0/579729335 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60002cdc0 con 0x7fb608144950 2023-11-25T04:09:17.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.661+0000 7fb6077fe640 1 -- 172.21.15.2:0/579729335 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600034660 con 0x7fb608144950 2023-11-25T04:09:17.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.662+0000 7fb60eb4c640 1 -- 172.21.15.2:0/579729335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 msgr2=0x7fb6080ce7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.664 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.662+0000 7fb60eb4c640 1 --2- 172.21.15.2:0/579729335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 0x7fb6080ce7e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb600009d90 tx=0x7fb60002beb0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.662+0000 7fb60eb4c640 1 -- 172.21.15.2:0/579729335 shutdown_connections 2023-11-25T04:09:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.662+0000 7fb60eb4c640 1 --2- 172.21.15.2:0/579729335 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 0x7fb6080ce7e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.662+0000 7fb60eb4c640 1 -- 172.21.15.2:0/579729335 >> 172.21.15.2:0/579729335 conn(0x7fb60806a8f0 msgr2=0x7fb60806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.662+0000 7fb60eb4c640 1 -- 172.21.15.2:0/579729335 shutdown_connections 2023-11-25T04:09:17.665 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.662+0000 7fb60eb4c640 1 -- 172.21.15.2:0/579729335 wait complete. 2023-11-25T04:09:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.663+0000 7fb60eb4c640 1 Processor -- start 2023-11-25T04:09:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.663+0000 7fb60eb4c640 1 -- start start 2023-11-25T04:09:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60eb4c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb60806cfa0 0x7fb6081f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60eb4c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb608144310 0x7fb608157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60eb4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 0x7fb60815dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60eb4c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6081583a0 con 0x7fb608144950 2023-11-25T04:09:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60eb4c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080ad450 con 0x7fb608144310 2023-11-25T04:09:17.667 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60eb4c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6080ad730 con 0x7fb60806cfa0 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60d0e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 0x7fb60815dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60d0e9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 0x7fb60815dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56328/0 (socket says 172.21.15.2:56328) 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60d0e9640 1 -- 172.21.15.2:0/864435470 learned_addr learned my addr 172.21.15.2:0/864435470 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb607fff640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb608144310 0x7fb608157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60c8e8640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb60806cfa0 0x7fb6081f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60d0e9640 1 -- 172.21.15.2:0/864435470 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb60806cfa0 msgr2=0x7fb6081f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60d0e9640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb60806cfa0 0x7fb6081f7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60d0e9640 1 -- 172.21.15.2:0/864435470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb608144310 msgr2=0x7fb608157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60d0e9640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb608144310 0x7fb608157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60d0e9640 1 -- 172.21.15.2:0/864435470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb600009a70 con 0x7fb608144950 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb607fff640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb608144310 0x7fb608157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:17.668 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.664+0000 7fb60d0e9640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 0x7fb60815dfc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb600009d90 tx=0x7fb600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.665+0000 7fb6057fa640 1 -- 172.21.15.2:0/864435470 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60003e610 con 0x7fb608144950 2023-11-25T04:09:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.665+0000 7fb6057fa640 1 -- 172.21.15.2:0/864435470 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60003e790 con 0x7fb608144950 2023-11-25T04:09:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.665+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6081f6c20 con 0x7fb608144950 2023-11-25T04:09:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.665+0000 7fb6057fa640 1 -- 172.21.15.2:0/864435470 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60003eb40 con 0x7fb608144950 2023-11-25T04:09:17.669 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.665+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6081f71e0 con 0x7fb608144950 2023-11-25T04:09:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.666+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb608072ae0 con 0x7fb608144950 2023-11-25T04:09:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.666+0000 7fb6057fa640 1 -- 172.21.15.2:0/864435470 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb60003b050 con 0x7fb608144950 2023-11-25T04:09:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.666+0000 7fb6057fa640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5ec06ae40 0x7fb5ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.667+0000 7fb60c8e8640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5ec06ae40 0x7fb5ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.667+0000 7fb6057fa640 1 -- 172.21.15.2:0/864435470 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fb6000ac110 con 0x7fb608144950 2023-11-25T04:09:17.670 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.667+0000 7fb60c8e8640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5ec06ae40 0x7fb5ec06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc007fd0 tx=0x7fb5fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.672 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.671+0000 7fb6057fa640 1 -- 172.21.15.2:0/864435470 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb600077130 con 0x7fb608144950 2023-11-25T04:09:17.849 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.847+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb6080b0510 con 0x7fb608144950 2023-11-25T04:09:17.850 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.848+0000 7fb6057fa640 1 -- 172.21.15.2:0/864435470 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb60007a750 con 0x7fb608144950 2023-11-25T04:09:17.850 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:17.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5ec06ae40 msgr2=0x7fb5ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5ec06ae40 0x7fb5ec06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc007fd0 tx=0x7fb5fc009040 comp rx=0 tx=0).stop 2023-11-25T04:09:17.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 msgr2=0x7fb60815dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 0x7fb60815dfc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb600009d90 tx=0x7fb600004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:17.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 shutdown_connections 2023-11-25T04:09:17.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb608144950 0x7fb60815dfc0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb5ec06ae40 0x7fb5ec06d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb608144310 0x7fb608157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.852 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 --2- 172.21.15.2:0/864435470 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb60806cfa0 0x7fb6081f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 >> 172.21.15.2:0/864435470 conn(0x7fb60806a8f0 msgr2=0x7fb6080afae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 shutdown_connections 2023-11-25T04:09:17.853 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.850+0000 7fb60eb4c640 1 -- 172.21.15.2:0/864435470 wait complete. 2023-11-25T04:09:17.863 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:17.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.971+0000 7f82bf7a9640 1 Processor -- start 2023-11-25T04:09:17.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.971+0000 7f82bf7a9640 1 -- start start 2023-11-25T04:09:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bf7a9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f82b80cfd40 0x7f82b806c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bf7a9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b80b3590 con 0x7f82b80b6b50 2023-11-25T04:09:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bf7a9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b806b310 con 0x7f82b809a080 2023-11-25T04:09:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bf7a9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b80cd3a0 con 0x7f82b80cfd40 2023-11-25T04:09:17.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bdd46640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f82b80cfd40 0x7f82b806c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bd545640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f82b80b6b50 0x7f82b8099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48432/0 (socket says 172.21.15.2:48432) 2023-11-25T04:09:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bd545640 1 -- 172.21.15.2:0/2533331530 learned_addr learned my addr 172.21.15.2:0/2533331530 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bdd46640 1 -- 172.21.15.2:0/2533331530 >> v1:172.21.15.66:6789/0 conn(0x7f82b809a080 legacy=0x7f82b806bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bdd46640 1 -- 172.21.15.2:0/2533331530 >> v1:172.21.15.2:6789/0 conn(0x7f82b80b6b50 legacy=0x7f82b8099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82bdd46640 1 -- 172.21.15.2:0/2533331530 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80b37c0 con 0x7f82b80cfd40 2023-11-25T04:09:17.975 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.972+0000 7f82b7fff640 1 -- 172.21.15.2:0/2533331530 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754114255 0 0) 0x7f82b80b3590 con 0x7f82b80b6b50 2023-11-25T04:09:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.973+0000 7f82bdd46640 1 --2- 172.21.15.2:0/2533331530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b80cfd40 0x7f82b806c360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f82a80097a0 tx=0x7f82a802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789359f441a1e21a server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.973+0000 7f82b7fff640 1 -- 172.21.15.2:0/2533331530 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a802f810 con 0x7f82b80cfd40 2023-11-25T04:09:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.973+0000 7f82b7fff640 1 -- 172.21.15.2:0/2533331530 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a802f970 con 0x7f82b80cfd40 2023-11-25T04:09:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.973+0000 7f82b7fff640 1 -- 172.21.15.2:0/2533331530 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a802fd00 con 0x7f82b80cfd40 2023-11-25T04:09:17.976 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.974+0000 7f82bf7a9640 1 -- 172.21.15.2:0/2533331530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b80cfd40 msgr2=0x7f82b806c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.974+0000 7f82bf7a9640 1 --2- 172.21.15.2:0/2533331530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b80cfd40 0x7f82b806c360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f82a80097a0 tx=0x7f82a802b9f0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.974+0000 7f82bf7a9640 1 -- 172.21.15.2:0/2533331530 shutdown_connections 2023-11-25T04:09:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.974+0000 7f82bf7a9640 1 --2- 172.21.15.2:0/2533331530 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b80cfd40 0x7f82b806c360 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.974+0000 7f82bf7a9640 1 -- 172.21.15.2:0/2533331530 >> 172.21.15.2:0/2533331530 conn(0x7f82b80b2a70 msgr2=0x7f82b80b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.974+0000 7f82bf7a9640 1 -- 172.21.15.2:0/2533331530 shutdown_connections 2023-11-25T04:09:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.974+0000 7f82bf7a9640 1 -- 172.21.15.2:0/2533331530 wait complete. 2023-11-25T04:09:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.975+0000 7f82bf7a9640 1 Processor -- start 2023-11-25T04:09:17.977 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.975+0000 7f82bf7a9640 1 -- start start 2023-11-25T04:09:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bf7a9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b809a080 0x7f82b80c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bf7a9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82b80b6b50 0x7f82b80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bf7a9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82b80cfd40 0x7f82b814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bf7a9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b80c7da0 con 0x7f82b809a080 2023-11-25T04:09:17.979 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bf7a9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8158490 con 0x7f82b80cfd40 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bf7a9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b8157c30 con 0x7f82b80b6b50 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bcd44640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82b80b6b50 0x7f82b80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bd545640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b809a080 0x7f82b80c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bdd46640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82b80cfd40 0x7f82b814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bcd44640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82b80b6b50 0x7f82b80b4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:45104/0 (socket says 172.21.15.2:45104) 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.976+0000 7f82bcd44640 1 -- 172.21.15.2:0/3074709324 learned_addr learned my addr 172.21.15.2:0/3074709324 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82bd545640 1 -- 172.21.15.2:0/3074709324 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82b80b6b50 msgr2=0x7f82b80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82bd545640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82b80b6b50 0x7f82b80b4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82bd545640 1 -- 172.21.15.2:0/3074709324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82b80cfd40 msgr2=0x7f82b814a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82bd545640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82b80cfd40 0x7f82b814a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82bd545640 1 -- 172.21.15.2:0/3074709324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a8009400 con 0x7f82b809a080 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82bd545640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b809a080 0x7f82b80c7860 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c780 tx=0x7f82b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.980 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82b5ffb640 1 -- 172.21.15.2:0/3074709324 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b000ce90 con 0x7f82b809a080 2023-11-25T04:09:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82b5ffb640 1 -- 172.21.15.2:0/3074709324 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b000a640 con 0x7f82b809a080 2023-11-25T04:09:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82b8157ed0 con 0x7f82b809a080 2023-11-25T04:09:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82b5ffb640 1 -- 172.21.15.2:0/3074709324 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b000a9f0 con 0x7f82b809a080 2023-11-25T04:09:17.981 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.977+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b80b4690 con 0x7f82b809a080 2023-11-25T04:09:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.978+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b80b44f0 con 0x7f82b809a080 2023-11-25T04:09:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.978+0000 7f82b5ffb640 1 -- 172.21.15.2:0/3074709324 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f82b000ab50 con 0x7f82b809a080 2023-11-25T04:09:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.979+0000 7f82b5ffb640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f82a406ae40 0x7f82a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.979+0000 7f82b5ffb640 1 -- 172.21.15.2:0/3074709324 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f82b0088e10 con 0x7f82b809a080 2023-11-25T04:09:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.979+0000 7f82bcd44640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f82a406ae40 0x7f82a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:17.982 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.979+0000 7f82bcd44640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f82a406ae40 0x7f82a406d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82b81f6810 tx=0x7f82ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:17.985 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:17.983+0000 7f82b5ffb640 1 -- 172.21.15.2:0/3074709324 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f82b80b44f0 con 0x7f82b809a080 2023-11-25T04:09:18.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.158+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82b80b44f0 con 0x7f82b809a080 2023-11-25T04:09:18.160 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.158+0000 7f82b5ffb640 1 -- 172.21.15.2:0/3074709324 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82b80b44f0 con 0x7f82b809a080 2023-11-25T04:09:18.160 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:18.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f82a406ae40 msgr2=0x7f82a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f82a406ae40 0x7f82a406d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82b81f6810 tx=0x7f82ac009040 comp rx=0 tx=0).stop 2023-11-25T04:09:18.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b809a080 msgr2=0x7f82b80c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b809a080 0x7f82b80c7860 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f82b000c780 tx=0x7f82b000cc40 comp rx=0 tx=0).stop 2023-11-25T04:09:18.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 shutdown_connections 2023-11-25T04:09:18.162 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f82a406ae40 0x7f82a406d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82b80cfd40 0x7f82b814a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82b80b6b50 0x7f82b80b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 --2- 172.21.15.2:0/3074709324 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f82b809a080 0x7f82b80c7860 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 >> 172.21.15.2:0/3074709324 conn(0x7f82b80b2a70 msgr2=0x7f82b80ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:18.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 shutdown_connections 2023-11-25T04:09:18.163 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.160+0000 7f82bf7a9640 1 -- 172.21.15.2:0/3074709324 wait complete. 2023-11-25T04:09:18.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-25T04:09:18.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.278+0000 7f6c9eff5640 1 Processor -- start 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.278+0000 7f6c9eff5640 1 -- start start 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9eff5640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c981465d0 0x7f6c980b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9eff5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c98071d40 0x7f6c98160d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9eff5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c980721d0 con 0x7f6c9806a4d0 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9eff5640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c98161d80 con 0x7f6c981465d0 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9eff5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c981612d0 con 0x7f6c98071d40 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9cd91640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f6c981465d0 0x7f6c980b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9d592640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6c9806a4d0 0x7f6c980cff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48446/0 (socket says 172.21.15.2:48446) 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9d592640 1 -- 172.21.15.2:0/3501137662 learned_addr learned my addr 172.21.15.2:0/3501137662 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c97fff640 1 --2- 172.21.15.2:0/3501137662 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c98071d40 0x7f6c98160d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9cd91640 1 -- 172.21.15.2:0/3501137662 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c98071d40 msgr2=0x7f6c98160d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:18.284 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9cd91640 1 --2- 172.21.15.2:0/3501137662 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c98071d40 0x7f6c98160d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9cd91640 1 -- 172.21.15.2:0/3501137662 >> v1:172.21.15.2:6789/0 conn(0x7f6c9806a4d0 legacy=0x7f6c980cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.279+0000 7f6c9cd91640 1 -- 172.21.15.2:0/3501137662 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c980cf790 con 0x7f6c981465d0 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.280+0000 7f6c9cd91640 1 --2- 172.21.15.2:0/3501137662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 0x7f6c980b2ee0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009d90 tx=0x7f6c9002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6b10a0ec758e4a server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.280+0000 7f6c977fe640 1 -- 172.21.15.2:0/3501137662 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9002cc50 con 0x7f6c981465d0 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.280+0000 7f6c977fe640 1 -- 172.21.15.2:0/3501137662 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9002cdb0 con 0x7f6c981465d0 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.280+0000 7f6c977fe640 1 -- 172.21.15.2:0/3501137662 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c90034660 con 0x7f6c981465d0 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.281+0000 7f6c9eff5640 1 -- 172.21.15.2:0/3501137662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 msgr2=0x7f6c980b2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.281+0000 7f6c9eff5640 1 --2- 172.21.15.2:0/3501137662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 0x7f6c980b2ee0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6c90009d90 tx=0x7f6c9002bea0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.281+0000 7f6c9eff5640 1 -- 172.21.15.2:0/3501137662 shutdown_connections 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.281+0000 7f6c9eff5640 1 --2- 172.21.15.2:0/3501137662 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c98071d40 0x7f6c98160d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.281+0000 7f6c9eff5640 1 --2- 172.21.15.2:0/3501137662 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 0x7f6c980b2ee0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.281+0000 7f6c9eff5640 1 -- 172.21.15.2:0/3501137662 >> 172.21.15.2:0/3501137662 conn(0x7f6c980cc930 msgr2=0x7f6c980ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:18.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.281+0000 7f6c9eff5640 1 -- 172.21.15.2:0/3501137662 shutdown_connections 2023-11-25T04:09:18.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.281+0000 7f6c9eff5640 1 -- 172.21.15.2:0/3501137662 wait complete. 2023-11-25T04:09:18.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.282+0000 7f6c9eff5640 1 Processor -- start 2023-11-25T04:09:18.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.282+0000 7f6c9eff5640 1 -- start start 2023-11-25T04:09:18.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9eff5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c9806a4d0 0x7f6c98141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9eff5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c98071d40 0x7f6c981419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9eff5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 0x7f6c98152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9eff5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9813e440 con 0x7f6c981465d0 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9eff5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c98150830 con 0x7f6c98071d40 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9eff5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9813de80 con 0x7f6c9806a4d0 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9d592640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 0x7f6c98152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9d592640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 0x7f6c98152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:56364/0 (socket says 172.21.15.2:56364) 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9d592640 1 -- 172.21.15.2:0/1360355080 learned_addr learned my addr 172.21.15.2:0/1360355080 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9cd91640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c9806a4d0 0x7f6c98141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c97fff640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c98071d40 0x7f6c981419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9d592640 1 -- 172.21.15.2:0/1360355080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c9806a4d0 msgr2=0x7f6c98141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9d592640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c9806a4d0 0x7f6c98141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9d592640 1 -- 172.21.15.2:0/1360355080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c98071d40 msgr2=0x7f6c981419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9d592640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c98071d40 0x7f6c981419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.283+0000 7f6c9d592640 1 -- 172.21.15.2:0/1360355080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c90009a70 con 0x7f6c981465d0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.284+0000 7f6c9d592640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 0x7f6c98152720 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c420 tx=0x7f6c8800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.284+0000 7f6c957fa640 1 -- 172.21.15.2:0/1360355080 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c88005ce0 con 0x7f6c981465d0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.284+0000 7f6c957fa640 1 -- 172.21.15.2:0/1360355080 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c88005e40 con 0x7f6c981465d0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.284+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9813e160 con 0x7f6c981465d0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.284+0000 7f6c957fa640 1 -- 172.21.15.2:0/1360355080 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c880072d0 con 0x7f6c981465d0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.284+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c98152c60 con 0x7f6c981465d0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.285+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c98150690 con 0x7f6c981465d0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.285+0000 7f6c957fa640 1 -- 172.21.15.2:0/1360355080 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c880074f0 con 0x7f6c981465d0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.286+0000 7f6c957fa640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6c8406ae40 0x7f6c8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.286+0000 7f6c957fa640 1 -- 172.21.15.2:0/1360355080 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f6c88088bc0 con 0x7f6c981465d0 2023-11-25T04:09:18.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.286+0000 7f6c9cd91640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6c8406ae40 0x7f6c8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.291 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.286+0000 7f6c9cd91640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6c8406ae40 0x7f6c8406d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c90036000 tx=0x7f6c90030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:18.292 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.290+0000 7f6c957fa640 1 -- 172.21.15.2:0/1360355080 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c98150690 con 0x7f6c981465d0 2023-11-25T04:09:18.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.479+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c98150d10 con 0x7f6c981465d0 2023-11-25T04:09:18.482 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.479+0000 7f6c957fa640 1 -- 172.21.15.2:0/1360355080 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c98150d10 con 0x7f6c981465d0 2023-11-25T04:09:18.482 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.481+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6c8406ae40 msgr2=0x7f6c8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.481+0000 7f6c9eff5640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6c8406ae40 0x7f6c8406d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c90036000 tx=0x7f6c90030000 comp rx=0 tx=0).stop 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.481+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 msgr2=0x7f6c98152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.481+0000 7f6c9eff5640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 0x7f6c98152720 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c420 tx=0x7f6c8800c8e0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.481+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 shutdown_connections 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.481+0000 7f6c9eff5640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6c981465d0 0x7f6c98152720 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.481+0000 7f6c9eff5640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6c8406ae40 0x7f6c8406d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.481+0000 7f6c9eff5640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c98071d40 0x7f6c981419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.482+0000 7f6c9eff5640 1 --2- 172.21.15.2:0/1360355080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c9806a4d0 0x7f6c98141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.482+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 >> 172.21.15.2:0/1360355080 conn(0x7f6c980cc930 msgr2=0x7f6c980b52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.482+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 shutdown_connections 2023-11-25T04:09:18.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.482+0000 7f6c9eff5640 1 -- 172.21.15.2:0/1360355080 wait complete. 2023-11-25T04:09:18.494 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T04:09:18.495 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T04:09:18.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:18.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.619+0000 7fd4f15e3640 1 Processor -- start 2023-11-25T04:09:18.621 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.619+0000 7fd4f15e3640 1 -- start start 2023-11-25T04:09:18.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4f15e3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd4ec15ada0 0x7fd4ec06d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4f15e3640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4ec06da60 0x7fd4ec071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4f15e3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4ec160e90 con 0x7fd4ec071880 2023-11-25T04:09:18.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4f15e3640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec161a80 con 0x7fd4ec06da60 2023-11-25T04:09:18.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4f15e3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4ec06df10 con 0x7fd4ec15ada0 2023-11-25T04:09:18.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4e3fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4ec06da60 0x7fd4ec071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4e3fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fd4ec06da60 0x7fd4ec071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42044/0 (socket says 172.21.15.2:42044) 2023-11-25T04:09:18.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4e3fff640 1 -- 172.21.15.2:0/574139822 learned_addr learned my addr 172.21.15.2:0/574139822 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:18.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4eaffd640 1 --2- 172.21.15.2:0/574139822 >> v2:172.21.15.66:3300/0 conn(0x7fd4ec15ada0 0x7fd4ec06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4e3fff640 1 -- 172.21.15.2:0/574139822 >> v2:172.21.15.66:3300/0 conn(0x7fd4ec15ada0 msgr2=0x7fd4ec06d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:18.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4e3fff640 1 --2- 172.21.15.2:0/574139822 >> v2:172.21.15.66:3300/0 conn(0x7fd4ec15ada0 0x7fd4ec06d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4e3fff640 1 -- 172.21.15.2:0/574139822 >> v1:172.21.15.66:6789/0 conn(0x7fd4ec071880 legacy=0x7fd4ec0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:18.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.620+0000 7fd4e3fff640 1 -- 172.21.15.2:0/574139822 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4ec1610e0 con 0x7fd4ec06da60 2023-11-25T04:09:18.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.621+0000 7fd4e3fff640 1 --2- 172.21.15.2:0/574139822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 0x7fd4ec071340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec06bac0 tx=0x7fd4d402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4f0f03b78bd116 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.621+0000 7fd4ea7fc640 1 -- 172.21.15.2:0/574139822 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4031750 con 0x7fd4ec06da60 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.621+0000 7fd4ea7fc640 1 -- 172.21.15.2:0/574139822 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d40318b0 con 0x7fd4ec06da60 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.621+0000 7fd4ea7fc640 1 -- 172.21.15.2:0/574139822 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4031c40 con 0x7fd4ec06da60 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.622+0000 7fd4f15e3640 1 -- 172.21.15.2:0/574139822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 msgr2=0x7fd4ec071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.622+0000 7fd4f15e3640 1 --2- 172.21.15.2:0/574139822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 0x7fd4ec071340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec06bac0 tx=0x7fd4d402b7f0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.622+0000 7fd4f15e3640 1 -- 172.21.15.2:0/574139822 shutdown_connections 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.622+0000 7fd4f15e3640 1 --2- 172.21.15.2:0/574139822 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 0x7fd4ec071340 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.622+0000 7fd4f15e3640 1 --2- 172.21.15.2:0/574139822 >> v2:172.21.15.66:3300/0 conn(0x7fd4ec15ada0 0x7fd4ec06d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.622+0000 7fd4f15e3640 1 -- 172.21.15.2:0/574139822 >> 172.21.15.2:0/574139822 conn(0x7fd4ec0b0af0 msgr2=0x7fd4ec0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:18.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.622+0000 7fd4f15e3640 1 -- 172.21.15.2:0/574139822 shutdown_connections 2023-11-25T04:09:18.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.622+0000 7fd4f15e3640 1 -- 172.21.15.2:0/574139822 wait complete. 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.623+0000 7fd4f15e3640 1 Processor -- start 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.623+0000 7fd4f15e3640 1 -- start start 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4f15e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 0x7fd4ec0b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4f15e3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4ec071880 0x7fd4ec1598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4f15e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ec15ada0 0x7fd4ec144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4f15e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0af070 con 0x7fd4ec06da60 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4f15e3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0af350 con 0x7fd4ec15ada0 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4f15e3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4ec0af630 con 0x7fd4ec071880 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 0x7fd4ec0b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.628 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eaffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 0x7fd4ec0b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42048/0 (socket says 172.21.15.2:42048) 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eaffd640 1 -- 172.21.15.2:0/3454945821 learned_addr learned my addr 172.21.15.2:0/3454945821 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eb7fe640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ec15ada0 0x7fd4ec144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4e3fff640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4ec071880 0x7fd4ec1598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eaffd640 1 -- 172.21.15.2:0/3454945821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4ec071880 msgr2=0x7fd4ec1598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eaffd640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4ec071880 0x7fd4ec1598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eaffd640 1 -- 172.21.15.2:0/3454945821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ec15ada0 msgr2=0x7fd4ec144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eaffd640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ec15ada0 0x7fd4ec144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eaffd640 1 -- 172.21.15.2:0/3454945821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40094d0 con 0x7fd4ec06da60 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4e3fff640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4ec071880 0x7fd4ec1598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4eaffd640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 0x7fd4ec0b0110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00d5f0 tx=0x7fd4dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4e37fe640 1 -- 172.21.15.2:0/3454945821 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc0125f0 con 0x7fd4ec06da60 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4e37fe640 1 -- 172.21.15.2:0/3454945821 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc012750 con 0x7fd4ec06da60 2023-11-25T04:09:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4e37fe640 1 -- 172.21.15.2:0/3454945821 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc012b00 con 0x7fd4ec06da60 2023-11-25T04:09:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.624+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4ec0af910 con 0x7fd4ec06da60 2023-11-25T04:09:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.625+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec0aec00 con 0x7fd4ec06da60 2023-11-25T04:09:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.626+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4ec073ee0 con 0x7fd4ec06da60 2023-11-25T04:09:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.626+0000 7fd4e37fe640 1 -- 172.21.15.2:0/3454945821 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4dc012c60 con 0x7fd4ec06da60 2023-11-25T04:09:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.626+0000 7fd4e37fe640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd4cc06ae70 0x7fd4cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.627+0000 7fd4e37fe640 1 -- 172.21.15.2:0/3454945821 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd4dc089ab0 con 0x7fd4ec06da60 2023-11-25T04:09:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.627+0000 7fd4e3fff640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd4cc06ae70 0x7fd4cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.627+0000 7fd4e3fff640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd4cc06ae70 0x7fd4cc06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4035000 tx=0x7fd4d4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.631+0000 7fd4e37fe640 1 -- 172.21.15.2:0/3454945821 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4dc054ac0 con 0x7fd4ec06da60 2023-11-25T04:09:18.808 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.806+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4ec067420 con 0x7fd4ec06da60 2023-11-25T04:09:18.809 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.807+0000 7fd4e37fe640 1 -- 172.21.15.2:0/3454945821 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16691 (secure 0 0 0) 0x7fd4dc081e60 con 0x7fd4ec06da60 2023-11-25T04:09:18.810 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:18.810 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:09:17.297158+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd4cc06ae70 msgr2=0x7fd4cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd4cc06ae70 0x7fd4cc06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4035000 tx=0x7fd4d4008030 comp rx=0 tx=0).stop 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 msgr2=0x7fd4ec0b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 0x7fd4ec0b0110 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00d5f0 tx=0x7fd4dc00dab0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 shutdown_connections 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd4cc06ae70 0x7fd4cc06d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4ec15ada0 0x7fd4ec144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4ec071880 0x7fd4ec1598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 --2- 172.21.15.2:0/3454945821 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd4ec06da60 0x7fd4ec0b0110 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 >> 172.21.15.2:0/3454945821 conn(0x7fd4ec0b0af0 msgr2=0x7fd4ec0701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.809+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 shutdown_connections 2023-11-25T04:09:18.812 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.810+0000 7fd4f15e3640 1 -- 172.21.15.2:0/3454945821 wait complete. 2023-11-25T04:09:18.823 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:18.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:18.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.930+0000 7f8c1e397640 1 Processor -- start 2023-11-25T04:09:18.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.930+0000 7f8c1e397640 1 -- start start 2023-11-25T04:09:18.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.931+0000 7f8c1e397640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 0x7f8c18168560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.931+0000 7f8c1e397640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c180ce360 con 0x7f8c180d1570 2023-11-25T04:09:18.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.931+0000 7f8c1e397640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c180d19f0 con 0x7f8c18160b70 2023-11-25T04:09:18.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.931+0000 7f8c1e397640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180b2f10 con 0x7f8c180b2aa0 2023-11-25T04:09:18.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.931+0000 7f8c177fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8c180d1570 0x7f8c180cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50470/0 (socket says 172.21.15.2:50470) 2023-11-25T04:09:18.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.931+0000 7f8c177fe640 1 -- 172.21.15.2:0/1961775358 learned_addr learned my addr 172.21.15.2:0/1961775358 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:18.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.932+0000 7f8c1c934640 1 --2- 172.21.15.2:0/1961775358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 0x7f8c18168560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.932+0000 7f8c16ffd640 1 -- 172.21.15.2:0/1961775358 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232500789 0 0) 0x7f8c180ce360 con 0x7f8c180d1570 2023-11-25T04:09:18.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.932+0000 7f8c16ffd640 1 -- 172.21.15.2:0/1961775358 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c04003520 con 0x7f8c180d1570 2023-11-25T04:09:18.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.932+0000 7f8c1c934640 1 -- 172.21.15.2:0/1961775358 >> v1:172.21.15.66:6789/0 conn(0x7f8c18160b70 legacy=0x7f8c180ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.932+0000 7f8c1c934640 1 -- 172.21.15.2:0/1961775358 >> v1:172.21.15.2:6789/0 conn(0x7f8c180d1570 legacy=0x7f8c180cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.932+0000 7f8c1c934640 1 -- 172.21.15.2:0/1961775358 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180cdd50 con 0x7f8c180b2aa0 2023-11-25T04:09:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.933+0000 7f8c1c934640 1 --2- 172.21.15.2:0/1961775358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 0x7f8c18168560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009dc0 tx=0x7f8c1002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53a94bdbd0c2de02 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.933+0000 7f8c16ffd640 1 -- 172.21.15.2:0/1961775358 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1002ccd0 con 0x7f8c180b2aa0 2023-11-25T04:09:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.933+0000 7f8c16ffd640 1 -- 172.21.15.2:0/1961775358 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1002ce30 con 0x7f8c180b2aa0 2023-11-25T04:09:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.933+0000 7f8c16ffd640 1 -- 172.21.15.2:0/1961775358 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10034660 con 0x7f8c180b2aa0 2023-11-25T04:09:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.933+0000 7f8c1e397640 1 -- 172.21.15.2:0/1961775358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 msgr2=0x7f8c18168560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.933+0000 7f8c1e397640 1 --2- 172.21.15.2:0/1961775358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 0x7f8c18168560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009dc0 tx=0x7f8c1002bf20 comp rx=0 tx=0).stop 2023-11-25T04:09:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.933+0000 7f8c1e397640 1 -- 172.21.15.2:0/1961775358 shutdown_connections 2023-11-25T04:09:18.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.933+0000 7f8c1e397640 1 --2- 172.21.15.2:0/1961775358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 0x7f8c18168560 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.933+0000 7f8c1e397640 1 -- 172.21.15.2:0/1961775358 >> 172.21.15.2:0/1961775358 conn(0x7f8c1809c470 msgr2=0x7f8c180d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.934+0000 7f8c1e397640 1 -- 172.21.15.2:0/1961775358 shutdown_connections 2023-11-25T04:09:18.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.934+0000 7f8c1e397640 1 -- 172.21.15.2:0/1961775358 wait complete. 2023-11-25T04:09:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.935+0000 7f8c1e397640 1 Processor -- start 2023-11-25T04:09:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.935+0000 7f8c1e397640 1 -- start start 2023-11-25T04:09:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c1e397640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 0x7f8c1814b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c1e397640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c180d1570 0x7f8c180ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c1e397640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c18160b70 0x7f8c1815eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c1e397640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1815e860 con 0x7f8c180d1570 2023-11-25T04:09:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c1e397640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180cb410 con 0x7f8c18160b70 2023-11-25T04:09:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c1e397640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1815e580 con 0x7f8c180b2aa0 2023-11-25T04:09:18.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c180d1570 0x7f8c180ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c177fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c180d1570 0x7f8c180ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42064/0 (socket says 172.21.15.2:42064) 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c177fe640 1 -- 172.21.15.2:0/3651283419 learned_addr learned my addr 172.21.15.2:0/3651283419 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c1c934640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c18160b70 0x7f8c1815eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c17fff640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 0x7f8c1814b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c177fe640 1 -- 172.21.15.2:0/3651283419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 msgr2=0x7f8c1814b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c177fe640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 0x7f8c1814b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c177fe640 1 -- 172.21.15.2:0/3651283419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c18160b70 msgr2=0x7f8c1815eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c177fe640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c18160b70 0x7f8c1815eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c177fe640 1 -- 172.21.15.2:0/3651283419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10009a70 con 0x7f8c180d1570 2023-11-25T04:09:18.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c177fe640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c180d1570 0x7f8c180ccc90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c410 tx=0x7f8c0000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c14ff9640 1 -- 172.21.15.2:0/3651283419 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c00005ce0 con 0x7f8c180d1570 2023-11-25T04:09:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c180cadc0 con 0x7f8c180d1570 2023-11-25T04:09:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c14ff9640 1 -- 172.21.15.2:0/3651283419 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c00005e40 con 0x7f8c180d1570 2023-11-25T04:09:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.936+0000 7f8c14ff9640 1 -- 172.21.15.2:0/3651283419 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c000072f0 con 0x7f8c180d1570 2023-11-25T04:09:18.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.937+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1814b970 con 0x7f8c180d1570 2023-11-25T04:09:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.938+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c180cac20 con 0x7f8c180d1570 2023-11-25T04:09:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.938+0000 7f8c14ff9640 1 -- 172.21.15.2:0/3651283419 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c00007450 con 0x7f8c180d1570 2023-11-25T04:09:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.938+0000 7f8c14ff9640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8bf806ae40 0x7f8bf806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.938+0000 7f8c14ff9640 1 -- 172.21.15.2:0/3651283419 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8c00088c20 con 0x7f8c180d1570 2023-11-25T04:09:18.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.938+0000 7f8c17fff640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8bf806ae40 0x7f8bf806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:18.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.939+0000 7f8c17fff640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8bf806ae40 0x7f8bf806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8c08000f60 tx=0x7f8c08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:18.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:18.943+0000 7f8c14ff9640 1 -- 172.21.15.2:0/3651283419 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c180cac20 con 0x7f8c180d1570 2023-11-25T04:09:19.118 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.116+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8c180cac20 con 0x7f8c180d1570 2023-11-25T04:09:19.119 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.117+0000 7f8c14ff9640 1 -- 172.21.15.2:0/3651283419 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8c180cac20 con 0x7f8c180d1570 2023-11-25T04:09:19.119 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:19.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8bf806ae40 msgr2=0x7f8bf806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8bf806ae40 0x7f8bf806d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8c08000f60 tx=0x7f8c08009040 comp rx=0 tx=0).stop 2023-11-25T04:09:19.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c180d1570 msgr2=0x7f8c180ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c180d1570 0x7f8c180ccc90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000c410 tx=0x7f8c0000c8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 shutdown_connections 2023-11-25T04:09:19.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8bf806ae40 0x7f8bf806d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c18160b70 0x7f8c1815eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c180d1570 0x7f8c180ccc90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 --2- 172.21.15.2:0/3651283419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c180b2aa0 0x7f8c1814b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.118+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 >> 172.21.15.2:0/3651283419 conn(0x7f8c1809c470 msgr2=0x7f8c180b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:19.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.119+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 shutdown_connections 2023-11-25T04:09:19.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.119+0000 7f8c1e397640 1 -- 172.21.15.2:0/3651283419 wait complete. 2023-11-25T04:09:19.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.239+0000 7f1e7d54c640 1 Processor -- start 2023-11-25T04:09:19.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.239+0000 7f1e7d54c640 1 -- start start 2023-11-25T04:09:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.240+0000 7f1e7d54c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e780b1970 0x7f1e78168360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.240+0000 7f1e7d54c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e780b04d0 con 0x7f1e7815d7b0 2023-11-25T04:09:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.240+0000 7f1e7d54c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e780d1e40 con 0x7f1e780d0220 2023-11-25T04:09:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.240+0000 7f1e7d54c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780afe80 con 0x7f1e780b1970 2023-11-25T04:09:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.240+0000 7f1e76ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1e7815d7b0 0x7f1e780cfb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50472/0 (socket says 172.21.15.2:50472) 2023-11-25T04:09:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.240+0000 7f1e76ffd640 1 -- 172.21.15.2:0/2479547055 learned_addr learned my addr 172.21.15.2:0/2479547055 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:19.245 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.240+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054275969 0 0) 0x7f1e780b04d0 con 0x7f1e7815d7b0 2023-11-25T04:09:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.240+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e64003520 con 0x7f1e7815d7b0 2023-11-25T04:09:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.240+0000 7f1e777fe640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e780b1970 0x7f1e78168360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2553467762 0 0) 0x7f1e64003520 con 0x7f1e7815d7b0 2023-11-25T04:09:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e780b1970 msgr2=0x7f1e78168360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e780b1970 0x7f1e78168360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 >> v1:172.21.15.66:6789/0 conn(0x7f1e780d0220 legacy=0x7f1e780cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780b0160 con 0x7f1e7815d7b0 2023-11-25T04:09:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f1e70001670 con 0x7f1e7815d7b0 2023-11-25T04:09:19.246 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 >> v1:172.21.15.2:6789/0 conn(0x7f1e7815d7b0 legacy=0x7f1e780cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e780b1970 0x7f1e640039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e64004d00 0x7f1e64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.247 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780afe80 con 0x7f1e64003f20 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6400ba60 con 0x7f1e64004d00 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6400bc20 con 0x7f1e780b1970 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e767fc640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e76ffd640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e780b1970 0x7f1e640039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e777fe640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e64004d00 0x7f1e64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e767fc640 1 -- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e780b1970 msgr2=0x7f1e640039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e767fc640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e780b1970 0x7f1e640039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e767fc640 1 -- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e64004d00 msgr2=0x7f1e64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e767fc640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e64004d00 0x7f1e64005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.248 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.241+0000 7f1e767fc640 1 -- 172.21.15.2:0/2479547055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e64003520 con 0x7f1e64003f20 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.242+0000 7f1e767fc640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e640047c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1e60001750 tx=0x7f1e640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13fa9bf704724ec server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.242+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e600052d0 con 0x7f1e64003f20 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.242+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6002e050 con 0x7f1e64003f20 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.242+0000 7f1e75ffb640 1 -- 172.21.15.2:0/2479547055 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e60003830 con 0x7f1e64003f20 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.243+0000 7f1e7d54c640 1 -- 172.21.15.2:0/2479547055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 msgr2=0x7f1e640047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.243+0000 7f1e7d54c640 1 --2- 172.21.15.2:0/2479547055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e640047c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1e60001750 tx=0x7f1e640057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.243+0000 7f1e777fe640 1 -- 172.21.15.2:0/2479547055 reap_dead start 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.243+0000 7f1e7d54c640 1 -- 172.21.15.2:0/2479547055 shutdown_connections 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.243+0000 7f1e7d54c640 1 -- 172.21.15.2:0/2479547055 >> 172.21.15.2:0/2479547055 conn(0x7f1e7809c480 msgr2=0x7f1e780d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:19.249 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.243+0000 7f1e7d54c640 1 -- 172.21.15.2:0/2479547055 shutdown_connections 2023-11-25T04:09:19.250 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.243+0000 7f1e7d54c640 1 -- 172.21.15.2:0/2479547055 wait complete. 2023-11-25T04:09:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.244+0000 7f1e7d54c640 1 Processor -- start 2023-11-25T04:09:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.244+0000 7f1e7d54c640 1 -- start start 2023-11-25T04:09:19.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e7d54c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e781f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e7d54c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e780b8910 0x7f1e780b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e7d54c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e78151870 0x7f1e780b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e7d54c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e781f6f20 con 0x7f1e64003f20 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e7d54c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e781f65c0 con 0x7f1e780b8910 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e7d54c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e780b8dd0 con 0x7f1e78151870 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e781f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e76ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e781f26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42086/0 (socket says 172.21.15.2:42086) 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e76ffd640 1 -- 172.21.15.2:0/4036861525 learned_addr learned my addr 172.21.15.2:0/4036861525 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e767fc640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e780b8910 0x7f1e780b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e777fe640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e78151870 0x7f1e780b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e76ffd640 1 -- 172.21.15.2:0/4036861525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e78151870 msgr2=0x7f1e780b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e76ffd640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e78151870 0x7f1e780b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e76ffd640 1 -- 172.21.15.2:0/4036861525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e780b8910 msgr2=0x7f1e780b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e76ffd640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e780b8910 0x7f1e780b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e76ffd640 1 -- 172.21.15.2:0/4036861525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e781f6860 con 0x7f1e64003f20 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.245+0000 7f1e76ffd640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e781f26d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1e700072c0 tx=0x7f1e70007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.246+0000 7f1e6f7fe640 1 -- 172.21.15.2:0/4036861525 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000f8e0 con 0x7f1e64003f20 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.246+0000 7f1e6f7fe640 1 -- 172.21.15.2:0/4036861525 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7000fa40 con 0x7f1e64003f20 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.246+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e781f6b40 con 0x7f1e64003f20 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.246+0000 7f1e6f7fe640 1 -- 172.21.15.2:0/4036861525 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e7000fdf0 con 0x7f1e64003f20 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.246+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e781f2c10 con 0x7f1e64003f20 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.247+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e780a1160 con 0x7f1e64003f20 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.247+0000 7f1e6f7fe640 1 -- 172.21.15.2:0/4036861525 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e7001d460 con 0x7f1e64003f20 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.247+0000 7f1e6f7fe640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1e5806ae70 0x7f1e5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.247+0000 7f1e6f7fe640 1 -- 172.21.15.2:0/4036861525 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1e70089610 con 0x7f1e64003f20 2023-11-25T04:09:19.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.247+0000 7f1e767fc640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1e5806ae70 0x7f1e5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.248+0000 7f1e767fc640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1e5806ae70 0x7f1e5806d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e60033000 tx=0x7f1e60009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:19.255 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.252+0000 7f1e6f7fe640 1 -- 172.21.15.2:0/4036861525 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1e70054770 con 0x7f1e64003f20 2023-11-25T04:09:19.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.427+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1e7804e920 con 0x7f1e64003f20 2023-11-25T04:09:19.430 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.427+0000 7f1e6f7fe640 1 -- 172.21.15.2:0/4036861525 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1e70057d90 con 0x7f1e64003f20 2023-11-25T04:09:19.430 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1e5806ae70 msgr2=0x7f1e5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1e5806ae70 0x7f1e5806d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1e60033000 tx=0x7f1e60009030 comp rx=0 tx=0).stop 2023-11-25T04:09:19.432 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 msgr2=0x7f1e781f26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e781f26d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1e700072c0 tx=0x7f1e70007780 comp rx=0 tx=0).stop 2023-11-25T04:09:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 shutdown_connections 2023-11-25T04:09:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1e78151870 0x7f1e780b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1e5806ae70 0x7f1e5806d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1e780b8910 0x7f1e780b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 --2- 172.21.15.2:0/4036861525 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1e64003f20 0x7f1e781f26d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.429+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 >> 172.21.15.2:0/4036861525 conn(0x7f1e7809c480 msgr2=0x7f1e7806c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:19.433 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.430+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 shutdown_connections 2023-11-25T04:09:19.434 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.430+0000 7f1e7d54c640 1 -- 172.21.15.2:0/4036861525 wait complete. 2023-11-25T04:09:19.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:19.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.550+0000 7f0a55368640 1 Processor -- start 2023-11-25T04:09:19.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.550+0000 7f0a55368640 1 -- start start 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.551+0000 7f0a55368640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a50160b70 0x7f0a500d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.551+0000 7f0a55368640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a500b2aa0 0x7f0a500ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.551+0000 7f0a55368640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a500ce360 con 0x7f0a500ced30 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.551+0000 7f0a55368640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500b2f20 con 0x7f0a50160b70 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.551+0000 7f0a55368640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500cdd50 con 0x7f0a500b2aa0 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.551+0000 7f0a4effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a50160b70 0x7f0a500d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.551+0000 7f0a4effd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f0a50160b70 0x7f0a500d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42094/0 (socket says 172.21.15.2:42094) 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.551+0000 7f0a4effd640 1 -- 172.21.15.2:0/3441180114 learned_addr learned my addr 172.21.15.2:0/3441180114 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.551+0000 7f0a4e7fc640 1 --2- 172.21.15.2:0/3441180114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a500b2aa0 0x7f0a500ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.552+0000 7f0a4effd640 1 -- 172.21.15.2:0/3441180114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a500b2aa0 msgr2=0x7f0a500ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:19.554 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.552+0000 7f0a4effd640 1 --2- 172.21.15.2:0/3441180114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a500b2aa0 0x7f0a500ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.552+0000 7f0a4effd640 1 -- 172.21.15.2:0/3441180114 >> v1:172.21.15.66:6789/0 conn(0x7f0a500ced30 legacy=0x7f0a500cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.555 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.552+0000 7f0a4effd640 1 -- 172.21.15.2:0/3441180114 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500d1c70 con 0x7f0a50160b70 2023-11-25T04:09:19.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.552+0000 7f0a4effd640 1 --2- 172.21.15.2:0/3441180114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a50160b70 0x7f0a500d1570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009870 tx=0x7f0a4802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a78f9deceeba14 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:19.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.552+0000 7f0a4dffb640 1 -- 172.21.15.2:0/3441180114 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48030840 con 0x7f0a50160b70 2023-11-25T04:09:19.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.552+0000 7f0a4dffb640 1 -- 172.21.15.2:0/3441180114 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a480309a0 con 0x7f0a50160b70 2023-11-25T04:09:19.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.552+0000 7f0a4dffb640 1 -- 172.21.15.2:0/3441180114 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a48030d30 con 0x7f0a50160b70 2023-11-25T04:09:19.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.553+0000 7f0a55368640 1 -- 172.21.15.2:0/3441180114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a50160b70 msgr2=0x7f0a500d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.553+0000 7f0a55368640 1 --2- 172.21.15.2:0/3441180114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a50160b70 0x7f0a500d1570 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0a48009870 tx=0x7f0a4802b980 comp rx=0 tx=0).stop 2023-11-25T04:09:19.556 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.553+0000 7f0a55368640 1 -- 172.21.15.2:0/3441180114 shutdown_connections 2023-11-25T04:09:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.553+0000 7f0a55368640 1 --2- 172.21.15.2:0/3441180114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a500b2aa0 0x7f0a500ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.553+0000 7f0a55368640 1 --2- 172.21.15.2:0/3441180114 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a50160b70 0x7f0a500d1570 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.553+0000 7f0a55368640 1 -- 172.21.15.2:0/3441180114 >> 172.21.15.2:0/3441180114 conn(0x7f0a5009c470 msgr2=0x7f0a500d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.553+0000 7f0a55368640 1 -- 172.21.15.2:0/3441180114 shutdown_connections 2023-11-25T04:09:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.553+0000 7f0a55368640 1 -- 172.21.15.2:0/3441180114 wait complete. 2023-11-25T04:09:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.554+0000 7f0a55368640 1 Processor -- start 2023-11-25T04:09:19.557 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.554+0000 7f0a55368640 1 -- start start 2023-11-25T04:09:19.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a55368640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a500b2aa0 0x7f0a500c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a55368640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a500ced30 0x7f0a50158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a55368640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a50160b70 0x7f0a500cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a55368640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a501590f0 con 0x7f0a500ced30 2023-11-25T04:09:19.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a55368640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a501593d0 con 0x7f0a500b2aa0 2023-11-25T04:09:19.559 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a55368640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a501596b0 con 0x7f0a50160b70 2023-11-25T04:09:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a4e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a500ced30 0x7f0a50158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a4e7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a500ced30 0x7f0a50158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42104/0 (socket says 172.21.15.2:42104) 2023-11-25T04:09:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a4e7fc640 1 -- 172.21.15.2:0/2242193866 learned_addr learned my addr 172.21.15.2:0/2242193866 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a4e7fc640 1 -- 172.21.15.2:0/2242193866 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a50160b70 msgr2=0x7f0a500cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a4e7fc640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a50160b70 0x7f0a500cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a4e7fc640 1 -- 172.21.15.2:0/2242193866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a500b2aa0 msgr2=0x7f0a500c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a4e7fc640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a500b2aa0 0x7f0a500c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.555+0000 7f0a4e7fc640 1 -- 172.21.15.2:0/2242193866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a480094d0 con 0x7f0a500ced30 2023-11-25T04:09:19.560 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.556+0000 7f0a4e7fc640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a500ced30 0x7f0a50158670 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800e9b0 tx=0x7f0a3800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:19.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.556+0000 7f0a477fe640 1 -- 172.21.15.2:0/2242193866 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a38009670 con 0x7f0a500ced30 2023-11-25T04:09:19.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.556+0000 7f0a477fe640 1 -- 172.21.15.2:0/2242193866 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3800c9a0 con 0x7f0a500ced30 2023-11-25T04:09:19.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.556+0000 7f0a477fe640 1 -- 172.21.15.2:0/2242193866 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3800cd50 con 0x7f0a500ced30 2023-11-25T04:09:19.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.556+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a50159990 con 0x7f0a500ced30 2023-11-25T04:09:19.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.556+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a50158bb0 con 0x7f0a500ced30 2023-11-25T04:09:19.561 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.557+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a50158e90 con 0x7f0a500ced30 2023-11-25T04:09:19.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.557+0000 7f0a477fe640 1 -- 172.21.15.2:0/2242193866 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a38013470 con 0x7f0a500ced30 2023-11-25T04:09:19.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.558+0000 7f0a477fe640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a3006ae40 0x7f0a3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.558+0000 7f0a477fe640 1 -- 172.21.15.2:0/2242193866 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0a38089820 con 0x7f0a500ced30 2023-11-25T04:09:19.562 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.558+0000 7f0a4effd640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a3006ae40 0x7f0a3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.558+0000 7f0a4effd640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a3006ae40 0x7f0a3006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a48036000 tx=0x7f0a4803b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:19.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.562+0000 7f0a477fe640 1 -- 172.21.15.2:0/2242193866 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a380548d0 con 0x7f0a500ced30 2023-11-25T04:09:19.738 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.736+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a500a1150 con 0x7f0a500ced30 2023-11-25T04:09:19.739 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.737+0000 7f0a477fe640 1 -- 172.21.15.2:0/2242193866 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a380170a0 con 0x7f0a500ced30 2023-11-25T04:09:19.739 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:19.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a3006ae40 msgr2=0x7f0a3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a3006ae40 0x7f0a3006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a48036000 tx=0x7f0a4803b040 comp rx=0 tx=0).stop 2023-11-25T04:09:19.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a500ced30 msgr2=0x7f0a50158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a500ced30 0x7f0a50158670 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800e9b0 tx=0x7f0a3800ee70 comp rx=0 tx=0).stop 2023-11-25T04:09:19.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 shutdown_connections 2023-11-25T04:09:19.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a50160b70 0x7f0a500cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.741 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f0a500ced30 0x7f0a50158670 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f0a3006ae40 0x7f0a3006d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 --2- 172.21.15.2:0/2242193866 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a500b2aa0 0x7f0a500c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 >> 172.21.15.2:0/2242193866 conn(0x7f0a5009c470 msgr2=0x7f0a5006c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 shutdown_connections 2023-11-25T04:09:19.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.739+0000 7f0a55368640 1 -- 172.21.15.2:0/2242193866 wait complete. 2023-11-25T04:09:19.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-25T04:09:19.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.857+0000 7f7e25ce7640 1 Processor -- start 2023-11-25T04:09:19.859 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.857+0000 7f7e25ce7640 1 -- start start 2023-11-25T04:09:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.858+0000 7f7e25ce7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7e20144a50 0x7f7e2015f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.858+0000 7f7e25ce7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e2006a4d0 0x7f7e2006a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.858+0000 7f7e25ce7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2006ae70 con 0x7f7e200cfde0 2023-11-25T04:09:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.858+0000 7f7e25ce7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e200b2ee0 con 0x7f7e20144a50 2023-11-25T04:09:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.858+0000 7f7e25ce7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e200b34a0 con 0x7f7e2006a4d0 2023-11-25T04:09:19.860 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.858+0000 7f7e1effd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e2006a4d0 0x7f7e2006a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.858+0000 7f7e1f7fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7e20144a50 0x7f7e2015f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.858+0000 7f7e1effd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e2006a4d0 0x7f7e2006a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:41044/0 (socket says 172.21.15.2:41044) 2023-11-25T04:09:19.861 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.858+0000 7f7e1effd640 1 -- 172.21.15.2:0/468375233 learned_addr learned my addr 172.21.15.2:0/468375233 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.859+0000 7f7e1effd640 1 -- 172.21.15.2:0/468375233 >> v2:172.21.15.66:3300/0 conn(0x7f7e20144a50 msgr2=0x7f7e2015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.859+0000 7f7e1effd640 1 --2- 172.21.15.2:0/468375233 >> v2:172.21.15.66:3300/0 conn(0x7f7e20144a50 0x7f7e2015f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.859+0000 7f7e1effd640 1 -- 172.21.15.2:0/468375233 >> v1:172.21.15.66:6789/0 conn(0x7f7e200cfde0 legacy=0x7f7e200d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.859+0000 7f7e1effd640 1 -- 172.21.15.2:0/468375233 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20144e30 con 0x7f7e2006a4d0 2023-11-25T04:09:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.859+0000 7f7e1effd640 1 --2- 172.21.15.2:0/468375233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e2006a4d0 0x7f7e2006a930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009870 tx=0x7f7e1402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541d1b8b3584fe0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e1e7fc640 1 -- 172.21.15.2:0/468375233 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14030840 con 0x7f7e2006a4d0 2023-11-25T04:09:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e1e7fc640 1 -- 172.21.15.2:0/468375233 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e140309a0 con 0x7f7e2006a4d0 2023-11-25T04:09:19.862 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e1e7fc640 1 -- 172.21.15.2:0/468375233 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e14030d30 con 0x7f7e2006a4d0 2023-11-25T04:09:19.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e25ce7640 1 -- 172.21.15.2:0/468375233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e2006a4d0 msgr2=0x7f7e2006a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e25ce7640 1 --2- 172.21.15.2:0/468375233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e2006a4d0 0x7f7e2006a930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009870 tx=0x7f7e1402b980 comp rx=0 tx=0).stop 2023-11-25T04:09:19.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e25ce7640 1 -- 172.21.15.2:0/468375233 shutdown_connections 2023-11-25T04:09:19.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e25ce7640 1 --2- 172.21.15.2:0/468375233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e2006a4d0 0x7f7e2006a930 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e25ce7640 1 --2- 172.21.15.2:0/468375233 >> v2:172.21.15.66:3300/0 conn(0x7f7e20144a50 0x7f7e2015f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e25ce7640 1 -- 172.21.15.2:0/468375233 >> 172.21.15.2:0/468375233 conn(0x7f7e200cc930 msgr2=0x7f7e200ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:19.863 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e25ce7640 1 -- 172.21.15.2:0/468375233 shutdown_connections 2023-11-25T04:09:19.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.860+0000 7f7e25ce7640 1 -- 172.21.15.2:0/468375233 wait complete. 2023-11-25T04:09:19.864 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.861+0000 7f7e25ce7640 1 Processor -- start 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.862+0000 7f7e25ce7640 1 -- start start 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.862+0000 7f7e25ce7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e2006a4d0 0x7f7e20143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.862+0000 7f7e25ce7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e200cfde0 0x7f7e20141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.862+0000 7f7e25ce7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e20144a50 0x7f7e2015aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.862+0000 7f7e25ce7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20143ea0 con 0x7f7e2006a4d0 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.862+0000 7f7e25ce7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e201428c0 con 0x7f7e20144a50 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.862+0000 7f7e25ce7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e20142ba0 con 0x7f7e200cfde0 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e2006a4d0 0x7f7e20143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1f7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e2006a4d0 0x7f7e20143960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42116/0 (socket says 172.21.15.2:42116) 2023-11-25T04:09:19.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1f7fe640 1 -- 172.21.15.2:0/179386700 learned_addr learned my addr 172.21.15.2:0/179386700 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1effd640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e200cfde0 0x7f7e20141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1ffff640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e20144a50 0x7f7e2015aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1f7fe640 1 -- 172.21.15.2:0/179386700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e200cfde0 msgr2=0x7f7e20141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1f7fe640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e200cfde0 0x7f7e20141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1f7fe640 1 -- 172.21.15.2:0/179386700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e20144a50 msgr2=0x7f7e2015aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1f7fe640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e20144a50 0x7f7e2015aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1f7fe640 1 -- 172.21.15.2:0/179386700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140094d0 con 0x7f7e2006a4d0 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1ffff640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e20144a50 0x7f7e2015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e1f7fe640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e2006a4d0 0x7f7e20143960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000e870 tx=0x7f7e1000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e07fff640 1 -- 172.21.15.2:0/179386700 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e100094f0 con 0x7f7e2006a4d0 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e07fff640 1 -- 172.21.15.2:0/179386700 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1000c940 con 0x7f7e2006a4d0 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e20142e80 con 0x7f7e2006a4d0 2023-11-25T04:09:19.868 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e07fff640 1 -- 172.21.15.2:0/179386700 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1000ccf0 con 0x7f7e2006a4d0 2023-11-25T04:09:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.863+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e20143440 con 0x7f7e2006a4d0 2023-11-25T04:09:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.864+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2006e6a0 con 0x7f7e2006a4d0 2023-11-25T04:09:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.865+0000 7f7e07fff640 1 -- 172.21.15.2:0/179386700 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e10013470 con 0x7f7e2006a4d0 2023-11-25T04:09:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.865+0000 7f7e07fff640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7e0c06ae40 0x7f7e0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:19.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.865+0000 7f7e07fff640 1 -- 172.21.15.2:0/179386700 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7e100897b0 con 0x7f7e2006a4d0 2023-11-25T04:09:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.865+0000 7f7e1effd640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7e0c06ae40 0x7f7e0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:19.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.866+0000 7f7e1effd640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7e0c06ae40 0x7f7e0c06d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e14036000 tx=0x7f7e14008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:19.872 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:19.869+0000 7f7e07fff640 1 -- 172.21.15.2:0/179386700 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e100547e0 con 0x7f7e2006a4d0 2023-11-25T04:09:20.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.058+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e2004e920 con 0x7f7e2006a4d0 2023-11-25T04:09:20.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.059+0000 7f7e07fff640 1 -- 172.21.15.2:0/179386700 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e10057e00 con 0x7f7e2006a4d0 2023-11-25T04:09:20.061 INFO:teuthology.orchestra.run.smithi002.stderr:listed 0 entries 2023-11-25T04:09:20.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7e0c06ae40 msgr2=0x7f7e0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7e0c06ae40 0x7f7e0c06d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7e14036000 tx=0x7f7e14008030 comp rx=0 tx=0).stop 2023-11-25T04:09:20.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e2006a4d0 msgr2=0x7f7e20143960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e2006a4d0 0x7f7e20143960 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7e1000e870 tx=0x7f7e1000ed30 comp rx=0 tx=0).stop 2023-11-25T04:09:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 shutdown_connections 2023-11-25T04:09:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7e0c06ae40 0x7f7e0c06d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7e20144a50 0x7f7e2015aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7e200cfde0 0x7f7e20141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 --2- 172.21.15.2:0/179386700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7e2006a4d0 0x7f7e20143960 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 >> 172.21.15.2:0/179386700 conn(0x7f7e200cc930 msgr2=0x7f7e2015c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 shutdown_connections 2023-11-25T04:09:20.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.061+0000 7f7e25ce7640 1 -- 172.21.15.2:0/179386700 wait complete. 2023-11-25T04:09:20.074 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi066.front.sepia.ceph.com... 2023-11-25T04:09:20.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:20.075 DEBUG:teuthology.orchestra.run.smithi066:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-11-25T04:09:20.111 INFO:teuthology.orchestra.run:waiting for 300 2023-11-25T04:09:20.112 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T04:09:20.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:20.112 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-25T04:09:20.171 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-25T04:09:20.171 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:09:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.276+0000 7f59872bb640 1 Processor -- start 2023-11-25T04:09:20.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.276+0000 7f59872bb640 1 -- start start 2023-11-25T04:09:20.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.277+0000 7f59872bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f598013e2d0 0x7f59800b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.277+0000 7f59872bb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598015bf60 0x7f59800cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.277+0000 7f59872bb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598006de80 con 0x7f59800b4640 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.277+0000 7f59872bb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59800b4ad0 con 0x7f598013e2d0 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.277+0000 7f59872bb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598015c3b0 con 0x7f598015bf60 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.277+0000 7f5985057640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f598013e2d0 0x7f59800b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.277+0000 7f5984856640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f59800b4640 0x7f598015b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50488/0 (socket says 172.21.15.2:50488) 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.277+0000 7f5984856640 1 -- 172.21.15.2:0/1747292061 learned_addr learned my addr 172.21.15.2:0/1747292061 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.278+0000 7f5985057640 1 -- 172.21.15.2:0/1747292061 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598015bf60 msgr2=0x7f59800cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.278+0000 7f5985858640 1 --2- 172.21.15.2:0/1747292061 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598015bf60 0x7f59800cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.278+0000 7f5985057640 1 --2- 172.21.15.2:0/1747292061 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598015bf60 0x7f59800cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.278+0000 7f5985057640 1 -- 172.21.15.2:0/1747292061 >> v1:172.21.15.2:6789/0 conn(0x7f59800b4640 legacy=0x7f598015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.281 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.278+0000 7f5985057640 1 -- 172.21.15.2:0/1747292061 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598006d5c0 con 0x7f598013e2d0 2023-11-25T04:09:20.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.278+0000 7f5985858640 1 --2- 172.21.15.2:0/1747292061 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598015bf60 0x7f59800cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:20.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.278+0000 7f5985057640 1 --2- 172.21.15.2:0/1747292061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598013e2d0 0x7f59800b4100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f59780097a0 tx=0x7f597802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df525e65b42ecb server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:20.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.278+0000 7f597ffff640 1 -- 172.21.15.2:0/1747292061 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978030710 con 0x7f598013e2d0 2023-11-25T04:09:20.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f597ffff640 1 -- 172.21.15.2:0/1747292061 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597802e050 con 0x7f598013e2d0 2023-11-25T04:09:20.282 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f597ffff640 1 -- 172.21.15.2:0/1747292061 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978030a90 con 0x7f598013e2d0 2023-11-25T04:09:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f59872bb640 1 -- 172.21.15.2:0/1747292061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598013e2d0 msgr2=0x7f59800b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f59872bb640 1 --2- 172.21.15.2:0/1747292061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598013e2d0 0x7f59800b4100 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f59780097a0 tx=0x7f597802b710 comp rx=0 tx=0).stop 2023-11-25T04:09:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f59872bb640 1 -- 172.21.15.2:0/1747292061 shutdown_connections 2023-11-25T04:09:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f59872bb640 1 --2- 172.21.15.2:0/1747292061 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598015bf60 0x7f59800cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f59872bb640 1 --2- 172.21.15.2:0/1747292061 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598013e2d0 0x7f59800b4100 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f59872bb640 1 -- 172.21.15.2:0/1747292061 >> 172.21.15.2:0/1747292061 conn(0x7f59800b0af0 msgr2=0x7f59800b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f59872bb640 1 -- 172.21.15.2:0/1747292061 shutdown_connections 2023-11-25T04:09:20.285 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.279+0000 7f59872bb640 1 -- 172.21.15.2:0/1747292061 wait complete. 2023-11-25T04:09:20.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.280+0000 7f59872bb640 1 Processor -- start 2023-11-25T04:09:20.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.280+0000 7f59872bb640 1 -- start start 2023-11-25T04:09:20.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f59872bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800b4640 0x7f598015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f59872bb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598013e2d0 0x7f59801505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f59872bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598015bf60 0x7f5980150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f59872bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59800ad4b0 con 0x7f598015bf60 2023-11-25T04:09:20.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f59872bb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59800ad790 con 0x7f59800b4640 2023-11-25T04:09:20.286 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f59872bb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59800ada70 con 0x7f598013e2d0 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f5985858640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598015bf60 0x7f5980150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f5985858640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598015bf60 0x7f5980150af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42136/0 (socket says 172.21.15.2:42136) 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f5985858640 1 -- 172.21.15.2:0/401787157 learned_addr learned my addr 172.21.15.2:0/401787157 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f5985057640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800b4640 0x7f598015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.281+0000 7f5984856640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598013e2d0 0x7f59801505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f5985858640 1 -- 172.21.15.2:0/401787157 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598013e2d0 msgr2=0x7f59801505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f5985858640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598013e2d0 0x7f59801505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f5985858640 1 -- 172.21.15.2:0/401787157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800b4640 msgr2=0x7f598015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f5985858640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800b4640 0x7f598015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f5985858640 1 -- 172.21.15.2:0/401787157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5978009400 con 0x7f598015bf60 2023-11-25T04:09:20.287 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f5984856640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598013e2d0 0x7f59801505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f5985858640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598015bf60 0x7f5980150af0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f597000cef0 tx=0x7f597000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f597dffb640 1 -- 172.21.15.2:0/401787157 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597000d840 con 0x7f598015bf60 2023-11-25T04:09:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f597dffb640 1 -- 172.21.15.2:0/401787157 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597000d9c0 con 0x7f598015bf60 2023-11-25T04:09:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59800add50 con 0x7f598015bf60 2023-11-25T04:09:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f597dffb640 1 -- 172.21.15.2:0/401787157 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597000dd70 con 0x7f598015bf60 2023-11-25T04:09:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.282+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59800ae270 con 0x7f598015bf60 2023-11-25T04:09:20.288 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.283+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59800adf70 con 0x7f598015bf60 2023-11-25T04:09:20.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.283+0000 7f597dffb640 1 -- 172.21.15.2:0/401787157 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f597001e3b0 con 0x7f598015bf60 2023-11-25T04:09:20.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.284+0000 7f597dffb640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f596c06ae40 0x7f596c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.284+0000 7f597dffb640 1 -- 172.21.15.2:0/401787157 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f597008a040 con 0x7f598015bf60 2023-11-25T04:09:20.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.284+0000 7f5985057640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f596c06ae40 0x7f596c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.289 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.284+0000 7f5985057640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f596c06ae40 0x7f596c06d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5978034000 tx=0x7f5978008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:20.290 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.288+0000 7f597dffb640 1 -- 172.21.15.2:0/401787157 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5970055260 con 0x7f598015bf60 2023-11-25T04:09:20.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.501+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59800ad5f0 con 0x7f598015bf60 2023-11-25T04:09:20.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.501+0000 7f597dffb640 1 -- 172.21.15.2:0/401787157 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f59800ad5f0 con 0x7f598015bf60 2023-11-25T04:09:20.504 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:20.504 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1227253459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1227253459},{"type":"v1","addr":"172.21.15.66:6835","nonce":1227253459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3032459629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3032459629},{"type":"v1","addr":"172.21.15.2:6835","nonce":3032459629}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:08:35.512348+0000","modified":"2023-11-25T04:08:38.534749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/1650670057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1650670057},{"type":"v1","addr":"172.21.15.66:6833","nonce":1650670057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-25T04:09:20.504 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-25T04:09:20.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f596c06ae40 msgr2=0x7f596c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f596c06ae40 0x7f596c06d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5978034000 tx=0x7f5978008030 comp rx=0 tx=0).stop 2023-11-25T04:09:20.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598015bf60 msgr2=0x7f5980150af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598015bf60 0x7f5980150af0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f597000cef0 tx=0x7f597000a710 comp rx=0 tx=0).stop 2023-11-25T04:09:20.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 shutdown_connections 2023-11-25T04:09:20.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f598015bf60 0x7f5980150af0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f598013e2d0 0x7f59801505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f596c06ae40 0x7f596c06d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 --2- 172.21.15.2:0/401787157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59800b4640 0x7f598015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 >> 172.21.15.2:0/401787157 conn(0x7f59800b0af0 msgr2=0x7f5980071670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:20.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 shutdown_connections 2023-11-25T04:09:20.507 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.504+0000 7f59872bb640 1 -- 172.21.15.2:0/401787157 wait complete. 2023-11-25T04:09:20.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:20.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.621+0000 7f1e03189640 1 Processor -- start 2023-11-25T04:09:20.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.621+0000 7f1e03189640 1 -- start start 2023-11-25T04:09:20.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.622+0000 7f1e03189640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1dfc15d3e0 0x7f1dfc0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.622+0000 7f1e03189640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1dfc0d1e30 0x7f1dfc0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.622+0000 7f1e03189640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dfc0b5f90 con 0x7f1dfc0ced30 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.622+0000 7f1e03189640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc0cf170 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.622+0000 7f1e03189640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dfc0b61e0 con 0x7f1dfc0d1e30 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.622+0000 7f1e00f25640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1dfc15d3e0 0x7f1dfc0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.622+0000 7f1e00f25640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f1dfc15d3e0 0x7f1dfc0ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42150/0 (socket says 172.21.15.2:42150) 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.623+0000 7f1e00f25640 1 -- 172.21.15.2:0/2120073231 learned_addr learned my addr 172.21.15.2:0/2120073231 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.623+0000 7f1e01726640 1 --2- 172.21.15.2:0/2120073231 >> v2:172.21.15.66:3300/0 conn(0x7f1dfc0d1e30 0x7f1dfc0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.623+0000 7f1e00f25640 1 -- 172.21.15.2:0/2120073231 >> v2:172.21.15.66:3300/0 conn(0x7f1dfc0d1e30 msgr2=0x7f1dfc0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.623+0000 7f1e00f25640 1 --2- 172.21.15.2:0/2120073231 >> v2:172.21.15.66:3300/0 conn(0x7f1dfc0d1e30 0x7f1dfc0b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.623+0000 7f1e00f25640 1 -- 172.21.15.2:0/2120073231 >> v1:172.21.15.66:6789/0 conn(0x7f1dfc0ced30 legacy=0x7f1dfc0d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:20.626 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.623+0000 7f1e00f25640 1 -- 172.21.15.2:0/2120073231 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc0b64c0 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1e00f25640 1 --2- 172.21.15.2:0/2120073231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 0x7f1dfc0ce7f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0cdc30 tx=0x7f1df402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce4b8ddc4b92497 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:20.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1dfb7fe640 1 -- 172.21.15.2:0/2120073231 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df402cb20 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1dfb7fe640 1 -- 172.21.15.2:0/2120073231 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df402cc80 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.627 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1dfb7fe640 1 -- 172.21.15.2:0/2120073231 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df40343f0 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1e03189640 1 -- 172.21.15.2:0/2120073231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 msgr2=0x7f1dfc0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.633 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1e03189640 1 --2- 172.21.15.2:0/2120073231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 0x7f1dfc0ce7f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0cdc30 tx=0x7f1df402bf80 comp rx=0 tx=0).stop 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1e03189640 1 -- 172.21.15.2:0/2120073231 shutdown_connections 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1e03189640 1 --2- 172.21.15.2:0/2120073231 >> v2:172.21.15.66:3300/0 conn(0x7f1dfc0d1e30 0x7f1dfc0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1e03189640 1 --2- 172.21.15.2:0/2120073231 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 0x7f1dfc0ce7f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1e03189640 1 -- 172.21.15.2:0/2120073231 >> 172.21.15.2:0/2120073231 conn(0x7f1dfc09c480 msgr2=0x7f1dfc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1e03189640 1 -- 172.21.15.2:0/2120073231 shutdown_connections 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.624+0000 7f1e03189640 1 -- 172.21.15.2:0/2120073231 wait complete. 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.625+0000 7f1e03189640 1 Processor -- start 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.625+0000 7f1e03189640 1 -- start start 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.626+0000 7f1e03189640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1dfc0ced30 0x7f1dfc1f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.626+0000 7f1e03189640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc0d1e30 0x7f1dfc1f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.626+0000 7f1e03189640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 0x7f1dfc0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.634 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.626+0000 7f1e03189640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc09e760 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.626+0000 7f1e03189640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1f6d80 con 0x7f1dfc0d1e30 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.626+0000 7f1e03189640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dfc1f7060 con 0x7f1dfc0ced30 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.626+0000 7f1e01726640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 0x7f1dfc0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.626+0000 7f1e01726640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 0x7f1dfc0cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42160/0 (socket says 172.21.15.2:42160) 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.626+0000 7f1e01726640 1 -- 172.21.15.2:0/543717474 learned_addr learned my addr 172.21.15.2:0/543717474 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1dfbfff640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc0d1e30 0x7f1dfc1f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e00f25640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1dfc0ced30 0x7f1dfc1f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e01726640 1 -- 172.21.15.2:0/543717474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1dfc0ced30 msgr2=0x7f1dfc1f24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e01726640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1dfc0ced30 0x7f1dfc1f24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e01726640 1 -- 172.21.15.2:0/543717474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc0d1e30 msgr2=0x7f1dfc1f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e01726640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc0d1e30 0x7f1dfc1f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.635 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e01726640 1 -- 172.21.15.2:0/543717474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df4009b30 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e00f25640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1dfc0ced30 0x7f1dfc1f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e01726640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 0x7f1dfc0cc3e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00c7f0 tx=0x7f1dec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1df97fa640 1 -- 172.21.15.2:0/543717474 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec004220 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1df97fa640 1 -- 172.21.15.2:0/543717474 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec004380 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1df97fa640 1 -- 172.21.15.2:0/543717474 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec007860 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dfc09e970 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.627+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dfc152be0 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.628+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dfc09ee90 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.629+0000 7f1df97fa640 1 -- 172.21.15.2:0/543717474 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1dec007bd0 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.629+0000 7f1df97fa640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1de806ae40 0x7f1de806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.629+0000 7f1df97fa640 1 -- 172.21.15.2:0/543717474 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1dec0895d0 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.636 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.629+0000 7f1e00f25640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1de806ae40 0x7f1de806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.630+0000 7f1e00f25640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1de806ae40 0x7f1de806d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1df4035000 tx=0x7f1df4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:20.637 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.633+0000 7f1df97fa640 1 -- 172.21.15.2:0/543717474 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1dfc09ee90 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.816 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.814+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dfc09ee90 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.817 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.815+0000 7f1df97fa640 1 -- 172.21.15.2:0/543717474 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16691 (secure 0 0 0) 0x7f1dfc09ee90 con 0x7f1dfc15d3e0 2023-11-25T04:09:20.818 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:20.818 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:09:17.297158+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:20.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.817+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1de806ae40 msgr2=0x7f1de806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.817+0000 7f1e03189640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1de806ae40 0x7f1de806d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1df4035000 tx=0x7f1df4030000 comp rx=0 tx=0).stop 2023-11-25T04:09:20.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.817+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 msgr2=0x7f1dfc0cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.817+0000 7f1e03189640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 0x7f1dfc0cc3e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00c7f0 tx=0x7f1dec00ccb0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.818+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 shutdown_connections 2023-11-25T04:09:20.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.818+0000 7f1e03189640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1dfc15d3e0 0x7f1dfc0cc3e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.818+0000 7f1e03189640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1de806ae40 0x7f1de806d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.818+0000 7f1e03189640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1dfc0d1e30 0x7f1dfc1f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.818+0000 7f1e03189640 1 --2- 172.21.15.2:0/543717474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1dfc0ced30 0x7f1dfc1f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.818+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 >> 172.21.15.2:0/543717474 conn(0x7f1dfc09c480 msgr2=0x7f1dfc0cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:20.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.818+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 shutdown_connections 2023-11-25T04:09:20.821 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.818+0000 7f1e03189640 1 -- 172.21.15.2:0/543717474 wait complete. 2023-11-25T04:09:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-25T04:08:33.589744+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-25T04:08:34.501601+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:20.831 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:20.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.939+0000 7f7f7ed33640 1 Processor -- start 2023-11-25T04:09:20.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.939+0000 7f7f7ed33640 1 -- start start 2023-11-25T04:09:20.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7ed33640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7f780b6b50 0x7f7f780cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7ed33640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f780b3590 con 0x7f7f7806bc50 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7ed33640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f7806b310 con 0x7f7f78099970 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7ed33640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f780cd3a0 con 0x7f7f780b6b50 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7cacf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7f780b6b50 0x7f7f780cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7d2d0640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7f7806bc50 0x7f7f7806c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50500/0 (socket says 172.21.15.2:50500) 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7d2d0640 1 -- 172.21.15.2:0/1691844700 learned_addr learned my addr 172.21.15.2:0/1691844700 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7cacf640 1 -- 172.21.15.2:0/1691844700 >> v1:172.21.15.66:6789/0 conn(0x7f7f78099970 legacy=0x7f7f78099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7cacf640 1 -- 172.21.15.2:0/1691844700 >> v1:172.21.15.2:6789/0 conn(0x7f7f7806bc50 legacy=0x7f7f7806c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f7cacf640 1 -- 172.21.15.2:0/1691844700 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780b37c0 con 0x7f7f780b6b50 2023-11-25T04:09:20.943 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.940+0000 7f7f777fe640 1 -- 172.21.15.2:0/1691844700 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669696458 0 0) 0x7f7f780b3590 con 0x7f7f7806bc50 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.941+0000 7f7f7cacf640 1 --2- 172.21.15.2:0/1691844700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f780b6b50 0x7f7f780cfd40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009d90 tx=0x7f7f7002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1b37b2895ea0643 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.941+0000 7f7f777fe640 1 -- 172.21.15.2:0/1691844700 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7002cd00 con 0x7f7f780b6b50 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.941+0000 7f7f777fe640 1 -- 172.21.15.2:0/1691844700 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7002ce60 con 0x7f7f780b6b50 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.941+0000 7f7f777fe640 1 -- 172.21.15.2:0/1691844700 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70034660 con 0x7f7f780b6b50 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.942+0000 7f7f7ed33640 1 -- 172.21.15.2:0/1691844700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f780b6b50 msgr2=0x7f7f780cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.942+0000 7f7f7ed33640 1 --2- 172.21.15.2:0/1691844700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f780b6b50 0x7f7f780cfd40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7f70009d90 tx=0x7f7f7002bf50 comp rx=0 tx=0).stop 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.942+0000 7f7f7ed33640 1 -- 172.21.15.2:0/1691844700 shutdown_connections 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.942+0000 7f7f7ed33640 1 --2- 172.21.15.2:0/1691844700 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f780b6b50 0x7f7f780cfd40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.942+0000 7f7f7ed33640 1 -- 172.21.15.2:0/1691844700 >> 172.21.15.2:0/1691844700 conn(0x7f7f780b2a70 msgr2=0x7f7f780b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:20.945 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.942+0000 7f7f7ed33640 1 -- 172.21.15.2:0/1691844700 shutdown_connections 2023-11-25T04:09:20.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.942+0000 7f7f7ed33640 1 -- 172.21.15.2:0/1691844700 wait complete. 2023-11-25T04:09:20.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.943+0000 7f7f7ed33640 1 Processor -- start 2023-11-25T04:09:20.946 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.943+0000 7f7f7ed33640 1 -- start start 2023-11-25T04:09:20.947 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7ed33640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7806bc50 0x7f7f780c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7ed33640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f78099970 0x7f7f781582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7ed33640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f780b6b50 0x7f7f781464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7ed33640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f781f2cc0 con 0x7f7f7806bc50 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7ed33640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7815b000 con 0x7f7f780b6b50 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7ed33640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7815b2e0 con 0x7f7f78099970 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7cacf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7806bc50 0x7f7f780c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7cacf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7806bc50 0x7f7f780c6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42174/0 (socket says 172.21.15.2:42174) 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7cacf640 1 -- 172.21.15.2:0/672977351 learned_addr learned my addr 172.21.15.2:0/672977351 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f77fff640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f78099970 0x7f7f781582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7d2d0640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f780b6b50 0x7f7f781464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7cacf640 1 -- 172.21.15.2:0/672977351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f78099970 msgr2=0x7f7f781582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.948 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7cacf640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f78099970 0x7f7f781582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7cacf640 1 -- 172.21.15.2:0/672977351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f780b6b50 msgr2=0x7f7f781464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7cacf640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f780b6b50 0x7f7f781464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f7cacf640 1 -- 172.21.15.2:0/672977351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f70009a70 con 0x7f7f7806bc50 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.944+0000 7f7f77fff640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f78099970 0x7f7f781582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.945+0000 7f7f7cacf640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7806bc50 0x7f7f780c6db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7f70037040 tx=0x7f7f70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.945+0000 7f7f757fa640 1 -- 172.21.15.2:0/672977351 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7003e670 con 0x7f7f7806bc50 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.945+0000 7f7f757fa640 1 -- 172.21.15.2:0/672977351 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7003e7d0 con 0x7f7f7806bc50 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.945+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7815b5c0 con 0x7f7f7806bc50 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.945+0000 7f7f757fa640 1 -- 172.21.15.2:0/672977351 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7003eb80 con 0x7f7f7806bc50 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.945+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f780c6890 con 0x7f7f7806bc50 2023-11-25T04:09:20.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.946+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7809ef40 con 0x7f7f7806bc50 2023-11-25T04:09:20.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.946+0000 7f7f757fa640 1 -- 172.21.15.2:0/672977351 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f7003b040 con 0x7f7f7806bc50 2023-11-25T04:09:20.950 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.947+0000 7f7f757fa640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f5806ae40 0x7f7f5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.947+0000 7f7f757fa640 1 -- 172.21.15.2:0/672977351 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7f700aba60 con 0x7f7f7806bc50 2023-11-25T04:09:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.947+0000 7f7f77fff640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f5806ae40 0x7f7f5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:20.951 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.947+0000 7f7f77fff640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f5806ae40 0x7f7f5806d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7f780d0280 tx=0x7f7f68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:20.953 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:20.951+0000 7f7f757fa640 1 -- 172.21.15.2:0/672977351 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f70076b10 con 0x7f7f7806bc50 2023-11-25T04:09:21.127 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.125+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7f7804e920 con 0x7f7f7806bc50 2023-11-25T04:09:21.128 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.126+0000 7f7f757fa640 1 -- 172.21.15.2:0/672977351 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7f7004e0a0 con 0x7f7f7806bc50 2023-11-25T04:09:21.128 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.127+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f5806ae40 msgr2=0x7f7f5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.127+0000 7f7f7ed33640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f5806ae40 0x7f7f5806d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7f780d0280 tx=0x7f7f68009040 comp rx=0 tx=0).stop 2023-11-25T04:09:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.127+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7806bc50 msgr2=0x7f7f780c6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.127+0000 7f7f7ed33640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7806bc50 0x7f7f780c6db0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7f70037040 tx=0x7f7f70004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.128+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 shutdown_connections 2023-11-25T04:09:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.128+0000 7f7f7ed33640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7f5806ae40 0x7f7f5806d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.130 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.128+0000 7f7f7ed33640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f780b6b50 0x7f7f781464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.128+0000 7f7f7ed33640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f78099970 0x7f7f781582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.128+0000 7f7f7ed33640 1 --2- 172.21.15.2:0/672977351 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7f7806bc50 0x7f7f780c6db0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.128+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 >> 172.21.15.2:0/672977351 conn(0x7f7f780b2a70 msgr2=0x7f7f7806edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.128+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 shutdown_connections 2023-11-25T04:09:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.128+0000 7f7f7ed33640 1 -- 172.21.15.2:0/672977351 wait complete. 2023-11-25T04:09:21.142 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-25T04:09:21.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.250+0000 7f500da0e640 1 Processor -- start 2023-11-25T04:09:21.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.250+0000 7f500da0e640 1 -- start start 2023-11-25T04:09:21.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f500da0e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f500815d6c0 0x7f50080cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f500da0e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50080d1d60 0x7f50080d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f500da0e640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080d11d0 con 0x7f50080d1980 2023-11-25T04:09:21.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f500da0e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50080ce2b0 con 0x7f50080d1d60 2023-11-25T04:09:21.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f500da0e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080ce590 con 0x7f500815d6c0 2023-11-25T04:09:21.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f5006ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f50080d1980 0x7f500815cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50512/0 (socket says 172.21.15.2:50512) 2023-11-25T04:09:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f50077fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f50080d1d60 0x7f50080d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f5006ffd640 1 -- 172.21.15.2:0/1224771 learned_addr learned my addr 172.21.15.2:0/1224771 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f4ffe7fc640 1 --2- 172.21.15.2:0/1224771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f500815d6c0 0x7f50080cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f50077fe640 1 -- 172.21.15.2:0/1224771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f500815d6c0 msgr2=0x7f50080cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f50077fe640 1 --2- 172.21.15.2:0/1224771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f500815d6c0 0x7f50080cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f50077fe640 1 -- 172.21.15.2:0/1224771 >> v1:172.21.15.2:6789/0 conn(0x7f50080d1980 legacy=0x7f500815cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f50067fc640 1 -- 172.21.15.2:0/1224771 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652721674 0 0) 0x7f50080d11d0 con 0x7f50080d1980 2023-11-25T04:09:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f50077fe640 1 -- 172.21.15.2:0/1224771 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080ce870 con 0x7f50080d1d60 2023-11-25T04:09:21.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.251+0000 7f4ffe7fc640 1 --2- 172.21.15.2:0/1224771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f500815d6c0 0x7f50080cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.252+0000 7f50077fe640 1 --2- 172.21.15.2:0/1224771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50080d1d60 0x7f50080d3bd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5000009d90 tx=0x7f500002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a6d315743d1cf9e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.252+0000 7f50067fc640 1 -- 172.21.15.2:0/1224771 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500002cbc0 con 0x7f50080d1d60 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.252+0000 7f50067fc640 1 -- 172.21.15.2:0/1224771 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500002cd20 con 0x7f50080d1d60 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.252+0000 7f50067fc640 1 -- 172.21.15.2:0/1224771 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000034660 con 0x7f50080d1d60 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.253+0000 7f500da0e640 1 -- 172.21.15.2:0/1224771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50080d1d60 msgr2=0x7f50080d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.253+0000 7f500da0e640 1 --2- 172.21.15.2:0/1224771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50080d1d60 0x7f50080d3bd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5000009d90 tx=0x7f500002be10 comp rx=0 tx=0).stop 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.253+0000 7f500da0e640 1 -- 172.21.15.2:0/1224771 shutdown_connections 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.253+0000 7f500da0e640 1 --2- 172.21.15.2:0/1224771 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f50080d1d60 0x7f50080d3bd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.253+0000 7f500da0e640 1 --2- 172.21.15.2:0/1224771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f500815d6c0 0x7f50080cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.253+0000 7f500da0e640 1 -- 172.21.15.2:0/1224771 >> 172.21.15.2:0/1224771 conn(0x7f500809c470 msgr2=0x7f50080d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:21.256 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.253+0000 7f500da0e640 1 -- 172.21.15.2:0/1224771 shutdown_connections 2023-11-25T04:09:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.253+0000 7f500da0e640 1 -- 172.21.15.2:0/1224771 wait complete. 2023-11-25T04:09:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.254+0000 7f500da0e640 1 Processor -- start 2023-11-25T04:09:21.257 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.254+0000 7f500da0e640 1 -- start start 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f500da0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50080d1980 0x7f50080b6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f500da0e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50080d1d60 0x7f5008156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f500da0e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f500815d6c0 0x7f50081f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f500da0e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080b7f90 con 0x7f500815d6c0 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f500da0e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080b7380 con 0x7f50080d1980 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f500da0e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080b7660 con 0x7f50080d1d60 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f50077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f500815d6c0 0x7f50081f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f50077fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f500815d6c0 0x7f50081f2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42186/0 (socket says 172.21.15.2:42186) 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f50077fe640 1 -- 172.21.15.2:0/3619846185 learned_addr learned my addr 172.21.15.2:0/3619846185 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:21.259 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f4ffe7fc640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50080d1d60 0x7f5008156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f5006ffd640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50080d1980 0x7f50080b6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f50077fe640 1 -- 172.21.15.2:0/3619846185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50080d1d60 msgr2=0x7f5008156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f50077fe640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50080d1d60 0x7f5008156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f50077fe640 1 -- 172.21.15.2:0/3619846185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50080d1980 msgr2=0x7f50080b6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f50077fe640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50080d1980 0x7f50080b6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f50077fe640 1 -- 172.21.15.2:0/3619846185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5000009a70 con 0x7f500815d6c0 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f5006ffd640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50080d1980 0x7f50080b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.255+0000 7f50077fe640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f500815d6c0 0x7f50081f2fe0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5000009d90 tx=0x7f5000004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.256+0000 7f5004ff9640 1 -- 172.21.15.2:0/3619846185 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000040650 con 0x7f500815d6c0 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.256+0000 7f5004ff9640 1 -- 172.21.15.2:0/3619846185 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500002ce90 con 0x7f500815d6c0 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.256+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50080b7940 con 0x7f500815d6c0 2023-11-25T04:09:21.260 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.256+0000 7f5004ff9640 1 -- 172.21.15.2:0/3619846185 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5000040a10 con 0x7f500815d6c0 2023-11-25T04:09:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.256+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5008149cb0 con 0x7f500815d6c0 2023-11-25T04:09:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.257+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50080b8140 con 0x7f500815d6c0 2023-11-25T04:09:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.257+0000 7f5004ff9640 1 -- 172.21.15.2:0/3619846185 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5000040b70 con 0x7f500815d6c0 2023-11-25T04:09:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.257+0000 7f5004ff9640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4fe806ae40 0x7f4fe806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.261 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.258+0000 7f5004ff9640 1 -- 172.21.15.2:0/3619846185 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f50000ac3e0 con 0x7f500815d6c0 2023-11-25T04:09:21.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.258+0000 7f5006ffd640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4fe806ae40 0x7f4fe806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.262 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.258+0000 7f5006ffd640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4fe806ae40 0x7f4fe806d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8000f60 tx=0x7f4ff8007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:21.264 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.262+0000 7f5004ff9640 1 -- 172.21.15.2:0/3619846185 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50080b8140 con 0x7f500815d6c0 2023-11-25T04:09:21.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.440+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50080a10e0 con 0x7f500815d6c0 2023-11-25T04:09:21.442 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.440+0000 7f5004ff9640 1 -- 172.21.15.2:0/3619846185 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50000774a0 con 0x7f500815d6c0 2023-11-25T04:09:21.443 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 32 2023-11-25T04:09:21.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.442+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4fe806ae40 msgr2=0x7f4fe806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4fe806ae40 0x7f4fe806d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8000f60 tx=0x7f4ff8007c10 comp rx=0 tx=0).stop 2023-11-25T04:09:21.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f500815d6c0 msgr2=0x7f50081f2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f500815d6c0 0x7f50081f2fe0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5000009d90 tx=0x7f5000004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:21.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 shutdown_connections 2023-11-25T04:09:21.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f500815d6c0 0x7f50081f2fe0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50080d1d60 0x7f5008156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f4fe806ae40 0x7f4fe806d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 --2- 172.21.15.2:0/3619846185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50080d1980 0x7f50080b6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 >> 172.21.15.2:0/3619846185 conn(0x7f500809c470 msgr2=0x7f50080b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:21.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 shutdown_connections 2023-11-25T04:09:21.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.443+0000 7f500da0e640 1 -- 172.21.15.2:0/3619846185 wait complete. 2023-11-25T04:09:21.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-25T04:09:21.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.563+0000 7f6b7c316640 1 Processor -- start 2023-11-25T04:09:21.565 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.563+0000 7f6b7c316640 1 -- start start 2023-11-25T04:09:21.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b7c316640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6b740cfd40 0x7f6b7406c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b7c316640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b740b3590 con 0x7f6b7409a080 2023-11-25T04:09:21.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b7c316640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7406b310 con 0x7f6b740b6b50 2023-11-25T04:09:21.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b7c316640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740cd3a0 con 0x7f6b740cfd40 2023-11-25T04:09:21.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b798b1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f6b7409a080 0x7f6b7406bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50526/0 (socket says 172.21.15.2:50526) 2023-11-25T04:09:21.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b798b1640 1 -- 172.21.15.2:0/3124063179 learned_addr learned my addr 172.21.15.2:0/3124063179 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:21.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b7a8b3640 1 --2- 172.21.15.2:0/3124063179 >> v2:172.21.15.66:3300/0 conn(0x7f6b740cfd40 0x7f6b7406c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3648658688 0 0) 0x7f6b740b3590 con 0x7f6b7409a080 2023-11-25T04:09:21.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b60003520 con 0x7f6b7409a080 2023-11-25T04:09:21.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588321151 0 0) 0x7f6b60003520 con 0x7f6b7409a080 2023-11-25T04:09:21.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 >> v2:172.21.15.66:3300/0 conn(0x7f6b740cfd40 msgr2=0x7f6b7406c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:21.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b790b0640 1 --2- 172.21.15.2:0/3124063179 >> v2:172.21.15.66:3300/0 conn(0x7f6b740cfd40 0x7f6b7406c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 >> v1:172.21.15.66:6789/0 conn(0x7f6b740b6b50 legacy=0x7f6b74099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.570 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.564+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b740b37c0 con 0x7f6b7409a080 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f6b64001670 con 0x7f6b7409a080 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 >> v1:172.21.15.2:6789/0 conn(0x7f6b7409a080 legacy=0x7f6b7406bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b790b0640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b60003970 0x7f6b60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b790b0640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b600047c0 0x7f6b60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b790b0640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b60005180 0x7f6b6000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740cd3a0 con 0x7f6b600047c0 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6000c030 con 0x7f6b60003970 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6000c1f0 con 0x7f6b60005180 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b798b1640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b600047c0 0x7f6b60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b7a0b2640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b60003970 0x7f6b60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b7a8b3640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b60005180 0x7f6b6000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.571 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b798b1640 1 -- 172.21.15.2:0/3124063179 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b60005180 msgr2=0x7f6b6000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b798b1640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b60005180 0x7f6b6000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b798b1640 1 -- 172.21.15.2:0/3124063179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b60003970 msgr2=0x7f6b60003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b798b1640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b60003970 0x7f6b60003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b798b1640 1 -- 172.21.15.2:0/3124063179 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60003520 con 0x7f6b600047c0 2023-11-25T04:09:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.565+0000 7f6b7a8b3640 1 -- 172.21.15.2:0/3124063179 reap_dead start 2023-11-25T04:09:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.566+0000 7f6b798b1640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b600047c0 0x7f6b60004c40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400c240 tx=0x7f6b600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70899782704f4ee7 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.566+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64005ad0 con 0x7f6b600047c0 2023-11-25T04:09:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.566+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64005c30 con 0x7f6b600047c0 2023-11-25T04:09:21.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.566+0000 7f6b790b0640 1 -- 172.21.15.2:0/3124063179 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6402c850 con 0x7f6b600047c0 2023-11-25T04:09:21.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.566+0000 7f6b7c316640 1 -- 172.21.15.2:0/3124063179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b600047c0 msgr2=0x7f6b60004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.566+0000 7f6b7c316640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b600047c0 0x7f6b60004c40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400c240 tx=0x7f6b600057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.567+0000 7f6b7c316640 1 -- 172.21.15.2:0/3124063179 shutdown_connections 2023-11-25T04:09:21.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.567+0000 7f6b7c316640 1 --2- 172.21.15.2:0/3124063179 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b600047c0 0x7f6b60004c40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.567+0000 7f6b7c316640 1 -- 172.21.15.2:0/3124063179 >> 172.21.15.2:0/3124063179 conn(0x7f6b740b2a70 msgr2=0x7f6b740b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:21.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.567+0000 7f6b7c316640 1 -- 172.21.15.2:0/3124063179 shutdown_connections 2023-11-25T04:09:21.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.567+0000 7f6b7c316640 1 -- 172.21.15.2:0/3124063179 wait complete. 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.568+0000 7f6b7c316640 1 Processor -- start 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.568+0000 7f6b7c316640 1 -- start start 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.568+0000 7f6b7c316640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b600047c0 0x7f6b7409e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b7c316640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b741f31c0 0x7f6b74150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b7c316640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b7415d580 0x7f6b740b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b7c316640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7409ecd0 con 0x7f6b741f31c0 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b7c316640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7409e9f0 con 0x7f6b600047c0 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b7c316640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7409be30 con 0x7f6b7415d580 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b798b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b741f31c0 0x7f6b74150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b798b1640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b741f31c0 0x7f6b74150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42196/0 (socket says 172.21.15.2:42196) 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b798b1640 1 -- 172.21.15.2:0/842463914 learned_addr learned my addr 172.21.15.2:0/842463914 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b7a0b2640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b600047c0 0x7f6b7409e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b7a8b3640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b7415d580 0x7f6b740b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b798b1640 1 -- 172.21.15.2:0/842463914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b7415d580 msgr2=0x7f6b740b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b798b1640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b7415d580 0x7f6b740b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b798b1640 1 -- 172.21.15.2:0/842463914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b600047c0 msgr2=0x7f6b7409e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b798b1640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b600047c0 0x7f6b7409e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b798b1640 1 -- 172.21.15.2:0/842463914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7409c110 con 0x7f6b741f31c0 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b798b1640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b741f31c0 0x7f6b74150360 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6b6402c3f0 tx=0x7f6b6402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b6affd640 1 -- 172.21.15.2:0/842463914 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6403c040 con 0x7f6b741f31c0 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b6affd640 1 -- 172.21.15.2:0/842463914 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6402cc60 con 0x7f6b741f31c0 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7409c3f0 con 0x7f6b741f31c0 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b6affd640 1 -- 172.21.15.2:0/842463914 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64007070 con 0x7f6b741f31c0 2023-11-25T04:09:21.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.569+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b741508a0 con 0x7f6b741f31c0 2023-11-25T04:09:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.571+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7409ef40 con 0x7f6b741f31c0 2023-11-25T04:09:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.571+0000 7f6b6affd640 1 -- 172.21.15.2:0/842463914 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6b64032070 con 0x7f6b741f31c0 2023-11-25T04:09:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.571+0000 7f6b6affd640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6b5806ae70 0x7f6b5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.571+0000 7f6b7a0b2640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6b5806ae70 0x7f6b5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.571+0000 7f6b6affd640 1 -- 172.21.15.2:0/842463914 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f6b640aab80 con 0x7f6b741f31c0 2023-11-25T04:09:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.572+0000 7f6b7a0b2640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6b5806ae70 0x7f6b5806d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6b70000c00 tx=0x7f6b70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:21.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.575+0000 7f6b6affd640 1 -- 172.21.15.2:0/842463914 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6b64075ba0 con 0x7f6b741f31c0 2023-11-25T04:09:21.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.750+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b7404e920 con 0x7f6b741f31c0 2023-11-25T04:09:21.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.751+0000 7f6b6affd640 1 -- 172.21.15.2:0/842463914 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b640791c0 con 0x7f6b741f31c0 2023-11-25T04:09:21.753 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 64 2023-11-25T04:09:21.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.752+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6b5806ae70 msgr2=0x7f6b5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.752+0000 7f6b7c316640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6b5806ae70 0x7f6b5806d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6b70000c00 tx=0x7f6b70009040 comp rx=0 tx=0).stop 2023-11-25T04:09:21.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.752+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b741f31c0 msgr2=0x7f6b74150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:21.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.752+0000 7f6b7c316640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b741f31c0 0x7f6b74150360 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f6b6402c3f0 tx=0x7f6b6402e070 comp rx=0 tx=0).stop 2023-11-25T04:09:21.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.752+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 shutdown_connections 2023-11-25T04:09:21.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.753+0000 7f6b7c316640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b7415d580 0x7f6b740b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.753+0000 7f6b7c316640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f6b741f31c0 0x7f6b74150360 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.755 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.753+0000 7f6b7c316640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f6b5806ae70 0x7f6b5806d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.753+0000 7f6b7c316640 1 --2- 172.21.15.2:0/842463914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b600047c0 0x7f6b7409e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.753+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 >> 172.21.15.2:0/842463914 conn(0x7f6b740b2a70 msgr2=0x7f6b740cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.753+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 shutdown_connections 2023-11-25T04:09:21.756 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:21.753+0000 7f6b7c316640 1 -- 172.21.15.2:0/842463914 wait complete. 2023-11-25T04:09:21.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:09:22.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.043+0000 7f1279256640 1 Processor -- start 2023-11-25T04:09:22.045 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.043+0000 7f1279256640 1 -- start start 2023-11-25T04:09:22.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f1279256640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f127415b1f0 0x7f12740ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f1279256640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12740ce760 con 0x7f1274141370 2023-11-25T04:09:22.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f1279256640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12740cea40 con 0x7f12740cc7c0 2023-11-25T04:09:22.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f1279256640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12740ced20 con 0x7f127415b1f0 2023-11-25T04:09:22.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f126bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1274141370 0x7f12740cc0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50542/0 (socket says 172.21.15.2:50542) 2023-11-25T04:09:22.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f126bfff640 1 -- 172.21.15.2:0/3739773639 learned_addr learned my addr 172.21.15.2:0/3739773639 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:22.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f1272d9d640 1 --2- 172.21.15.2:0/3739773639 >> v2:172.21.15.66:3300/0 conn(0x7f127415b1f0 0x7f12740ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f127259c640 1 -- 172.21.15.2:0/3739773639 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1642770040 0 0) 0x7f12740ce760 con 0x7f1274141370 2023-11-25T04:09:22.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f127259c640 1 -- 172.21.15.2:0/3739773639 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1260003520 con 0x7f1274141370 2023-11-25T04:09:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f127259c640 1 -- 172.21.15.2:0/3739773639 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941185146 0 0) 0x7f12740cea40 con 0x7f12740cc7c0 2023-11-25T04:09:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f127259c640 1 -- 172.21.15.2:0/3739773639 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12740ce760 con 0x7f12740cc7c0 2023-11-25T04:09:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f127259c640 1 -- 172.21.15.2:0/3739773639 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2968554208 0 0) 0x7f1260003520 con 0x7f1274141370 2023-11-25T04:09:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f1272d9d640 1 -- 172.21.15.2:0/3739773639 >> v1:172.21.15.66:6789/0 conn(0x7f12740cc7c0 legacy=0x7f127406a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f1272d9d640 1 -- 172.21.15.2:0/3739773639 >> v1:172.21.15.2:6789/0 conn(0x7f1274141370 legacy=0x7f12740cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.044+0000 7f1272d9d640 1 -- 172.21.15.2:0/3739773639 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12740cf000 con 0x7f127415b1f0 2023-11-25T04:09:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.045+0000 7f1272d9d640 1 --2- 172.21.15.2:0/3739773639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127415b1f0 0x7f12740ce0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12640097a0 tx=0x7f126402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bd254106bd5161 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:22.049 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.045+0000 7f127259c640 1 -- 172.21.15.2:0/3739773639 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126402f050 con 0x7f127415b1f0 2023-11-25T04:09:22.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.045+0000 7f127259c640 1 -- 172.21.15.2:0/3739773639 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1264031500 con 0x7f127415b1f0 2023-11-25T04:09:22.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.045+0000 7f127259c640 1 -- 172.21.15.2:0/3739773639 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c001670 con 0x7f127415b1f0 2023-11-25T04:09:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.046+0000 7f1279256640 1 -- 172.21.15.2:0/3739773639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127415b1f0 msgr2=0x7f12740ce0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.046+0000 7f1279256640 1 --2- 172.21.15.2:0/3739773639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127415b1f0 0x7f12740ce0a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f12640097a0 tx=0x7f126402b820 comp rx=0 tx=0).stop 2023-11-25T04:09:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.046+0000 7f1279256640 1 -- 172.21.15.2:0/3739773639 shutdown_connections 2023-11-25T04:09:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.046+0000 7f1279256640 1 --2- 172.21.15.2:0/3739773639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f127415b1f0 0x7f12740ce0a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.046+0000 7f1279256640 1 -- 172.21.15.2:0/3739773639 >> 172.21.15.2:0/3739773639 conn(0x7f12740cf6a0 msgr2=0x7f12740cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.046+0000 7f1279256640 1 -- 172.21.15.2:0/3739773639 shutdown_connections 2023-11-25T04:09:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.046+0000 7f1279256640 1 -- 172.21.15.2:0/3739773639 wait complete. 2023-11-25T04:09:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.047+0000 7f1279256640 1 Processor -- start 2023-11-25T04:09:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.047+0000 7f1279256640 1 -- start start 2023-11-25T04:09:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.048+0000 7f1279256640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12740cc7c0 0x7f12741f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.048+0000 7f1279256640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1274141370 0x7f1274153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.048+0000 7f1279256640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f127415b1f0 0x7f12740b3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.048+0000 7f1279256640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1274157050 con 0x7f127415b1f0 2023-11-25T04:09:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.048+0000 7f1279256640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1274157330 con 0x7f12740cc7c0 2023-11-25T04:09:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.048+0000 7f1279256640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1274157610 con 0x7f1274141370 2023-11-25T04:09:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.048+0000 7f127359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f127415b1f0 0x7f12740b3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.048+0000 7f127359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f127415b1f0 0x7f12740b3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42200/0 (socket says 172.21.15.2:42200) 2023-11-25T04:09:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.048+0000 7f127359e640 1 -- 172.21.15.2:0/2456398369 learned_addr learned my addr 172.21.15.2:0/2456398369 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:22.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f1272d9d640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12740cc7c0 0x7f12741f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f126bfff640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1274141370 0x7f1274153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f127359e640 1 -- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1274141370 msgr2=0x7f1274153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f127359e640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1274141370 0x7f1274153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f127359e640 1 -- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12740cc7c0 msgr2=0x7f12741f6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f127359e640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12740cc7c0 0x7f12741f6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f127359e640 1 -- 172.21.15.2:0/2456398369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1264009400 con 0x7f127415b1f0 2023-11-25T04:09:22.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f1272d9d640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12740cc7c0 0x7f12741f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f126bfff640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1274141370 0x7f1274153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f127359e640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f127415b1f0 0x7f12740b3110 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c7a0 tx=0x7f126c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f126b7fe640 1 -- 172.21.15.2:0/2456398369 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c003b70 con 0x7f127415b1f0 2023-11-25T04:09:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f126b7fe640 1 -- 172.21.15.2:0/2456398369 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c003cd0 con 0x7f127415b1f0 2023-11-25T04:09:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12741578f0 con 0x7f127415b1f0 2023-11-25T04:09:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f126b7fe640 1 -- 172.21.15.2:0/2456398369 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c00aa90 con 0x7f127415b1f0 2023-11-25T04:09:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.049+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12740b4640 con 0x7f127415b1f0 2023-11-25T04:09:22.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.050+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12741417c0 con 0x7f127415b1f0 2023-11-25T04:09:22.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.050+0000 7f126b7fe640 1 -- 172.21.15.2:0/2456398369 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f126c00abf0 con 0x7f127415b1f0 2023-11-25T04:09:22.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.051+0000 7f126b7fe640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f125406ae40 0x7f125406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.051+0000 7f1272d9d640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f125406ae40 0x7f125406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.051+0000 7f126b7fe640 1 -- 172.21.15.2:0/2456398369 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f126c089560 con 0x7f127415b1f0 2023-11-25T04:09:22.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.052+0000 7f1272d9d640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f125406ae40 0x7f125406d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1264035000 tx=0x7f1264008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:22.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.055+0000 7f126b7fe640 1 -- 172.21.15.2:0/2456398369 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f12741417c0 con 0x7f127415b1f0 2023-11-25T04:09:22.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.269+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1274157e10 con 0x7f127415b1f0 2023-11-25T04:09:22.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.269+0000 7f126b7fe640 1 -- 172.21.15.2:0/2456398369 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f1274157e10 con 0x7f127415b1f0 2023-11-25T04:09:22.272 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:22.272 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1227253459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1227253459},{"type":"v1","addr":"172.21.15.66:6835","nonce":1227253459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3032459629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3032459629},{"type":"v1","addr":"172.21.15.2:6835","nonce":3032459629}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:08:35.512348+0000","modified":"2023-11-25T04:08:38.534749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/1650670057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1650670057},{"type":"v1","addr":"172.21.15.66:6833","nonce":1650670057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-25T04:09:22.272 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-25T04:09:22.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f125406ae40 msgr2=0x7f125406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f125406ae40 0x7f125406d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1264035000 tx=0x7f1264008030 comp rx=0 tx=0).stop 2023-11-25T04:09:22.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f127415b1f0 msgr2=0x7f12740b3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f127415b1f0 0x7f12740b3110 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f126c00c7a0 tx=0x7f126c00cc60 comp rx=0 tx=0).stop 2023-11-25T04:09:22.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 shutdown_connections 2023-11-25T04:09:22.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f127415b1f0 0x7f12740b3110 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1274141370 0x7f1274153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f125406ae40 0x7f125406d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 --2- 172.21.15.2:0/2456398369 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12740cc7c0 0x7f12741f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.271+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 >> 172.21.15.2:0/2456398369 conn(0x7f12740cf6a0 msgr2=0x7f127406a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:22.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.272+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 shutdown_connections 2023-11-25T04:09:22.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.272+0000 7f1279256640 1 -- 172.21.15.2:0/2456398369 wait complete. 2023-11-25T04:09:22.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:22.391 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.389+0000 7f5696143640 1 Processor -- start 2023-11-25T04:09:22.392 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.389+0000 7f5696143640 1 -- start start 2023-11-25T04:09:22.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f5696143640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5690099970 0x7f5690099d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f5696143640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f569009a530 0x7f56900cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f5696143640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f56900cf890 0x7f56900b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f5696143640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900d0070 con 0x7f5690099970 2023-11-25T04:09:22.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f5696143640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56900cbb50 con 0x7f56900cf890 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f5696143640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f569009a290 con 0x7f569009a530 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f568f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5690099970 0x7f5690099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f568f7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5690099970 0x7f5690099d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42210/0 (socket says 172.21.15.2:42210) 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f568f7fe640 1 -- 172.21.15.2:0/3020007913 learned_addr learned my addr 172.21.15.2:0/3020007913 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f568ffff640 1 --2- 172.21.15.2:0/3020007913 >> v2:172.21.15.66:3300/0 conn(0x7f56900cf890 0x7f56900b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f568effd640 1 --2- 172.21.15.2:0/3020007913 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f569009a530 0x7f56900cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f568f7fe640 1 -- 172.21.15.2:0/3020007913 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f569009a530 msgr2=0x7f56900cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f568f7fe640 1 --2- 172.21.15.2:0/3020007913 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f569009a530 0x7f56900cc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.390+0000 7f568f7fe640 1 -- 172.21.15.2:0/3020007913 >> v2:172.21.15.66:3300/0 conn(0x7f56900cf890 msgr2=0x7f56900b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.391+0000 7f568f7fe640 1 --2- 172.21.15.2:0/3020007913 >> v2:172.21.15.66:3300/0 conn(0x7f56900cf890 0x7f56900b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.391+0000 7f568f7fe640 1 -- 172.21.15.2:0/3020007913 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56900cfd90 con 0x7f5690099970 2023-11-25T04:09:22.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.391+0000 7f568effd640 1 --2- 172.21.15.2:0/3020007913 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f569009a530 0x7f56900cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:22.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.391+0000 7f568f7fe640 1 --2- 172.21.15.2:0/3020007913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690099970 0x7f5690099d50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5690068100 tx=0x7f568002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785eba2244a33930 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:22.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.391+0000 7f568e7fc640 1 -- 172.21.15.2:0/3020007913 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680031870 con 0x7f5690099970 2023-11-25T04:09:22.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.391+0000 7f568e7fc640 1 -- 172.21.15.2:0/3020007913 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56800319d0 con 0x7f5690099970 2023-11-25T04:09:22.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.391+0000 7f568e7fc640 1 -- 172.21.15.2:0/3020007913 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680031d60 con 0x7f5690099970 2023-11-25T04:09:22.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.392+0000 7f5696143640 1 -- 172.21.15.2:0/3020007913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690099970 msgr2=0x7f5690099d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.392+0000 7f5696143640 1 --2- 172.21.15.2:0/3020007913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690099970 0x7f5690099d50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5690068100 tx=0x7f568002b910 comp rx=0 tx=0).stop 2023-11-25T04:09:22.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.392+0000 7f5696143640 1 -- 172.21.15.2:0/3020007913 shutdown_connections 2023-11-25T04:09:22.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.392+0000 7f5696143640 1 --2- 172.21.15.2:0/3020007913 >> v2:172.21.15.66:3300/0 conn(0x7f56900cf890 0x7f56900b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.392+0000 7f5696143640 1 --2- 172.21.15.2:0/3020007913 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f569009a530 0x7f56900cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.392+0000 7f5696143640 1 --2- 172.21.15.2:0/3020007913 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5690099970 0x7f5690099d50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.392+0000 7f5696143640 1 -- 172.21.15.2:0/3020007913 >> 172.21.15.2:0/3020007913 conn(0x7f56900b2a70 msgr2=0x7f56900b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.392+0000 7f5696143640 1 -- 172.21.15.2:0/3020007913 shutdown_connections 2023-11-25T04:09:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.392+0000 7f5696143640 1 -- 172.21.15.2:0/3020007913 wait complete. 2023-11-25T04:09:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.393+0000 7f5696143640 1 Processor -- start 2023-11-25T04:09:22.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.393+0000 7f5696143640 1 -- start start 2023-11-25T04:09:22.401 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f5696143640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5690099970 0x7f56900c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f5696143640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f569009a530 0x7f56900ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f5696143640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56900cf890 0x7f56900b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f5696143640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900c6550 con 0x7f569009a530 2023-11-25T04:09:22.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f5696143640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56900c6830 con 0x7f5690099970 2023-11-25T04:09:22.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f5696143640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56900c6b10 con 0x7f56900cf890 2023-11-25T04:09:22.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f568effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f569009a530 0x7f56900ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f568effd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f569009a530 0x7f56900ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42220/0 (socket says 172.21.15.2:42220) 2023-11-25T04:09:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f568effd640 1 -- 172.21.15.2:0/1813931378 learned_addr learned my addr 172.21.15.2:0/1813931378 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f568ffff640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56900cf890 0x7f56900b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f568f7fe640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5690099970 0x7f56900c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.394+0000 7f568effd640 1 -- 172.21.15.2:0/1813931378 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56900cf890 msgr2=0x7f56900b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f568effd640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56900cf890 0x7f56900b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f568effd640 1 -- 172.21.15.2:0/1813931378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5690099970 msgr2=0x7f56900c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f568effd640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5690099970 0x7f56900c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f568effd640 1 -- 172.21.15.2:0/1813931378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56800094d0 con 0x7f569009a530 2023-11-25T04:09:22.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f568f7fe640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5690099970 0x7f56900c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:22.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f568effd640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f569009a530 0x7f56900ca9f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f568400c7c0 tx=0x7f568400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:22.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f5677fff640 1 -- 172.21.15.2:0/1813931378 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5684007a30 con 0x7f569009a530 2023-11-25T04:09:22.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f5677fff640 1 -- 172.21.15.2:0/1813931378 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5684007b90 con 0x7f569009a530 2023-11-25T04:09:22.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56900c6df0 con 0x7f569009a530 2023-11-25T04:09:22.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f5677fff640 1 -- 172.21.15.2:0/1813931378 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568400ce70 con 0x7f569009a530 2023-11-25T04:09:22.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.395+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56900caf30 con 0x7f569009a530 2023-11-25T04:09:22.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.396+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56900c7310 con 0x7f569009a530 2023-11-25T04:09:22.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.396+0000 7f5677fff640 1 -- 172.21.15.2:0/1813931378 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56840113f0 con 0x7f569009a530 2023-11-25T04:09:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.397+0000 7f5677fff640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f567c06ae70 0x7f567c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.397+0000 7f5677fff640 1 -- 172.21.15.2:0/1813931378 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f5684089760 con 0x7f569009a530 2023-11-25T04:09:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.397+0000 7f568f7fe640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f567c06ae70 0x7f567c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.397+0000 7f568f7fe640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f567c06ae70 0x7f567c06d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5680036000 tx=0x7f568003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:22.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.401+0000 7f5677fff640 1 -- 172.21.15.2:0/1813931378 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f56900c7310 con 0x7f569009a530 2023-11-25T04:09:22.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.578+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56900c7310 con 0x7f569009a530 2023-11-25T04:09:22.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.579+0000 7f5677fff640 1 -- 172.21.15.2:0/1813931378 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16691 (secure 0 0 0) 0x7f56900c7310 con 0x7f569009a530 2023-11-25T04:09:22.582 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:22.582 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:09:17.297158+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.581+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f567c06ae70 msgr2=0x7f567c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.581+0000 7f5696143640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f567c06ae70 0x7f567c06d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5680036000 tx=0x7f568003c040 comp rx=0 tx=0).stop 2023-11-25T04:09:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.581+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f569009a530 msgr2=0x7f56900ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.581+0000 7f5696143640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f569009a530 0x7f56900ca9f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f568400c7c0 tx=0x7f568400cc80 comp rx=0 tx=0).stop 2023-11-25T04:09:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.582+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 shutdown_connections 2023-11-25T04:09:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.582+0000 7f5696143640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56900cf890 0x7f56900b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.582+0000 7f5696143640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f569009a530 0x7f56900ca9f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.582+0000 7f5696143640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f567c06ae70 0x7f567c06d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.582+0000 7f5696143640 1 --2- 172.21.15.2:0/1813931378 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5690099970 0x7f56900c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.582+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 >> 172.21.15.2:0/1813931378 conn(0x7f56900b2a70 msgr2=0x7f56900adbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.582+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 shutdown_connections 2023-11-25T04:09:22.585 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.582+0000 7f5696143640 1 -- 172.21.15.2:0/1813931378 wait complete. 2023-11-25T04:09:22.595 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-25T04:09:22.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:09:22.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.700+0000 7f48cffa9640 1 Processor -- start 2023-11-25T04:09:22.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.700+0000 7f48cffa9640 1 -- start start 2023-11-25T04:09:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48cffa9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c80b2690 0x7f48c815d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48cffa9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f48c806a8b0 0x7f48c806ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48cffa9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c806e9e0 con 0x7f48c806cc50 2023-11-25T04:09:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48cffa9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c806d0d0 con 0x7f48c806a8b0 2023-11-25T04:09:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48cffa9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c806d2e0 con 0x7f48c80b2690 2023-11-25T04:09:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48cd544640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f48c806cc50 0x7f48c80b2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50554/0 (socket says 172.21.15.2:50554) 2023-11-25T04:09:22.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48cd544640 1 -- 172.21.15.2:0/1766206687 learned_addr learned my addr 172.21.15.2:0/1766206687 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48cdd45640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c80b2690 0x7f48c815d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ce546640 1 --2- 172.21.15.2:0/1766206687 >> v2:172.21.15.66:3300/0 conn(0x7f48c806a8b0 0x7f48c806ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2732398319 0 0) 0x7f48c806e9e0 con 0x7f48c806cc50 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48b4003520 con 0x7f48c806cc50 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508760450 0 0) 0x7f48b4003520 con 0x7f48c806cc50 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c80b2690 msgr2=0x7f48c815d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c80b2690 0x7f48c815d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 >> v2:172.21.15.66:3300/0 conn(0x7f48c806a8b0 msgr2=0x7f48c806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 --2- 172.21.15.2:0/1766206687 >> v2:172.21.15.66:3300/0 conn(0x7f48c806a8b0 0x7f48c806ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c806de60 con 0x7f48c806cc50 2023-11-25T04:09:22.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f48b8001670 con 0x7f48c806cc50 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 >> v1:172.21.15.2:6789/0 conn(0x7f48c806cc50 legacy=0x7f48c80b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.701+0000 7f48ccd43640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48b4003970 0x7f48b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ccd43640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c80b2690 0x7f48b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ccd43640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c806d0d0 con 0x7f48b4004d00 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c806d2e0 con 0x7f48b4003970 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b400b980 con 0x7f48c80b2690 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ce546640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48cdd45640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48b4003970 0x7f48b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48cd544640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c80b2690 0x7f48b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ce546640 1 -- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c80b2690 msgr2=0x7f48b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:22.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ce546640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c80b2690 0x7f48b40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ce546640 1 -- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48b4003970 msgr2=0x7f48b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:22.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ce546640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48b4003970 0x7f48b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.702+0000 7f48ce546640 1 -- 172.21.15.2:0/1766206687 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4003520 con 0x7f48b4004d00 2023-11-25T04:09:22.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48ce546640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48b4005180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009fc0 tx=0x7f48b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc9e6256324862e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:22.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c002cc60 con 0x7f48b4004d00 2023-11-25T04:09:22.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c000f040 con 0x7f48b4004d00 2023-11-25T04:09:22.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48ccd43640 1 -- 172.21.15.2:0/1766206687 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c0034440 con 0x7f48b4004d00 2023-11-25T04:09:22.711 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48cffa9640 1 -- 172.21.15.2:0/1766206687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 msgr2=0x7f48b4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48cffa9640 1 --2- 172.21.15.2:0/1766206687 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48b4005180 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009fc0 tx=0x7f48b40057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48ce546640 1 -- 172.21.15.2:0/1766206687 reap_dead start 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48cffa9640 1 -- 172.21.15.2:0/1766206687 shutdown_connections 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48cffa9640 1 -- 172.21.15.2:0/1766206687 >> 172.21.15.2:0/1766206687 conn(0x7f48c80cf6a0 msgr2=0x7f48c80cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48cffa9640 1 -- 172.21.15.2:0/1766206687 shutdown_connections 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.703+0000 7f48cffa9640 1 -- 172.21.15.2:0/1766206687 wait complete. 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cffa9640 1 Processor -- start 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cffa9640 1 -- start start 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cffa9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48c8155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cffa9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c81405b0 0x7f48c81586f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cffa9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48c8158c30 0x7f48c80af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cffa9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8140dd0 con 0x7f48b4004d00 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cffa9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c81410b0 con 0x7f48c8158c30 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cffa9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c8141390 con 0x7f48c81405b0 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cdd45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48c8155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cdd45640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48c8155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42234/0 (socket says 172.21.15.2:42234) 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.705+0000 7f48cdd45640 1 -- 172.21.15.2:0/3230717246 learned_addr learned my addr 172.21.15.2:0/3230717246 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48cd544640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c81405b0 0x7f48c81586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48ce546640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48c8158c30 0x7f48c80af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48cdd45640 1 -- 172.21.15.2:0/3230717246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c81405b0 msgr2=0x7f48c81586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48cdd45640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c81405b0 0x7f48c81586f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48cdd45640 1 -- 172.21.15.2:0/3230717246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48c8158c30 msgr2=0x7f48c80af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48cdd45640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48c8158c30 0x7f48c80af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48cdd45640 1 -- 172.21.15.2:0/3230717246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c8141670 con 0x7f48b4004d00 2023-11-25T04:09:22.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48ce546640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48c8158c30 0x7f48c80af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48cdd45640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48c8155a30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f48c40118e0 tx=0x7f48c4011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48be7fc640 1 -- 172.21.15.2:0/3230717246 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400faf0 con 0x7f48b4004d00 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48be7fc640 1 -- 172.21.15.2:0/3230717246 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400fc50 con 0x7f48b4004d00 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48be7fc640 1 -- 172.21.15.2:0/3230717246 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4014440 con 0x7f48b4004d00 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c8141950 con 0x7f48b4004d00 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.706+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c8146fc0 con 0x7f48b4004d00 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.707+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c8067420 con 0x7f48b4004d00 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.708+0000 7f48be7fc640 1 -- 172.21.15.2:0/3230717246 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f48c40145a0 con 0x7f48b4004d00 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.708+0000 7f48be7fc640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f48ac06ae70 0x7f48ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.708+0000 7f48cd544640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f48ac06ae70 0x7f48ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:22.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.708+0000 7f48be7fc640 1 -- 172.21.15.2:0/3230717246 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f48c4089ea0 con 0x7f48b4004d00 2023-11-25T04:09:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.708+0000 7f48cd544640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f48ac06ae70 0x7f48ac06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48c8151a30 tx=0x7f48b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:22.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.712+0000 7f48be7fc640 1 -- 172.21.15.2:0/3230717246 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f48c4054f50 con 0x7f48b4004d00 2023-11-25T04:09:22.926 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.924+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48c8073580 con 0x7f48b4004d00 2023-11-25T04:09:22.927 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.924+0000 7f48be7fc640 1 -- 172.21.15.2:0/3230717246 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f48c4058570 con 0x7f48b4004d00 2023-11-25T04:09:22.927 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:22.927 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1227253459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1227253459},{"type":"v1","addr":"172.21.15.66:6835","nonce":1227253459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3032459629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3032459629},{"type":"v1","addr":"172.21.15.2:6835","nonce":3032459629}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:08:35.512348+0000","modified":"2023-11-25T04:08:38.534749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/1650670057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1650670057},{"type":"v1","addr":"172.21.15.66:6833","nonce":1650670057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-25T04:09:22.927 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-25T04:09:22.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f48ac06ae70 msgr2=0x7f48ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f48ac06ae70 0x7f48ac06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f48c8151a30 tx=0x7f48b8009040 comp rx=0 tx=0).stop 2023-11-25T04:09:22.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 msgr2=0x7f48c8155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:22.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48c8155a30 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f48c40118e0 tx=0x7f48c4011da0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 shutdown_connections 2023-11-25T04:09:22.929 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f48ac06ae70 0x7f48ac06d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f48c8158c30 0x7f48c80af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48c81405b0 0x7f48c81586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 --2- 172.21.15.2:0/3230717246 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48b4004d00 0x7f48c8155a30 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:22.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.926+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 >> 172.21.15.2:0/3230717246 conn(0x7f48c80cf6a0 msgr2=0x7f48c8161800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:22.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.927+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 shutdown_connections 2023-11-25T04:09:22.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:22.927+0000 7f48cffa9640 1 -- 172.21.15.2:0/3230717246 wait complete. 2023-11-25T04:09:22.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:09:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.044+0000 7f4879948640 1 Processor -- start 2023-11-25T04:09:23.046 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.044+0000 7f4879948640 1 -- start start 2023-11-25T04:09:23.047 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f4879948640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f487415d3e0 0x7f48740ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f4879948640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48740b5f90 con 0x7f48740ced30 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f4879948640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48740b61e0 con 0x7f48740d1e30 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f4879948640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48740cf170 con 0x7f487415d3e0 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f4872ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f487415d3e0 0x7f48740ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f48727fc640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f48740ced30 0x7f48740d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50558/0 (socket says 172.21.15.2:50558) 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f48727fc640 1 -- 172.21.15.2:0/500573546 learned_addr learned my addr 172.21.15.2:0/500573546 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f4872ffd640 1 -- 172.21.15.2:0/500573546 >> v1:172.21.15.66:6789/0 conn(0x7f48740d1e30 legacy=0x7f48740b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f4872ffd640 1 -- 172.21.15.2:0/500573546 >> v1:172.21.15.2:6789/0 conn(0x7f48740ced30 legacy=0x7f48740d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f4872ffd640 1 -- 172.21.15.2:0/500573546 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48740b64c0 con 0x7f487415d3e0 2023-11-25T04:09:23.048 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.045+0000 7f4871ffb640 1 -- 172.21.15.2:0/500573546 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2292597017 0 0) 0x7f48740b5f90 con 0x7f48740ced30 2023-11-25T04:09:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.046+0000 7f4872ffd640 1 --2- 172.21.15.2:0/500573546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487415d3e0 0x7f48740ce7f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f486c0097a0 tx=0x7f486c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4fa475ae310f9a server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.046+0000 7f4871ffb640 1 -- 172.21.15.2:0/500573546 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c030610 con 0x7f487415d3e0 2023-11-25T04:09:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.046+0000 7f4871ffb640 1 -- 172.21.15.2:0/500573546 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c030770 con 0x7f487415d3e0 2023-11-25T04:09:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.046+0000 7f4871ffb640 1 -- 172.21.15.2:0/500573546 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c030b00 con 0x7f487415d3e0 2023-11-25T04:09:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.047+0000 7f4879948640 1 -- 172.21.15.2:0/500573546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487415d3e0 msgr2=0x7f48740ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.047+0000 7f4879948640 1 --2- 172.21.15.2:0/500573546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487415d3e0 0x7f48740ce7f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f486c0097a0 tx=0x7f486c02b960 comp rx=0 tx=0).stop 2023-11-25T04:09:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.047+0000 7f4879948640 1 -- 172.21.15.2:0/500573546 shutdown_connections 2023-11-25T04:09:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.047+0000 7f4879948640 1 --2- 172.21.15.2:0/500573546 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f487415d3e0 0x7f48740ce7f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.047+0000 7f4879948640 1 -- 172.21.15.2:0/500573546 >> 172.21.15.2:0/500573546 conn(0x7f487409c480 msgr2=0x7f48740d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:23.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.047+0000 7f4879948640 1 -- 172.21.15.2:0/500573546 shutdown_connections 2023-11-25T04:09:23.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.047+0000 7f4879948640 1 -- 172.21.15.2:0/500573546 wait complete. 2023-11-25T04:09:23.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.048+0000 7f4879948640 1 Processor -- start 2023-11-25T04:09:23.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.048+0000 7f4879948640 1 -- start start 2023-11-25T04:09:23.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4879948640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48740ced30 0x7f48741f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4879948640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48740d1e30 0x7f48740cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.054 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4879948640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f487415d3e0 0x7f487414f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4879948640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48741f61c0 con 0x7f48740ced30 2023-11-25T04:09:23.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4879948640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48741f5120 con 0x7f487415d3e0 2023-11-25T04:09:23.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4879948640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48741f5400 con 0x7f48740d1e30 2023-11-25T04:09:23.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4872ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48740ced30 0x7f48741f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4872ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48740ced30 0x7f48741f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42260/0 (socket says 172.21.15.2:42260) 2023-11-25T04:09:23.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4872ffd640 1 -- 172.21.15.2:0/2568351247 learned_addr learned my addr 172.21.15.2:0/2568351247 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:23.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f48727fc640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48740d1e30 0x7f48740cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f48737fe640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f487415d3e0 0x7f487414f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4872ffd640 1 -- 172.21.15.2:0/2568351247 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48740d1e30 msgr2=0x7f48740cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4872ffd640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48740d1e30 0x7f48740cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4872ffd640 1 -- 172.21.15.2:0/2568351247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f487415d3e0 msgr2=0x7f487414f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4872ffd640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f487415d3e0 0x7f487414f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f4872ffd640 1 -- 172.21.15.2:0/2568351247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c009400 con 0x7f48740ced30 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.049+0000 7f48737fe640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f487415d3e0 0x7f487414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.050+0000 7f4872ffd640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48740ced30 0x7f48741f4a90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f486c0098c0 tx=0x7f486c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.050+0000 7f486bfff640 1 -- 172.21.15.2:0/2568351247 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c03e070 con 0x7f48740ced30 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.050+0000 7f486bfff640 1 -- 172.21.15.2:0/2568351247 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486c039800 con 0x7f48740ced30 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.050+0000 7f486bfff640 1 -- 172.21.15.2:0/2568351247 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486c039bb0 con 0x7f48740ced30 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.050+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48741f56e0 con 0x7f48740ced30 2023-11-25T04:09:23.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.050+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48741f5ca0 con 0x7f48740ced30 2023-11-25T04:09:23.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.051+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4874067420 con 0x7f48740ced30 2023-11-25T04:09:23.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.051+0000 7f486bfff640 1 -- 172.21.15.2:0/2568351247 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f486c042070 con 0x7f48740ced30 2023-11-25T04:09:23.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.052+0000 7f486bfff640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f485406ae40 0x7f485406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.052+0000 7f486bfff640 1 -- 172.21.15.2:0/2568351247 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f486c0ab2c0 con 0x7f48740ced30 2023-11-25T04:09:23.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.052+0000 7f48727fc640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f485406ae40 0x7f485406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.052+0000 7f48727fc640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f485406ae40 0x7f485406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f48740a0560 tx=0x7f485c007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:23.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.056+0000 7f486bfff640 1 -- 172.21.15.2:0/2568351247 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f486c076270 con 0x7f48740ced30 2023-11-25T04:09:23.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.271+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48740d1500 con 0x7f48740ced30 2023-11-25T04:09:23.274 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.272+0000 7f486bfff640 1 -- 172.21.15.2:0/2568351247 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4901 (secure 0 0 0) 0x7f486c079890 con 0x7f48740ced30 2023-11-25T04:09:23.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:23.274 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/1227253459","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6834","nonce":1227253459},{"type":"v1","addr":"172.21.15.66:6835","nonce":1227253459}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6835/3032459629","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":3032459629},{"type":"v1","addr":"172.21.15.2:6835","nonce":3032459629}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/3957936396","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6836","nonce":3957936396},{"type":"v1","addr":"172.21.15.2:6837","nonce":3957936396}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:08:35.512348+0000","modified":"2023-11-25T04:08:38.534749+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/1650670057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1650670057},{"type":"v1","addr":"172.21.15.66:6833","nonce":1650670057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-25T04:09:23.275 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 8 2023-11-25T04:09:23.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f485406ae40 msgr2=0x7f485406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f485406ae40 0x7f485406d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f48740a0560 tx=0x7f485c007d50 comp rx=0 tx=0).stop 2023-11-25T04:09:23.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48740ced30 msgr2=0x7f48741f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48740ced30 0x7f48741f4a90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f486c0098c0 tx=0x7f486c0046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 shutdown_connections 2023-11-25T04:09:23.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f485406ae40 0x7f485406d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f487415d3e0 0x7f487414f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f48740d1e30 0x7f48740cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 --2- 172.21.15.2:0/2568351247 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f48740ced30 0x7f48741f4a90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 >> 172.21.15.2:0/2568351247 conn(0x7f487409c480 msgr2=0x7f487415fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:23.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 shutdown_connections 2023-11-25T04:09:23.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.274+0000 7f4879948640 1 -- 172.21.15.2:0/2568351247 wait complete. 2023-11-25T04:09:23.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.391+0000 7f077f2bb640 1 Processor -- start 2023-11-25T04:09:23.393 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.391+0000 7f077f2bb640 1 -- start start 2023-11-25T04:09:23.395 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077f2bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f077813e2d0 0x7f07780b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077f2bb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07780b4640 0x7f077815b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.396 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077f2bb640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07780b4aa0 con 0x7f077815bd90 2023-11-25T04:09:23.397 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077f2bb640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077815fc60 con 0x7f077813e2d0 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077f2bb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077806de80 con 0x7f07780b4640 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077d057640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f077813e2d0 0x7f07780b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077d858640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f077815bd90 0x7f0778140860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50574/0 (socket says 172.21.15.2:50574) 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077d858640 1 -- 172.21.15.2:0/3685565943 learned_addr learned my addr 172.21.15.2:0/3685565943 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077c856640 1 --2- 172.21.15.2:0/3685565943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07780b4640 0x7f077815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077d057640 1 -- 172.21.15.2:0/3685565943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07780b4640 msgr2=0x7f077815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077d057640 1 --2- 172.21.15.2:0/3685565943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07780b4640 0x7f077815b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077d057640 1 -- 172.21.15.2:0/3685565943 >> v1:172.21.15.2:6789/0 conn(0x7f077815bd90 legacy=0x7f0778140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.392+0000 7f077d057640 1 -- 172.21.15.2:0/3685565943 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077806d5c0 con 0x7f077813e2d0 2023-11-25T04:09:23.398 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.393+0000 7f077d057640 1 --2- 172.21.15.2:0/3685565943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f077813e2d0 0x7f07780b4100 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0770009d90 tx=0x7f077002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e48f4a7f66ef4e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:23.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.393+0000 7f0777fff640 1 -- 172.21.15.2:0/3685565943 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077002cc50 con 0x7f077813e2d0 2023-11-25T04:09:23.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.393+0000 7f0777fff640 1 -- 172.21.15.2:0/3685565943 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077002cdb0 con 0x7f077813e2d0 2023-11-25T04:09:23.399 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.393+0000 7f0777fff640 1 -- 172.21.15.2:0/3685565943 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770034660 con 0x7f077813e2d0 2023-11-25T04:09:23.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.394+0000 7f077f2bb640 1 -- 172.21.15.2:0/3685565943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f077813e2d0 msgr2=0x7f07780b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.394+0000 7f077f2bb640 1 --2- 172.21.15.2:0/3685565943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f077813e2d0 0x7f07780b4100 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0770009d90 tx=0x7f077002bea0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.394+0000 7f077f2bb640 1 -- 172.21.15.2:0/3685565943 shutdown_connections 2023-11-25T04:09:23.402 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.394+0000 7f077f2bb640 1 --2- 172.21.15.2:0/3685565943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07780b4640 0x7f077815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.394+0000 7f077f2bb640 1 --2- 172.21.15.2:0/3685565943 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f077813e2d0 0x7f07780b4100 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.394+0000 7f077f2bb640 1 -- 172.21.15.2:0/3685565943 >> 172.21.15.2:0/3685565943 conn(0x7f07780b0af0 msgr2=0x7f07780b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.394+0000 7f077f2bb640 1 -- 172.21.15.2:0/3685565943 shutdown_connections 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.394+0000 7f077f2bb640 1 -- 172.21.15.2:0/3685565943 wait complete. 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.395+0000 7f077f2bb640 1 Processor -- start 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.395+0000 7f077f2bb640 1 -- start start 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077f2bb640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07780b4640 0x7f077813c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077f2bb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077813e2d0 0x7f077813c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077f2bb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f077815bd90 0x7f07780aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077f2bb640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f077813d800 con 0x7f07780b4640 2023-11-25T04:09:23.403 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077f2bb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780a9b10 con 0x7f077813e2d0 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077f2bb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780a8de0 con 0x7f077815bd90 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077d057640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07780b4640 0x7f077813c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077d057640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07780b4640 0x7f077813c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42282/0 (socket says 172.21.15.2:42282) 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077d057640 1 -- 172.21.15.2:0/3312105289 learned_addr learned my addr 172.21.15.2:0/3312105289 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077d858640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f077815bd90 0x7f07780aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077c856640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077813e2d0 0x7f077813c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077d057640 1 -- 172.21.15.2:0/3312105289 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f077815bd90 msgr2=0x7f07780aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077d057640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f077815bd90 0x7f07780aa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077d057640 1 -- 172.21.15.2:0/3312105289 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077813e2d0 msgr2=0x7f077813c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077d057640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077813e2d0 0x7f077813c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077d057640 1 -- 172.21.15.2:0/3312105289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770009a70 con 0x7f07780b4640 2023-11-25T04:09:23.404 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.396+0000 7f077c856640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077813e2d0 0x7f077813c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.397+0000 7f077d057640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07780b4640 0x7f077813c360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0770037040 tx=0x7f0770004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.397+0000 7f0775ffb640 1 -- 172.21.15.2:0/3312105289 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770040650 con 0x7f07780b4640 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.397+0000 7f0775ffb640 1 -- 172.21.15.2:0/3312105289 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07700407b0 con 0x7f07780b4640 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.397+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07780a9680 con 0x7f07780b4640 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.397+0000 7f0775ffb640 1 -- 172.21.15.2:0/3312105289 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0770040b60 con 0x7f07780b4640 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.397+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07780a9030 con 0x7f07780b4640 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.398+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077806e310 con 0x7f07780b4640 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.398+0000 7f0775ffb640 1 -- 172.21.15.2:0/3312105289 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0770040cc0 con 0x7f07780b4640 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.399+0000 7f0775ffb640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f076406ae40 0x7f076406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.399+0000 7f0775ffb640 1 -- 172.21.15.2:0/3312105289 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f07700ac3c0 con 0x7f07780b4640 2023-11-25T04:09:23.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.399+0000 7f077c856640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f076406ae40 0x7f076406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.399+0000 7f077c856640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f076406ae40 0x7f076406d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07781e74e0 tx=0x7f076c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:23.406 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.403+0000 7f0775ffb640 1 -- 172.21.15.2:0/3312105289 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07700773e0 con 0x7f07780b4640 2023-11-25T04:09:23.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.580+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0778067420 con 0x7f07780b4640 2023-11-25T04:09:23.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.582+0000 7f0775ffb640 1 -- 172.21.15.2:0/3312105289 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16691 (secure 0 0 0) 0x7f077007aa00 con 0x7f07780b4640 2023-11-25T04:09:23.584 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:23.584 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":22,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:09:17.297158+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:08:33.589744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-25T04:08:34.501601+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.c","mappings":[{"from":3,"to":1}]},{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.583+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f076406ae40 msgr2=0x7f076406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.583+0000 7f077f2bb640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f076406ae40 0x7f076406d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f07781e74e0 tx=0x7f076c008040 comp rx=0 tx=0).stop 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.583+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07780b4640 msgr2=0x7f077813c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.583+0000 7f077f2bb640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07780b4640 0x7f077813c360 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0770037040 tx=0x7f0770004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.583+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 shutdown_connections 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.583+0000 7f077f2bb640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f077815bd90 0x7f07780aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.583+0000 7f077f2bb640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f076406ae40 0x7f076406d300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.583+0000 7f077f2bb640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f077813e2d0 0x7f077813c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.583+0000 7f077f2bb640 1 --2- 172.21.15.2:0/3312105289 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f07780b4640 0x7f077813c360 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.584+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 >> 172.21.15.2:0/3312105289 conn(0x7f07780b0af0 msgr2=0x7f0778071820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:23.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.584+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 shutdown_connections 2023-11-25T04:09:23.587 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.584+0000 7f077f2bb640 1 -- 172.21.15.2:0/3312105289 wait complete. 2023-11-25T04:09:23.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-25T04:09:23.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.702+0000 7f8aabf83640 1 Processor -- start 2023-11-25T04:09:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.703+0000 7f8aabf83640 1 -- start start 2023-11-25T04:09:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.703+0000 7f8aabf83640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa4144310 0x7f8aa4144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.705 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.703+0000 7f8aabf83640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8aa40ce7e0 0x7f8aa40b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aabf83640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aa41446f0 con 0x7f8aa406c890 2023-11-25T04:09:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aabf83640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aa40b3980 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aabf83640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa40cec60 con 0x7f8aa4144310 2023-11-25T04:09:23.706 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aa9d1f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa4144310 0x7f8aa4144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aa951e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8aa40ce7e0 0x7f8aa40b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aa951e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8aa40ce7e0 0x7f8aa40b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:60208/0 (socket says 172.21.15.2:60208) 2023-11-25T04:09:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aa9d1f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa4144310 0x7f8aa4144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:41214/0 (socket says 172.21.15.2:41214) 2023-11-25T04:09:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aa951e640 1 -- 172.21.15.2:0/1344189901 learned_addr learned my addr 172.21.15.2:0/1344189901 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aa9d1f640 1 -- 172.21.15.2:0/1344189901 >> v2:172.21.15.66:3300/0 conn(0x7f8aa40ce7e0 msgr2=0x7f8aa40b3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aa9d1f640 1 --2- 172.21.15.2:0/1344189901 >> v2:172.21.15.66:3300/0 conn(0x7f8aa40ce7e0 0x7f8aa40b3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aa9d1f640 1 -- 172.21.15.2:0/1344189901 >> v1:172.21.15.66:6789/0 conn(0x7f8aa406c890 legacy=0x7f8aa415ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.704+0000 7f8aa9d1f640 1 -- 172.21.15.2:0/1344189901 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa415ba80 con 0x7f8aa4144310 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.705+0000 7f8aa9d1f640 1 --2- 172.21.15.2:0/1344189901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa4144310 0x7f8aa4144950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00097a0 tx=0x7f8aa002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4038ecc931a09593 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.705+0000 7f8aa8d1d640 1 -- 172.21.15.2:0/1344189901 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0031830 con 0x7f8aa4144310 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.705+0000 7f8aa8d1d640 1 -- 172.21.15.2:0/1344189901 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa0031990 con 0x7f8aa4144310 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.705+0000 7f8aa8d1d640 1 -- 172.21.15.2:0/1344189901 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0031d20 con 0x7f8aa4144310 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.706+0000 7f8aabf83640 1 -- 172.21.15.2:0/1344189901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa4144310 msgr2=0x7f8aa4144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.706+0000 7f8aabf83640 1 --2- 172.21.15.2:0/1344189901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa4144310 0x7f8aa4144950 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00097a0 tx=0x7f8aa002b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.706+0000 7f8aabf83640 1 -- 172.21.15.2:0/1344189901 shutdown_connections 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.706+0000 7f8aabf83640 1 --2- 172.21.15.2:0/1344189901 >> v2:172.21.15.66:3300/0 conn(0x7f8aa40ce7e0 0x7f8aa40b3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.706+0000 7f8aabf83640 1 --2- 172.21.15.2:0/1344189901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa4144310 0x7f8aa4144950 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.712 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.706+0000 7f8aabf83640 1 -- 172.21.15.2:0/1344189901 >> 172.21.15.2:0/1344189901 conn(0x7f8aa406a8f0 msgr2=0x7f8aa406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:23.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.706+0000 7f8aabf83640 1 -- 172.21.15.2:0/1344189901 shutdown_connections 2023-11-25T04:09:23.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.706+0000 7f8aabf83640 1 -- 172.21.15.2:0/1344189901 wait complete. 2023-11-25T04:09:23.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.707+0000 7f8aabf83640 1 Processor -- start 2023-11-25T04:09:23.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.707+0000 7f8aabf83640 1 -- start start 2023-11-25T04:09:23.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aabf83640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa406c890 0x7f8aa413a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aabf83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa40ce7e0 0x7f8aa41576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.713 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aabf83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8aa4144310 0x7f8aa4157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aabf83640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa4155e00 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aabf83640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41560e0 con 0x7f8aa4144310 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aabf83640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa41563c0 con 0x7f8aa406c890 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aa951e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa40ce7e0 0x7f8aa41576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aa951e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa40ce7e0 0x7f8aa41576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42298/0 (socket says 172.21.15.2:42298) 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aa951e640 1 -- 172.21.15.2:0/3656698400 learned_addr learned my addr 172.21.15.2:0/3656698400 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aa9d1f640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa406c890 0x7f8aa413a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aaa520640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8aa4144310 0x7f8aa4157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aa951e640 1 -- 172.21.15.2:0/3656698400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa406c890 msgr2=0x7f8aa413a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aa951e640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa406c890 0x7f8aa413a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aa951e640 1 -- 172.21.15.2:0/3656698400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8aa4144310 msgr2=0x7f8aa4157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.714 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aa951e640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8aa4144310 0x7f8aa4157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.708+0000 7f8aa951e640 1 -- 172.21.15.2:0/3656698400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0009400 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.709+0000 7f8aa951e640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa40ce7e0 0x7f8aa41576a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009fd0 tx=0x7f8a9400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:23.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.709+0000 7f8a9a7fc640 1 -- 172.21.15.2:0/3656698400 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400c940 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.709+0000 7f8a9a7fc640 1 -- 172.21.15.2:0/3656698400 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a9400caa0 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.709+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa41566a0 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.709+0000 7f8a9a7fc640 1 -- 172.21.15.2:0/3656698400 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9400ce30 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.709+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa4155040 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.715 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.710+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa41f0f70 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.710+0000 7f8a9a7fc640 1 -- 172.21.15.2:0/3656698400 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a94013470 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.711+0000 7f8a9a7fc640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8a8806ae40 0x7f8a8806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:23.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.711+0000 7f8a9a7fc640 1 -- 172.21.15.2:0/3656698400 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8a94089880 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.711+0000 7f8aa9d1f640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8a8806ae40 0x7f8a8806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:23.716 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.711+0000 7f8aa9d1f640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8a8806ae40 0x7f8a8806d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0036000 tx=0x7f8aa003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:23.718 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.715+0000 7f8a9a7fc640 1 -- 172.21.15.2:0/3656698400 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a94054820 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.928 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.926+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8aa4072ae0 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.929 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-25T04:09:23.927+0000 7f167b0c3640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-25T04:09:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.929+0000 7f8a9a7fc640 1 -- 172.21.15.2:0/3656698400 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8a94057e40 con 0x7f8aa40ce7e0 2023-11-25T04:09:23.931 INFO:teuthology.orchestra.run.smithi002.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-25T04:09:23.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8a8806ae40 msgr2=0x7f8a8806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8a8806ae40 0x7f8a8806d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0036000 tx=0x7f8aa003c040 comp rx=0 tx=0).stop 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa40ce7e0 msgr2=0x7f8aa41576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa40ce7e0 0x7f8aa41576a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8a94009fd0 tx=0x7f8a9400ed40 comp rx=0 tx=0).stop 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 shutdown_connections 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8a8806ae40 0x7f8a8806d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8aa4144310 0x7f8aa4157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8aa40ce7e0 0x7f8aa41576a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 --2- 172.21.15.2:0/3656698400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8aa406c890 0x7f8aa413a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 >> 172.21.15.2:0/3656698400 conn(0x7f8aa406a8f0 msgr2=0x7f8aa40b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 shutdown_connections 2023-11-25T04:09:23.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:23.931+0000 7f8aabf83640 1 -- 172.21.15.2:0/3656698400 wait complete. 2023-11-25T04:09:23.936 INFO:tasks.ceph.mds.b.smithi066.stderr: -2716> 2023-11-25T04:08:40.084+0000 7faff8b4f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-25T04:09:23.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-25T04:09:23.966 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2023-11-25T04:09:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.051+0000 7f1be4dd5640 1 Processor -- start 2023-11-25T04:09:24.053 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.051+0000 7f1be4dd5640 1 -- start start 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.051+0000 7f1be4dd5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1be015b0d0 0x7f1be00cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.051+0000 7f1be4dd5640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be015b530 con 0x7f1be0070630 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1be4dd5640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be00ce060 con 0x7f1be013f750 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1be4dd5640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be00cec70 con 0x7f1be015b0d0 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bded9d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f1be0070630 0x7f1be0070ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50586/0 (socket says 172.21.15.2:50586) 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bded9d640 1 -- 172.21.15.2:0/547269049 learned_addr learned my addr 172.21.15.2:0/547269049 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bd7fff640 1 --2- 172.21.15.2:0/547269049 >> v2:172.21.15.66:3300/0 conn(0x7f1be015b0d0 0x7f1be00cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766318217 0 0) 0x7f1be015b530 con 0x7f1be0070630 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bcc003520 con 0x7f1be0070630 2023-11-25T04:09:24.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3536150380 0 0) 0x7f1bcc003520 con 0x7f1be0070630 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 >> v2:172.21.15.66:3300/0 conn(0x7f1be015b0d0 msgr2=0x7f1be00cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 --2- 172.21.15.2:0/547269049 >> v2:172.21.15.66:3300/0 conn(0x7f1be015b0d0 0x7f1be00cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 >> v1:172.21.15.66:6789/0 conn(0x7f1be013f750 legacy=0x7f1be013fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be00ce340 con 0x7f1be0070630 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f1bd80019f0 con 0x7f1be0070630 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 >> v1:172.21.15.2:6789/0 conn(0x7f1be0070630 legacy=0x7f1be0070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc003970 0x7f1bcc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc004370 0x7f1bcc004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc005040 0x7f1bcc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00cec70 con 0x7f1bcc003970 2023-11-25T04:09:24.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc00bfa0 con 0x7f1bcc005040 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.052+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc00c160 con 0x7f1bcc004370 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.053+0000 7f1bde59c640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc003970 0x7f1bcc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.053+0000 7f1bded9d640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc005040 0x7f1bcc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.053+0000 7f1bd7fff640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc004370 0x7f1bcc004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.053+0000 7f1bde59c640 1 -- 172.21.15.2:0/547269049 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc004370 msgr2=0x7f1bcc004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.053+0000 7f1bde59c640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc004370 0x7f1bcc004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.053+0000 7f1bde59c640 1 -- 172.21.15.2:0/547269049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc005040 msgr2=0x7f1bcc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.053+0000 7f1bde59c640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bcc005040 0x7f1bcc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.053+0000 7f1bde59c640 1 -- 172.21.15.2:0/547269049 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc003520 con 0x7f1bcc003970 2023-11-25T04:09:24.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.053+0000 7f1bded9d640 1 -- 172.21.15.2:0/547269049 reap_dead start 2023-11-25T04:09:24.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1bde59c640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc003970 0x7f1bcc003d50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0001910 tx=0x7f1bcc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2592a21ae59a04 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:24.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0032620 con 0x7f1bcc003970 2023-11-25T04:09:24.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd0032780 con 0x7f1bcc003970 2023-11-25T04:09:24.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1bddd9b640 1 -- 172.21.15.2:0/547269049 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0032b50 con 0x7f1bcc003970 2023-11-25T04:09:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1be4dd5640 1 -- 172.21.15.2:0/547269049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc003970 msgr2=0x7f1bcc003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1be4dd5640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc003970 0x7f1bcc003d50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0001910 tx=0x7f1bcc0057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1be4dd5640 1 -- 172.21.15.2:0/547269049 shutdown_connections 2023-11-25T04:09:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1be4dd5640 1 --2- 172.21.15.2:0/547269049 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1bcc003970 0x7f1bcc003d50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1be4dd5640 1 -- 172.21.15.2:0/547269049 >> 172.21.15.2:0/547269049 conn(0x7f1be006a8f0 msgr2=0x7f1be006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1be4dd5640 1 -- 172.21.15.2:0/547269049 shutdown_connections 2023-11-25T04:09:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.054+0000 7f1be4dd5640 1 -- 172.21.15.2:0/547269049 wait complete. 2023-11-25T04:09:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1be4dd5640 1 Processor -- start 2023-11-25T04:09:24.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1be4dd5640 1 -- start start 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1be4dd5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc003970 0x7f1be00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1be4dd5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be015b4b0 0x7f1be014cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1be4dd5640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be013b370 0x7f1be013b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1be4dd5640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be013bd60 con 0x7f1be013b370 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1be4dd5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be015b990 con 0x7f1be015b4b0 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1be4dd5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be015bc70 con 0x7f1bcc003970 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1bded9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be013b370 0x7f1be013b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1bded9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be013b370 0x7f1be013b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42328/0 (socket says 172.21.15.2:42328) 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.056+0000 7f1bded9d640 1 -- 172.21.15.2:0/3357338353 learned_addr learned my addr 172.21.15.2:0/3357338353 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bd7fff640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be015b4b0 0x7f1be014cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:24.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bde59c640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc003970 0x7f1be00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:24.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bded9d640 1 -- 172.21.15.2:0/3357338353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc003970 msgr2=0x7f1be00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:24.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bded9d640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc003970 0x7f1be00aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bded9d640 1 -- 172.21.15.2:0/3357338353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be015b4b0 msgr2=0x7f1be014cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:24.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bded9d640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be015b4b0 0x7f1be014cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bded9d640 1 -- 172.21.15.2:0/3357338353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be015bf50 con 0x7f1be013b370 2023-11-25T04:09:24.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bded9d640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be013b370 0x7f1be013b820 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1be006e2c0 tx=0x7f1bd8007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:24.065 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bd6ffd640 1 -- 172.21.15.2:0/3357338353 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800ab30 con 0x7f1be013b370 2023-11-25T04:09:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bd6ffd640 1 -- 172.21.15.2:0/3357338353 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800acb0 con 0x7f1be013b370 2023-11-25T04:09:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be015c230 con 0x7f1be013b370 2023-11-25T04:09:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1bd6ffd640 1 -- 172.21.15.2:0/3357338353 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8013630 con 0x7f1be013b370 2023-11-25T04:09:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.057+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be00af0f0 con 0x7f1be013b370 2023-11-25T04:09:24.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.058+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be0072ae0 con 0x7f1be013b370 2023-11-25T04:09:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.059+0000 7f1bd6ffd640 1 -- 172.21.15.2:0/3357338353 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1bd8013790 con 0x7f1be013b370 2023-11-25T04:09:24.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.059+0000 7f1bd6ffd640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1bc006ae70 0x7f1bc006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.059+0000 7f1bd6ffd640 1 -- 172.21.15.2:0/3357338353 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f1bd8089cd0 con 0x7f1be013b370 2023-11-25T04:09:24.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.059+0000 7f1bde59c640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1bc006ae70 0x7f1bc006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:24.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.059+0000 7f1bde59c640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1bc006ae70 0x7f1bc006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0036000 tx=0x7f1bd0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:24.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.063+0000 7f1bd6ffd640 1 -- 172.21.15.2:0/3357338353 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1bd8054c90 con 0x7f1be013b370 2023-11-25T04:09:24.283 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.281+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1be004e920 con 0x7f1be013b370 2023-11-25T04:09:24.932 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.930+0000 7f1bd6ffd640 1 -- 172.21.15.2:0/3357338353 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1bd80582b0 con 0x7f1be013b370 2023-11-25T04:09:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1bc006ae70 msgr2=0x7f1bc006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:24.935 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1bc006ae70 0x7f1bc006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0036000 tx=0x7f1bd0009030 comp rx=0 tx=0).stop 2023-11-25T04:09:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be013b370 msgr2=0x7f1be013b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be013b370 0x7f1be013b820 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1be006e2c0 tx=0x7f1bd8007b00 comp rx=0 tx=0).stop 2023-11-25T04:09:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 shutdown_connections 2023-11-25T04:09:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f1be013b370 0x7f1be013b820 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f1bc006ae70 0x7f1bc006d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1be015b4b0 0x7f1be014cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 --2- 172.21.15.2:0/3357338353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bcc003970 0x7f1be00aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 >> 172.21.15.2:0/3357338353 conn(0x7f1be006a8f0 msgr2=0x7f1be00b2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:24.936 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 shutdown_connections 2023-11-25T04:09:24.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:24.933+0000 7f1be4dd5640 1 -- 172.21.15.2:0/3357338353 wait complete. 2023-11-25T04:09:24.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-25T04:09:25.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.064+0000 7fb35cf1d640 1 Processor -- start 2023-11-25T04:09:25.066 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.064+0000 7fb35cf1d640 1 -- start start 2023-11-25T04:09:25.067 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb35cf1d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35815d390 0x7fb3580cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:25.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb35cf1d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb35806c3b0 0x7fb3580cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:25.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb35cf1d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35809a520 con 0x7fb3580b35e0 2023-11-25T04:09:25.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb35cf1d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35806ba60 con 0x7fb35806c3b0 2023-11-25T04:09:25.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb35cf1d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35806b780 con 0x7fb35815d390 2023-11-25T04:09:25.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb356d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb35806c3b0 0x7fb3580cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:25.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb35659c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35815d390 0x7fb3580cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:25.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb35659c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35815d390 0x7fb3580cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:41250/0 (socket says 172.21.15.2:41250) 2023-11-25T04:09:25.068 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb34ffff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb3580b35e0 0x7fb35806bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:38410/0 (socket says 172.21.15.2:38410) 2023-11-25T04:09:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb34ffff640 1 -- 172.21.15.2:0/2936874936 learned_addr learned my addr 172.21.15.2:0/2936874936 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb356d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb35806c3b0 0x7fb3580cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.2:60252/0 (socket says 172.21.15.2:60252) 2023-11-25T04:09:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb356d9d640 1 -- 172.21.15.2:0/2936874936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35815d390 msgr2=0x7fb3580cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.065+0000 7fb356d9d640 1 --2- 172.21.15.2:0/2936874936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35815d390 0x7fb3580cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.066+0000 7fb356d9d640 1 -- 172.21.15.2:0/2936874936 >> v1:172.21.15.66:6789/0 conn(0x7fb3580b35e0 legacy=0x7fb35806bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:25.069 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.066+0000 7fb356d9d640 1 -- 172.21.15.2:0/2936874936 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3580cf3b0 con 0x7fb35806c3b0 2023-11-25T04:09:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.066+0000 7fb356d9d640 1 --2- 172.21.15.2:0/2936874936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb35806c3b0 0x7fb3580cf8d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb350009d90 tx=0x7fb35002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2face2c940429bc server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb355d9b640 1 -- 172.21.15.2:0/2936874936 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35002cc50 con 0x7fb35806c3b0 2023-11-25T04:09:25.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb355d9b640 1 -- 172.21.15.2:0/2936874936 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35002cdb0 con 0x7fb35806c3b0 2023-11-25T04:09:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb355d9b640 1 -- 172.21.15.2:0/2936874936 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350034660 con 0x7fb35806c3b0 2023-11-25T04:09:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb35cf1d640 1 -- 172.21.15.2:0/2936874936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb35806c3b0 msgr2=0x7fb3580cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb35cf1d640 1 --2- 172.21.15.2:0/2936874936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb35806c3b0 0x7fb3580cf8d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb350009d90 tx=0x7fb35002bea0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb35cf1d640 1 -- 172.21.15.2:0/2936874936 shutdown_connections 2023-11-25T04:09:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb35cf1d640 1 --2- 172.21.15.2:0/2936874936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb35806c3b0 0x7fb3580cf8d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb35cf1d640 1 --2- 172.21.15.2:0/2936874936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35815d390 0x7fb3580cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb35cf1d640 1 -- 172.21.15.2:0/2936874936 >> 172.21.15.2:0/2936874936 conn(0x7fb3580b2ac0 msgr2=0x7fb3580b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb35cf1d640 1 -- 172.21.15.2:0/2936874936 shutdown_connections 2023-11-25T04:09:25.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.067+0000 7fb35cf1d640 1 -- 172.21.15.2:0/2936874936 wait complete. 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.069+0000 7fb35cf1d640 1 Processor -- start 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.069+0000 7fb35cf1d640 1 -- start start 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.069+0000 7fb35cf1d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35806c3b0 0x7fb3580ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.069+0000 7fb35cf1d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3580b35e0 0x7fb3581f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.069+0000 7fb35cf1d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb35815d390 0x7fb3581f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.069+0000 7fb35cf1d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581f1330 con 0x7fb35815d390 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.069+0000 7fb35cf1d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581f39e0 con 0x7fb3580b35e0 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.069+0000 7fb35cf1d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3581f3c50 con 0x7fb35806c3b0 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.069+0000 7fb356d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb35815d390 0x7fb3581f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:25.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb356d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb35815d390 0x7fb3581f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42330/0 (socket says 172.21.15.2:42330) 2023-11-25T04:09:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb356d9d640 1 -- 172.21.15.2:0/3906315632 learned_addr learned my addr 172.21.15.2:0/3906315632 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb34ffff640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3580b35e0 0x7fb3581f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb35659c640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35806c3b0 0x7fb3580ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb356d9d640 1 -- 172.21.15.2:0/3906315632 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35806c3b0 msgr2=0x7fb3580ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb356d9d640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35806c3b0 0x7fb3580ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb356d9d640 1 -- 172.21.15.2:0/3906315632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3580b35e0 msgr2=0x7fb3581f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb356d9d640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3580b35e0 0x7fb3581f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb356d9d640 1 -- 172.21.15.2:0/3906315632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350009a70 con 0x7fb35815d390 2023-11-25T04:09:25.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb356d9d640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb35815d390 0x7fb3581f0df0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb350009eb0 tx=0x7fb350004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb34effd640 1 -- 172.21.15.2:0/3906315632 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35003e610 con 0x7fb35815d390 2023-11-25T04:09:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb34effd640 1 -- 172.21.15.2:0/3906315632 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35003e770 con 0x7fb35815d390 2023-11-25T04:09:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3581f3f30 con 0x7fb35815d390 2023-11-25T04:09:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb34effd640 1 -- 172.21.15.2:0/3906315632 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35003eb60 con 0x7fb35815d390 2023-11-25T04:09:25.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.070+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3581f44f0 con 0x7fb35815d390 2023-11-25T04:09:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.071+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3581f46e0 con 0x7fb35815d390 2023-11-25T04:09:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.072+0000 7fb34effd640 1 -- 172.21.15.2:0/3906315632 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb35003b050 con 0x7fb35815d390 2023-11-25T04:09:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.072+0000 7fb34effd640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb33806ae70 0x7fb33806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.072+0000 7fb34effd640 1 -- 172.21.15.2:0/3906315632 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5940+0+0 (secure 0 0 0) 0x7fb3500ab930 con 0x7fb35815d390 2023-11-25T04:09:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.072+0000 7fb35659c640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb33806ae70 0x7fb33806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:25.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.073+0000 7fb35659c640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb33806ae70 0x7fb33806d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb348009aa0 tx=0x7fb348009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:25.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.076+0000 7fb34effd640 1 -- 172.21.15.2:0/3906315632 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb350076900 con 0x7fb35815d390 2023-11-25T04:09:25.254 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.251+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb358067420 con 0x7fb35815d390 2023-11-25T04:09:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.931+0000 7fb34effd640 1 -- 172.21.15.2:0/3906315632 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb35004d0d0 con 0x7fb35815d390 2023-11-25T04:09:25.934 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' removed 2023-11-25T04:09:25.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.934+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb33806ae70 msgr2=0x7fb33806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:25.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.934+0000 7fb35cf1d640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb33806ae70 0x7fb33806d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb348009aa0 tx=0x7fb348009190 comp rx=0 tx=0).stop 2023-11-25T04:09:25.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.935+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb35815d390 msgr2=0x7fb3581f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:25.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.935+0000 7fb35cf1d640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb35815d390 0x7fb3581f0df0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb350009eb0 tx=0x7fb350004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:25.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.935+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 shutdown_connections 2023-11-25T04:09:25.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.935+0000 7fb35cf1d640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb35815d390 0x7fb3581f0df0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.935+0000 7fb35cf1d640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb33806ae70 0x7fb33806d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.940 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.935+0000 7fb35cf1d640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3580b35e0 0x7fb3581f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.935+0000 7fb35cf1d640 1 --2- 172.21.15.2:0/3906315632 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb35806c3b0 0x7fb3580ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:25.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.935+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 >> 172.21.15.2:0/3906315632 conn(0x7fb3580b2ac0 msgr2=0x7fb35815c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:25.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.935+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 shutdown_connections 2023-11-25T04:09:25.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:25.936+0000 7fb35cf1d640 1 -- 172.21.15.2:0/3906315632 wait complete. 2023-11-25T04:09:25.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-25T04:09:26.072 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.070+0000 7f5ffc272640 1 Processor -- start 2023-11-25T04:09:26.073 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.070+0000 7f5ffc272640 1 -- start start 2023-11-25T04:09:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.071+0000 7f5ffc272640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5ff4160a00 0x7f5ff40b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.071+0000 7f5ffc272640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ff40d08f0 0x7f5ff40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.071+0000 7f5ffc272640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff40cee40 con 0x7f5ff40d1510 2023-11-25T04:09:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.071+0000 7f5ffc272640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff40cfb70 con 0x7f5ff40d08f0 2023-11-25T04:09:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.071+0000 7f5ffc272640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff40cfe10 con 0x7f5ff4160a00 2023-11-25T04:09:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.071+0000 7f5ff980d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ff40d08f0 0x7f5ff40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.072+0000 7f5ff980d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f5ff40d08f0 0x7f5ff40b43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42340/0 (socket says 172.21.15.2:42340) 2023-11-25T04:09:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.072+0000 7f5ff980d640 1 -- 172.21.15.2:0/2167779936 learned_addr learned my addr 172.21.15.2:0/2167779936 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:26.074 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.072+0000 7f5ffa00e640 1 --2- 172.21.15.2:0/2167779936 >> v2:172.21.15.66:3300/0 conn(0x7f5ff4160a00 0x7f5ff40b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:26.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.072+0000 7f5ff980d640 1 -- 172.21.15.2:0/2167779936 >> v2:172.21.15.66:3300/0 conn(0x7f5ff4160a00 msgr2=0x7f5ff40b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:26.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.072+0000 7f5ff980d640 1 --2- 172.21.15.2:0/2167779936 >> v2:172.21.15.66:3300/0 conn(0x7f5ff4160a00 0x7f5ff40b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:26.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.072+0000 7f5ff980d640 1 -- 172.21.15.2:0/2167779936 >> v1:172.21.15.66:6789/0 conn(0x7f5ff40d1510 legacy=0x7f5ff41611f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:26.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.072+0000 7f5ff980d640 1 -- 172.21.15.2:0/2167779936 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40d00f0 con 0x7f5ff40d08f0 2023-11-25T04:09:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ff980d640 1 --2- 172.21.15.2:0/2167779936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d08f0 0x7f5ff40b43c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4072be0 tx=0x7f5fe802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6198de63726a6f server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ff900c640 1 -- 172.21.15.2:0/2167779936 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8031870 con 0x7f5ff40d08f0 2023-11-25T04:09:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ff900c640 1 -- 172.21.15.2:0/2167779936 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe80319d0 con 0x7f5ff40d08f0 2023-11-25T04:09:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ff900c640 1 -- 172.21.15.2:0/2167779936 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8031d60 con 0x7f5ff40d08f0 2023-11-25T04:09:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ffc272640 1 -- 172.21.15.2:0/2167779936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d08f0 msgr2=0x7f5ff40b43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ffc272640 1 --2- 172.21.15.2:0/2167779936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d08f0 0x7f5ff40b43c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4072be0 tx=0x7f5fe802b910 comp rx=0 tx=0).stop 2023-11-25T04:09:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ffc272640 1 -- 172.21.15.2:0/2167779936 shutdown_connections 2023-11-25T04:09:26.076 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ffc272640 1 --2- 172.21.15.2:0/2167779936 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d08f0 0x7f5ff40b43c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:26.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ffc272640 1 --2- 172.21.15.2:0/2167779936 >> v2:172.21.15.66:3300/0 conn(0x7f5ff4160a00 0x7f5ff40b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:26.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ffc272640 1 -- 172.21.15.2:0/2167779936 >> 172.21.15.2:0/2167779936 conn(0x7f5ff409c4a0 msgr2=0x7f5ff40d3170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:26.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ffc272640 1 -- 172.21.15.2:0/2167779936 shutdown_connections 2023-11-25T04:09:26.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.073+0000 7f5ffc272640 1 -- 172.21.15.2:0/2167779936 wait complete. 2023-11-25T04:09:26.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ffc272640 1 Processor -- start 2023-11-25T04:09:26.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ffc272640 1 -- start start 2023-11-25T04:09:26.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ffc272640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff40d08f0 0x7f5ff4153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:26.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ffc272640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d1510 0x7f5ff40b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ffc272640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff4160a00 0x7f5ff40b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ffc272640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40b1110 con 0x7f5ff40d1510 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ffc272640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40cb940 con 0x7f5ff4160a00 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ffc272640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff40cb380 con 0x7f5ff40d08f0 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ff980d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d1510 0x7f5ff40b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ff980d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d1510 0x7f5ff40b15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42342/0 (socket says 172.21.15.2:42342) 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.075+0000 7f5ff980d640 1 -- 172.21.15.2:0/1026492600 learned_addr learned my addr 172.21.15.2:0/1026492600 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ffa80f640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff4160a00 0x7f5ff40b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ff980d640 1 -- 172.21.15.2:0/1026492600 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff40d08f0 msgr2=0x7f5ff4153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ff980d640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff40d08f0 0x7f5ff4153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ff980d640 1 -- 172.21.15.2:0/1026492600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff4160a00 msgr2=0x7f5ff40b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:26.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ff980d640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff4160a00 0x7f5ff40b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:26.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ff980d640 1 -- 172.21.15.2:0/1026492600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe80094d0 con 0x7f5ff40d1510 2023-11-25T04:09:26.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ff980d640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d1510 0x7f5ff40b15a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5fe802b950 tx=0x7f5fe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:26.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ff2ffd640 1 -- 172.21.15.2:0/1026492600 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe8031840 con 0x7f5ff40d1510 2023-11-25T04:09:26.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ff2ffd640 1 -- 172.21.15.2:0/1026492600 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe80443f0 con 0x7f5ff40d1510 2023-11-25T04:09:26.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff40cb660 con 0x7f5ff40d1510 2023-11-25T04:09:26.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ff2ffd640 1 -- 172.21.15.2:0/1026492600 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe80447a0 con 0x7f5ff40d1510 2023-11-25T04:09:26.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.076+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff4153990 con 0x7f5ff40d1510 2023-11-25T04:09:26.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.077+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff4067420 con 0x7f5ff40d1510 2023-11-25T04:09:26.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.078+0000 7f5ff2ffd640 1 -- 172.21.15.2:0/1026492600 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fe8044900 con 0x7f5ff40d1510 2023-11-25T04:09:26.082 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.078+0000 7f5ff2ffd640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5fe006ae40 0x7f5fe006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:26.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.078+0000 7f5ff2ffd640 1 -- 172.21.15.2:0/1026492600 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f5fe802d040 con 0x7f5ff40d1510 2023-11-25T04:09:26.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.078+0000 7f5ffa00e640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5fe006ae40 0x7f5fe006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:26.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.079+0000 7f5ffa00e640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5fe006ae40 0x7f5fe006d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00a810 tx=0x7f5fec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:26.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.083+0000 7f5ff2ffd640 1 -- 172.21.15.2:0/1026492600 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5fe8076f40 con 0x7f5ff40d1510 2023-11-25T04:09:26.266 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:26.264+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5ff40cee40 con 0x7f5ff40d1510 2023-11-25T04:09:27.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.144+0000 7f5ff2ffd640 1 -- 172.21.15.2:0/1026492600 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5ff40cee40 con 0x7f5ff40d1510 2023-11-25T04:09:27.147 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' removed 2023-11-25T04:09:27.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5fe006ae40 msgr2=0x7f5fe006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:27.151 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5fe006ae40 0x7f5fe006d300 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5fec00a810 tx=0x7f5fec008040 comp rx=0 tx=0).stop 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d1510 msgr2=0x7f5ff40b15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d1510 0x7f5ff40b15a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5fe802b950 tx=0x7f5fe80046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 shutdown_connections 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f5fe006ae40 0x7f5fe006d300 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff4160a00 0x7f5ff40b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f5ff40d1510 0x7f5ff40b15a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 --2- 172.21.15.2:0/1026492600 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff40d08f0 0x7f5ff4153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 >> 172.21.15.2:0/1026492600 conn(0x7f5ff409c4a0 msgr2=0x7f5ff406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.149+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 shutdown_connections 2023-11-25T04:09:27.152 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.150+0000 7f5ffc272640 1 -- 172.21.15.2:0/1026492600 wait complete. 2023-11-25T04:09:27.167 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-25T04:09:27.167 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-25T04:09:27.167 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-25T04:09:27.167 INFO:teuthology.orchestra.run:waiting for 300 2023-11-25T04:09:27.167 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-25T04:09:27.168 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-25T04:09:27.168 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-25T04:09:27.168 INFO:teuthology.orchestra.run:waiting for 300 2023-11-25T04:09:27.168 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-25T04:09:27.168 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-25T04:09:27.168 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-25T04:09:27.168 INFO:teuthology.orchestra.run:waiting for 300 2023-11-25T04:09:27.169 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-25T04:09:27.169 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-25T04:09:27.169 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-25T04:09:27.169 INFO:teuthology.orchestra.run:waiting for 300 2023-11-25T04:09:27.180 INFO:tasks.ceph.mds.b:Stopped 2023-11-25T04:09:27.180 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-25T04:09:27.181 INFO:tasks.ceph.mds.d:Stopped 2023-11-25T04:09:27.181 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-25T04:09:27.182 INFO:tasks.ceph.mds.a:Stopped 2023-11-25T04:09:27.182 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-25T04:09:27.183 INFO:tasks.ceph.mds.c:Stopped 2023-11-25T04:09:27.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-25T04:09:27.222 INFO:tasks.ceph.mds.b:Started 2023-11-25T04:09:27.223 DEBUG:teuthology.parallel:result is None 2023-11-25T04:09:27.223 INFO:tasks.ceph.mds.d:Started 2023-11-25T04:09:27.224 DEBUG:teuthology.parallel:result is None 2023-11-25T04:09:27.226 INFO:tasks.ceph.mds.a:Started 2023-11-25T04:09:27.226 DEBUG:teuthology.parallel:result is None 2023-11-25T04:09:27.227 INFO:tasks.ceph.mds.c:Started 2023-11-25T04:09:27.228 DEBUG:teuthology.parallel:result is None 2023-11-25T04:09:27.228 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-25T04:09:27.308 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2023-11-25T04:09:27.308 INFO:tasks.ceph.mds.d.smithi066.stdout:starting mds.d at 2023-11-25T04:09:27.312 INFO:tasks.ceph.mds.a.smithi002.stdout:starting mds.a at 2023-11-25T04:09:27.312 INFO:tasks.ceph.mds.c.smithi002.stdout:starting mds.c at 2023-11-25T04:09:27.313 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T04:09:27.311+0000 7fe9029f7640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-11-25T04:09:27.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.343+0000 7f473f71d640 1 Processor -- start 2023-11-25T04:09:27.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.343+0000 7f473f71d640 1 -- start start 2023-11-25T04:09:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.344+0000 7f473f71d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f47380d1570 0x7f47380b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.344+0000 7f473f71d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47380ce360 con 0x7f4738160b70 2023-11-25T04:09:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.344+0000 7f473f71d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47380d19f0 con 0x7f47380cef00 2023-11-25T04:09:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.344+0000 7f473f71d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47380cdd50 con 0x7f47380d1570 2023-11-25T04:09:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.344+0000 7f473d4b9640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f4738160b70 0x7f47380ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:50604/0 (socket says 172.21.15.2:50604) 2023-11-25T04:09:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.344+0000 7f473d4b9640 1 -- 172.21.15.2:0/2610441070 learned_addr learned my addr 172.21.15.2:0/2610441070 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.344+0000 7f473ccb8640 1 --2- 172.21.15.2:0/2610441070 >> v2:172.21.15.66:3300/0 conn(0x7f47380d1570 0x7f47380b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:27.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.345+0000 7f472ffff640 1 -- 172.21.15.2:0/2610441070 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607431746 0 0) 0x7f47380d19f0 con 0x7f47380cef00 2023-11-25T04:09:27.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.345+0000 7f472ffff640 1 -- 172.21.15.2:0/2610441070 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4724003520 con 0x7f47380cef00 2023-11-25T04:09:27.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.345+0000 7f472ffff640 1 -- 172.21.15.2:0/2610441070 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194961924 0 0) 0x7f47380ce360 con 0x7f4738160b70 2023-11-25T04:09:27.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.345+0000 7f472ffff640 1 -- 172.21.15.2:0/2610441070 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47380d19f0 con 0x7f4738160b70 2023-11-25T04:09:27.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.345+0000 7f473ccb8640 1 -- 172.21.15.2:0/2610441070 >> v1:172.21.15.66:6789/0 conn(0x7f47380cef00 legacy=0x7f4738161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:27.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.345+0000 7f473ccb8640 1 -- 172.21.15.2:0/2610441070 >> v1:172.21.15.2:6789/0 conn(0x7f4738160b70 legacy=0x7f47380ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:27.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.345+0000 7f473ccb8640 1 -- 172.21.15.2:0/2610441070 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380d1c70 con 0x7f47380d1570 2023-11-25T04:09:27.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f473ccb8640 1 --2- 172.21.15.2:0/2610441070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47380d1570 0x7f47380b2aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f47340097a0 tx=0x7f473402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91082fa11cbf87d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:27.352 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f472ffff640 1 -- 172.21.15.2:0/2610441070 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734030610 con 0x7f47380d1570 2023-11-25T04:09:27.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f472ffff640 1 -- 172.21.15.2:0/2610441070 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4734030770 con 0x7f47380d1570 2023-11-25T04:09:27.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f472ffff640 1 -- 172.21.15.2:0/2610441070 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734030b00 con 0x7f47380d1570 2023-11-25T04:09:27.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f473f71d640 1 -- 172.21.15.2:0/2610441070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47380d1570 msgr2=0x7f47380b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:27.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f473f71d640 1 --2- 172.21.15.2:0/2610441070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47380d1570 0x7f47380b2aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f47340097a0 tx=0x7f473402b960 comp rx=0 tx=0).stop 2023-11-25T04:09:27.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f473f71d640 1 -- 172.21.15.2:0/2610441070 shutdown_connections 2023-11-25T04:09:27.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f473f71d640 1 --2- 172.21.15.2:0/2610441070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47380d1570 0x7f47380b2aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:27.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f473f71d640 1 -- 172.21.15.2:0/2610441070 >> 172.21.15.2:0/2610441070 conn(0x7f473809c470 msgr2=0x7f47380d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:27.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f473f71d640 1 -- 172.21.15.2:0/2610441070 shutdown_connections 2023-11-25T04:09:27.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.346+0000 7f473f71d640 1 -- 172.21.15.2:0/2610441070 wait complete. 2023-11-25T04:09:27.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.347+0000 7f473f71d640 1 Processor -- start 2023-11-25T04:09:27.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473f71d640 1 -- start start 2023-11-25T04:09:27.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473f71d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47380cef00 0x7f473814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:27.356 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473f71d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47380d1570 0x7f47380cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473f71d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738160b70 0x7f47380cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473f71d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473815dcb0 con 0x7f4738160b70 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473f71d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473815cd70 con 0x7f47380cef00 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473f71d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473814c980 con 0x7f47380d1570 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473dcba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738160b70 0x7f47380cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473dcba640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738160b70 0x7f47380cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42384/0 (socket says 172.21.15.2:42384) 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.348+0000 7f473dcba640 1 -- 172.21.15.2:0/3224836080 learned_addr learned my addr 172.21.15.2:0/3224836080 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473d4b9640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47380cef00 0x7f473814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473ccb8640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47380d1570 0x7f47380cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473dcba640 1 -- 172.21.15.2:0/3224836080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47380d1570 msgr2=0x7f47380cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:27.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473dcba640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47380d1570 0x7f47380cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473dcba640 1 -- 172.21.15.2:0/3224836080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47380cef00 msgr2=0x7f473814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473dcba640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47380cef00 0x7f473814c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473dcba640 1 -- 172.21.15.2:0/3224836080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009400 con 0x7f4738160b70 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473ccb8640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47380d1570 0x7f47380cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473dcba640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738160b70 0x7f47380cb7a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f473000c6e0 tx=0x7f473000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f472dffb640 1 -- 172.21.15.2:0/3224836080 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730003b70 con 0x7f4738160b70 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f472dffb640 1 -- 172.21.15.2:0/3224836080 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730003cd0 con 0x7f4738160b70 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473815d030 con 0x7f4738160b70 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f472dffb640 1 -- 172.21.15.2:0/3224836080 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730005310 con 0x7f4738160b70 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.349+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473815d5f0 con 0x7f4738160b70 2023-11-25T04:09:27.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.350+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473815ddf0 con 0x7f4738160b70 2023-11-25T04:09:27.359 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.351+0000 7f472dffb640 1 -- 172.21.15.2:0/3224836080 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4730005470 con 0x7f4738160b70 2023-11-25T04:09:27.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.351+0000 7f472dffb640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f471c06ae40 0x7f471c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:27.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.351+0000 7f472dffb640 1 -- 172.21.15.2:0/3224836080 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4730089120 con 0x7f4738160b70 2023-11-25T04:09:27.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.351+0000 7f473d4b9640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f471c06ae40 0x7f471c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:27.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.352+0000 7f473d4b9640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f471c06ae40 0x7f471c06d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f47280011e0 tx=0x7f4728009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:27.360 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.356+0000 7f472dffb640 1 -- 172.21.15.2:0/3224836080 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f473815ddf0 con 0x7f4738160b70 2023-11-25T04:09:27.553 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:27.551+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f473815ddf0 con 0x7f4738160b70 2023-11-25T04:09:28.165 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.163+0000 7f472dffb640 1 -- 172.21.15.2:0/3224836080 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f473815ddf0 con 0x7f4738160b70 2023-11-25T04:09:28.165 INFO:teuthology.orchestra.run.smithi002.stderr: removed all blocklist entries 2023-11-25T04:09:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f471c06ae40 msgr2=0x7f471c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f471c06ae40 0x7f471c06d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f47280011e0 tx=0x7f4728009040 comp rx=0 tx=0).stop 2023-11-25T04:09:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738160b70 msgr2=0x7f47380cb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738160b70 0x7f47380cb7a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f473000c6e0 tx=0x7f473000cba0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.168 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 shutdown_connections 2023-11-25T04:09:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f4738160b70 0x7f47380cb7a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47380d1570 0x7f47380cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f471c06ae40 0x7f471c06d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 --2- 172.21.15.2:0/3224836080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47380cef00 0x7f473814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 >> 172.21.15.2:0/3224836080 conn(0x7f473809c470 msgr2=0x7f473806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 shutdown_connections 2023-11-25T04:09:28.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.166+0000 7f473f71d640 1 -- 172.21.15.2:0/3224836080 wait complete. 2023-11-25T04:09:28.182 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-25T04:09:28.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.294+0000 7f05f4f8e640 1 Processor -- start 2023-11-25T04:09:28.296 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.294+0000 7f05f4f8e640 1 -- start start 2023-11-25T04:09:28.297 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05f4f8e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05f00ce860 0x7f05f006e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05f4f8e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f05f015d280 0x7f05f015d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05f4f8e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f0071ca0 con 0x7f05f0159c90 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05f4f8e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f015dc50 con 0x7f05f00ce860 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05f4f8e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f0071090 con 0x7f05f015d280 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05ee59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05f00ce860 0x7f05f006e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05ee59c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f05f00ce860 0x7f05f006e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42390/0 (socket says 172.21.15.2:42390) 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05ee59c640 1 -- 172.21.15.2:0/1801735458 learned_addr learned my addr 172.21.15.2:0/1801735458 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05e7fff640 1 --2- 172.21.15.2:0/1801735458 >> v2:172.21.15.66:3300/0 conn(0x7f05f015d280 0x7f05f015d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05ee59c640 1 -- 172.21.15.2:0/1801735458 >> v2:172.21.15.66:3300/0 conn(0x7f05f015d280 msgr2=0x7f05f015d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:28.298 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05edd9b640 1 -- 172.21.15.2:0/1801735458 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184279645 0 0) 0x7f05f0071ca0 con 0x7f05f0159c90 2023-11-25T04:09:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05ee59c640 1 --2- 172.21.15.2:0/1801735458 >> v2:172.21.15.66:3300/0 conn(0x7f05f015d280 0x7f05f015d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05ee59c640 1 -- 172.21.15.2:0/1801735458 >> v1:172.21.15.66:6789/0 conn(0x7f05f0159c90 legacy=0x7f05f015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.295+0000 7f05ee59c640 1 -- 172.21.15.2:0/1801735458 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0071370 con 0x7f05f00ce860 2023-11-25T04:09:28.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.296+0000 7f05ee59c640 1 --2- 172.21.15.2:0/1801735458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 0x7f05f006e050 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f05f0067c40 tx=0x7f05e002df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4637bd63d207f7e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:28.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.296+0000 7f05edd9b640 1 -- 172.21.15.2:0/1801735458 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e002ed00 con 0x7f05f00ce860 2023-11-25T04:09:28.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.296+0000 7f05edd9b640 1 -- 172.21.15.2:0/1801735458 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0032070 con 0x7f05f00ce860 2023-11-25T04:09:28.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.296+0000 7f05edd9b640 1 -- 172.21.15.2:0/1801735458 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0038620 con 0x7f05f00ce860 2023-11-25T04:09:28.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.297+0000 7f05f4f8e640 1 -- 172.21.15.2:0/1801735458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 msgr2=0x7f05f006e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.297+0000 7f05f4f8e640 1 --2- 172.21.15.2:0/1801735458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 0x7f05f006e050 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f05f0067c40 tx=0x7f05e002df50 comp rx=0 tx=0).stop 2023-11-25T04:09:28.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.297+0000 7f05f4f8e640 1 -- 172.21.15.2:0/1801735458 shutdown_connections 2023-11-25T04:09:28.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.297+0000 7f05f4f8e640 1 --2- 172.21.15.2:0/1801735458 >> v2:172.21.15.66:3300/0 conn(0x7f05f015d280 0x7f05f015d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.297+0000 7f05f4f8e640 1 --2- 172.21.15.2:0/1801735458 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 0x7f05f006e050 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.297+0000 7f05f4f8e640 1 -- 172.21.15.2:0/1801735458 >> 172.21.15.2:0/1801735458 conn(0x7f05f00b0af0 msgr2=0x7f05f00b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:28.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.297+0000 7f05f4f8e640 1 -- 172.21.15.2:0/1801735458 shutdown_connections 2023-11-25T04:09:28.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.297+0000 7f05f4f8e640 1 -- 172.21.15.2:0/1801735458 wait complete. 2023-11-25T04:09:28.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.298+0000 7f05f4f8e640 1 Processor -- start 2023-11-25T04:09:28.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.298+0000 7f05f4f8e640 1 -- start start 2023-11-25T04:09:28.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05f4f8e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 0x7f05f0148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05f4f8e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05f0159c90 0x7f05f0148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05f4f8e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05f015d280 0x7f05f014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05f4f8e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0148890 con 0x7f05f00ce860 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05f4f8e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f01eeb40 con 0x7f05f0159c90 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05f4f8e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f01493c0 con 0x7f05f015d280 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 0x7f05f0148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05ee59c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 0x7f05f0148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:42394/0 (socket says 172.21.15.2:42394) 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05ee59c640 1 -- 172.21.15.2:0/2116323215 learned_addr learned my addr 172.21.15.2:0/2116323215 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05e7fff640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05f0159c90 0x7f05f0148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05eed9d640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05f015d280 0x7f05f014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05ee59c640 1 -- 172.21.15.2:0/2116323215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05f015d280 msgr2=0x7f05f014a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05ee59c640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05f015d280 0x7f05f014a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05ee59c640 1 -- 172.21.15.2:0/2116323215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05f0159c90 msgr2=0x7f05f0148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05ee59c640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05f0159c90 0x7f05f0148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.305 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.299+0000 7f05ee59c640 1 -- 172.21.15.2:0/2116323215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e000b760 con 0x7f05f00ce860 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.300+0000 7f05ee59c640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 0x7f05f0148350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000c00 tx=0x7f05e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.300+0000 7f05e6ffd640 1 -- 172.21.15.2:0/2116323215 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0043440 con 0x7f05f00ce860 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.300+0000 7f05e6ffd640 1 -- 172.21.15.2:0/2116323215 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e00435c0 con 0x7f05f00ce860 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.300+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f01496a0 con 0x7f05f00ce860 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.300+0000 7f05e6ffd640 1 -- 172.21.15.2:0/2116323215 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0043970 con 0x7f05f00ce860 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.300+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f01ee790 con 0x7f05f00ce860 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.301+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f0067420 con 0x7f05f00ce860 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.301+0000 7f05e6ffd640 1 -- 172.21.15.2:0/2116323215 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05e0043ad0 con 0x7f05f00ce860 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.302+0000 7f05e6ffd640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f05d006ae40 0x7f05d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.302+0000 7f05e6ffd640 1 -- 172.21.15.2:0/2116323215 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f05e00ad760 con 0x7f05f00ce860 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.302+0000 7f05e7fff640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f05d006ae40 0x7f05d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.302+0000 7f05e7fff640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f05d006ae40 0x7f05d006d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05f00b1860 tx=0x7f05d8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:28.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.306+0000 7f05e6ffd640 1 -- 172.21.15.2:0/2116323215 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05e0078c30 con 0x7f05f00ce860 2023-11-25T04:09:28.551 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.549+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f05f006c690 con 0x7f05f00ce860 2023-11-25T04:09:28.552 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.550+0000 7f05e6ffd640 1 -- 172.21.15.2:0/2116323215 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f05e007c250 con 0x7f05f00ce860 2023-11-25T04:09:28.552 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:28.552 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-25T04:09:28.552 INFO:teuthology.orchestra.run.smithi002.stdout: "auth_dump": [ 2023-11-25T04:09:28.552 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.552 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.a", 2023-11-25T04:09:28.552 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALc2Flo4gFABAAq6znUGgcN4BGfkmIUMYAaQ==", 2023-11-25T04:09:28.552 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.b", 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALc2Flco3oDRAA5QJWKMCa51W6HptwDpoadw==", 2023-11-25T04:09:28.553 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.c", 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALc2FlnZcNCBAAJ5vebG16ng3h7UyzNaED7g==", 2023-11-25T04:09:28.554 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mds.d", 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALc2Fll6EJFhAALB9wQZ7XAnZgRHtEuf7LxA==", 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-25T04:09:28.555 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.0", 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQANc2Fl4RsNAhAAuESHc7m52EPiMJyR0y7B7g==", 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-25T04:09:28.556 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.1", 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQAQc2FlFzP+ABAA4WAc5NSSFzAh9fOdlZ/k8Q==", 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.557 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.2", 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQASc2FlggiGOxAATqBwHWUQbLehkeHtSZSnog==", 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.3", 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQAVc2Fls9wkOhAAjiVd24vsbKIbQJ5thsqYGA==", 2023-11-25T04:09:28.558 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.4", 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQAcc2FlfYsDChAAizaC1FsO1fw3tY2tpEUZOQ==", 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-25T04:09:28.559 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.5", 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQAfc2FlBoVYCRAAHdeE38eG4oEsYYevW8tKaA==", 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.560 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.561 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.561 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.6", 2023-11-25T04:09:28.561 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQAic2FlReb+CBAAI1lAmpz9xIVRukJl5UbBOQ==", 2023-11-25T04:09:28.561 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.561 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-25T04:09:28.561 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-25T04:09:28.561 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.561 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.561 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "osd.7", 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQAlc2FlliuHCBAAZAiY1Ic+2V55TYPU7vIVvA==", 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow profile osd", 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile osd", 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.0", 2023-11-25T04:09:28.562 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALc2FlqNP5GhAAv0HvFTFKxDiE/tkoFN1FKA==", 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.1", 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALc2FlRd61IhAAMEg1v1C3vWe4G5ukk6qqEA==", 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.563 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.2", 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALc2Fl1I3WHhAAq2KxvUCG7qKZne5v4xuQMQ==", 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-25T04:09:28.564 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.3", 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQALc2FlWZCLJhAA5wtUUIzLPvqkJPUlqWq/rg==", 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow", 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow r", 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow rw", 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow rwx" 2023-11-25T04:09:28.565 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.admin", 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQAKc2FlIkK4GxAA/rMcF9sRc98QtUqoNm7W1g==", 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: "mgr": "allow *", 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow *", 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.566 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mds", 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQArc2FlCGb4DRAARSinv8q9OpTLDLPLv4Psgw==", 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mds" 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-mgr", 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQArc2FlAG/4DRAApiK3dSsc0CyytmkECzNTqQ==", 2023-11-25T04:09:28.567 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-osd", 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQArc2Fldnb4DRAAFRWRLzg6o6wUZ/cTTNEL0w==", 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-osd" 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd", 2023-11-25T04:09:28.568 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQArc2FljH34DRAAgNLQdUhNAgTYREdBV5nG+Q==", 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQArc2FlzYT4DRAA9BISaYrwcIs/F4QWfhCvAQ==", 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.569 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "client.bootstrap-rgw", 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQArc2FlMYz4DRAAENMakYhYIBs9v3bJzctTWw==", 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.x", 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQAKc2Fl1Fm8NxAAGC2prWE3MBy1mfCAo6e9IA==", 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-25T04:09:28.570 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: "entity": "mgr.y", 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: "key": "AQAKc2Fl6XTlMhAAjZ7UbcmM3JleJcMDf+bYvQ==", 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": { 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: "mds": "allow *", 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: "mon": "allow profile mgr", 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: "osd": "allow *" 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.571 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:28.572 INFO:teuthology.orchestra.run.smithi002.stdout: ] 2023-11-25T04:09:28.572 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-25T04:09:28.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.551+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f05d006ae40 msgr2=0x7f05d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.551+0000 7f05f4f8e640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f05d006ae40 0x7f05d006d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f05f00b1860 tx=0x7f05d8009190 comp rx=0 tx=0).stop 2023-11-25T04:09:28.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.551+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 msgr2=0x7f05f0148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.551+0000 7f05f4f8e640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 0x7f05f0148350 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f05e0000c00 tx=0x7f05e00046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.551+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 shutdown_connections 2023-11-25T04:09:28.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.551+0000 7f05f4f8e640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05f015d280 0x7f05f014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.551+0000 7f05f4f8e640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f05d006ae40 0x7f05d006d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.551+0000 7f05f4f8e640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05f0159c90 0x7f05f0148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.551+0000 7f05f4f8e640 1 --2- 172.21.15.2:0/2116323215 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f05f00ce860 0x7f05f0148350 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.552+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 >> 172.21.15.2:0/2116323215 conn(0x7f05f00b0af0 msgr2=0x7f05f00af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.552+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 shutdown_connections 2023-11-25T04:09:28.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.552+0000 7f05f4f8e640 1 -- 172.21.15.2:0/2116323215 wait complete. 2023-11-25T04:09:28.574 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-25T04:09:28.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.680+0000 7f39aab8a640 1 Processor -- start 2023-11-25T04:09:28.682 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.680+0000 7f39aab8a640 1 -- start start 2023-11-25T04:09:28.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39aab8a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f39a406ec60 0x7f39a415e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39aab8a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a415d690 0x7f39a406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.683 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39aab8a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f39a406e460 0x7f39a4160f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39aab8a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a415e9d0 con 0x7f39a406e460 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39aab8a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39a409a720 con 0x7f39a406ec60 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39aab8a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a406f580 con 0x7f39a415d690 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a9127640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f39a406e460 0x7f39a4160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a9127640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f39a406e460 0x7f39a4160f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35156/0 (socket says 172.21.15.2:35156) 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a9127640 1 -- 172.21.15.2:0/1309063030 learned_addr learned my addr 172.21.15.2:0/1309063030 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a8926640 1 --2- 172.21.15.2:0/1309063030 >> v2:172.21.15.66:3300/0 conn(0x7f39a406ec60 0x7f39a415e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a3fff640 1 --2- 172.21.15.2:0/1309063030 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a415d690 0x7f39a406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a9127640 1 -- 172.21.15.2:0/1309063030 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a415d690 msgr2=0x7f39a406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a9127640 1 --2- 172.21.15.2:0/1309063030 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a415d690 0x7f39a406f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a9127640 1 -- 172.21.15.2:0/1309063030 >> v2:172.21.15.66:3300/0 conn(0x7f39a406ec60 msgr2=0x7f39a415e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:28.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a9127640 1 --2- 172.21.15.2:0/1309063030 >> v2:172.21.15.66:3300/0 conn(0x7f39a406ec60 0x7f39a415e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.685 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.681+0000 7f39a9127640 1 -- 172.21.15.2:0/1309063030 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a4099b10 con 0x7f39a406e460 2023-11-25T04:09:28.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.682+0000 7f39a9127640 1 --2- 172.21.15.2:0/1309063030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a406e460 0x7f39a4160f80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f39a4071b50 tx=0x7f399c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d88ce46ab200a3 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:28.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.682+0000 7f39a37fe640 1 -- 172.21.15.2:0/1309063030 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c02c9e0 con 0x7f39a406e460 2023-11-25T04:09:28.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.682+0000 7f39a37fe640 1 -- 172.21.15.2:0/1309063030 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c02cb40 con 0x7f39a406e460 2023-11-25T04:09:28.686 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.682+0000 7f39a37fe640 1 -- 172.21.15.2:0/1309063030 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c0343f0 con 0x7f39a406e460 2023-11-25T04:09:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.683+0000 7f39aab8a640 1 -- 172.21.15.2:0/1309063030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a406e460 msgr2=0x7f39a4160f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.683+0000 7f39aab8a640 1 --2- 172.21.15.2:0/1309063030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a406e460 0x7f39a4160f80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f39a4071b50 tx=0x7f399c02be40 comp rx=0 tx=0).stop 2023-11-25T04:09:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.683+0000 7f39aab8a640 1 -- 172.21.15.2:0/1309063030 shutdown_connections 2023-11-25T04:09:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.683+0000 7f39aab8a640 1 --2- 172.21.15.2:0/1309063030 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a406e460 0x7f39a4160f80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.687 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.683+0000 7f39aab8a640 1 --2- 172.21.15.2:0/1309063030 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a415d690 0x7f39a406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.683+0000 7f39aab8a640 1 --2- 172.21.15.2:0/1309063030 >> v2:172.21.15.66:3300/0 conn(0x7f39a406ec60 0x7f39a415e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.688 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.683+0000 7f39aab8a640 1 -- 172.21.15.2:0/1309063030 >> 172.21.15.2:0/1309063030 conn(0x7f39a40b2a20 msgr2=0x7f39a40b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.683+0000 7f39aab8a640 1 -- 172.21.15.2:0/1309063030 shutdown_connections 2023-11-25T04:09:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.683+0000 7f39aab8a640 1 -- 172.21.15.2:0/1309063030 wait complete. 2023-11-25T04:09:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.684+0000 7f39aab8a640 1 Processor -- start 2023-11-25T04:09:28.689 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.684+0000 7f39aab8a640 1 -- start start 2023-11-25T04:09:28.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39aab8a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a406e460 0x7f39a41e8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39aab8a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a406ec60 0x7f39a409ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39aab8a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a409b380 0x7f39a409ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.691 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39aab8a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41e8c60 con 0x7f39a409b380 2023-11-25T04:09:28.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39aab8a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41e7680 con 0x7f39a406e460 2023-11-25T04:09:28.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39aab8a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39a41e7960 con 0x7f39a406ec60 2023-11-25T04:09:28.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a9127640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a409b380 0x7f39a409ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a8926640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a406e460 0x7f39a41e8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a9127640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a409b380 0x7f39a409ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35170/0 (socket says 172.21.15.2:35170) 2023-11-25T04:09:28.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a9127640 1 -- 172.21.15.2:0/2148993814 learned_addr learned my addr 172.21.15.2:0/2148993814 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:28.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a3fff640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a406ec60 0x7f39a409ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.692 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a9127640 1 -- 172.21.15.2:0/2148993814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a406ec60 msgr2=0x7f39a409ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a9127640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a406ec60 0x7f39a409ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a9127640 1 -- 172.21.15.2:0/2148993814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a406e460 msgr2=0x7f39a41e8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a9127640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a406e460 0x7f39a41e8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a9127640 1 -- 172.21.15.2:0/2148993814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f399c009b30 con 0x7f39a409b380 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a9127640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a409b380 0x7f39a409ca40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f399c036040 tx=0x7f399c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.685+0000 7f39a17fa640 1 -- 172.21.15.2:0/2148993814 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c009510 con 0x7f39a409b380 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.686+0000 7f39a17fa640 1 -- 172.21.15.2:0/2148993814 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f399c03e450 con 0x7f39a409b380 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.686+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39a41e7c40 con 0x7f39a409b380 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.686+0000 7f39a17fa640 1 -- 172.21.15.2:0/2148993814 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f399c03e800 con 0x7f39a409b380 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.686+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39a41e8200 con 0x7f39a409b380 2023-11-25T04:09:28.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.687+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39a41e8420 con 0x7f39a409b380 2023-11-25T04:09:28.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.687+0000 7f39a17fa640 1 -- 172.21.15.2:0/2148993814 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f399c03e960 con 0x7f39a409b380 2023-11-25T04:09:28.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.687+0000 7f39a17fa640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f398806ae70 0x7f398806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:28.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.687+0000 7f39a17fa640 1 -- 172.21.15.2:0/2148993814 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f399c0abb60 con 0x7f39a409b380 2023-11-25T04:09:28.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.687+0000 7f39a8926640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f398806ae70 0x7f398806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:28.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.688+0000 7f39a8926640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f398806ae70 0x7f398806d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3998009ac0 tx=0x7f3998009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:28.695 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.692+0000 7f39a17fa640 1 -- 172.21.15.2:0/2148993814 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f399c076f80 con 0x7f39a409b380 2023-11-25T04:09:28.937 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.935+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f39a409f040 con 0x7f39a409b380 2023-11-25T04:09:28.939 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.937+0000 7f39a17fa640 1 -- 172.21.15.2:0/2148993814 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f399c07a5a0 con 0x7f39a409b380 2023-11-25T04:09:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f398806ae70 msgr2=0x7f398806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f398806ae70 0x7f398806d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3998009ac0 tx=0x7f3998009190 comp rx=0 tx=0).stop 2023-11-25T04:09:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a409b380 msgr2=0x7f39a409ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a409b380 0x7f39a409ca40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f399c036040 tx=0x7f399c004a40 comp rx=0 tx=0).stop 2023-11-25T04:09:28.941 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 shutdown_connections 2023-11-25T04:09:28.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39a409b380 0x7f39a409ca40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39a406ec60 0x7f39a409ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f398806ae70 0x7f398806d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 --2- 172.21.15.2:0/2148993814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39a406e460 0x7f39a41e8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:28.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 >> 172.21.15.2:0/2148993814 conn(0x7f39a40b2a20 msgr2=0x7f39a40d0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:28.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 shutdown_connections 2023-11-25T04:09:28.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:28.939+0000 7f39aab8a640 1 -- 172.21.15.2:0/2148993814 wait complete. 2023-11-25T04:09:28.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-25T04:09:29.083 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.058+0000 7f8c5d7ec640 1 Processor -- start 2023-11-25T04:09:29.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.058+0000 7f8c5d7ec640 1 -- start start 2023-11-25T04:09:29.084 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c5d7ec640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8c580ce0d0 0x7f8c5815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c5d7ec640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8c580ce510 0x7f8c5815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.085 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c5d7ec640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c580cf510 con 0x7f8c580cc170 2023-11-25T04:09:29.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c5d7ec640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c580ce990 con 0x7f8c580ce510 2023-11-25T04:09:29.086 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c5d7ec640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c580cec70 con 0x7f8c580ce0d0 2023-11-25T04:09:29.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c577fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8c580ce510 0x7f8c5815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c577fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8c580ce510 0x7f8c5815f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35176/0 (socket says 172.21.15.2:35176) 2023-11-25T04:09:29.087 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c577fe640 1 -- 172.21.15.2:0/2989500793 learned_addr learned my addr 172.21.15.2:0/2989500793 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:29.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c567fc640 1 --2- 172.21.15.2:0/2989500793 >> v2:172.21.15.66:3300/0 conn(0x7f8c580ce0d0 0x7f8c5815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.088 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c577fe640 1 -- 172.21.15.2:0/2989500793 >> v2:172.21.15.66:3300/0 conn(0x7f8c580ce0d0 msgr2=0x7f8c5815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:29.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c577fe640 1 --2- 172.21.15.2:0/2989500793 >> v2:172.21.15.66:3300/0 conn(0x7f8c580ce0d0 0x7f8c5815eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.089 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c577fe640 1 -- 172.21.15.2:0/2989500793 >> v1:172.21.15.66:6789/0 conn(0x7f8c580cc170 legacy=0x7f8c580cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.059+0000 7f8c577fe640 1 -- 172.21.15.2:0/2989500793 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c580cef50 con 0x7f8c580ce510 2023-11-25T04:09:29.090 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.060+0000 7f8c577fe640 1 --2- 172.21.15.2:0/2989500793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580ce510 0x7f8c5815f0d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8c58073ba0 tx=0x7f8c5002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0600f50c39f3ce server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:29.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.060+0000 7f8c55ffb640 1 -- 172.21.15.2:0/2989500793 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50031870 con 0x7f8c580ce510 2023-11-25T04:09:29.091 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.060+0000 7f8c55ffb640 1 -- 172.21.15.2:0/2989500793 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c500319d0 con 0x7f8c580ce510 2023-11-25T04:09:29.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.060+0000 7f8c55ffb640 1 -- 172.21.15.2:0/2989500793 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c50031d60 con 0x7f8c580ce510 2023-11-25T04:09:29.092 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.061+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/2989500793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580ce510 msgr2=0x7f8c5815f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.061+0000 7f8c5d7ec640 1 --2- 172.21.15.2:0/2989500793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580ce510 0x7f8c5815f0d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8c58073ba0 tx=0x7f8c5002b910 comp rx=0 tx=0).stop 2023-11-25T04:09:29.093 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.061+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/2989500793 shutdown_connections 2023-11-25T04:09:29.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.061+0000 7f8c5d7ec640 1 --2- 172.21.15.2:0/2989500793 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580ce510 0x7f8c5815f0d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.094 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.061+0000 7f8c5d7ec640 1 --2- 172.21.15.2:0/2989500793 >> v2:172.21.15.66:3300/0 conn(0x7f8c580ce0d0 0x7f8c5815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.061+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/2989500793 >> 172.21.15.2:0/2989500793 conn(0x7f8c580b1670 msgr2=0x7f8c580b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:29.095 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.061+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/2989500793 shutdown_connections 2023-11-25T04:09:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.061+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/2989500793 wait complete. 2023-11-25T04:09:29.096 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.062+0000 7f8c5d7ec640 1 Processor -- start 2023-11-25T04:09:29.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.062+0000 7f8c5d7ec640 1 -- start start 2023-11-25T04:09:29.097 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c5d7ec640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580cc170 0x7f8c58157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.098 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c5d7ec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c580ce0d0 0x7f8c581f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c5d7ec640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c580ce510 0x7f8c581f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.099 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c5d7ec640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c58154a70 con 0x7f8c580cc170 2023-11-25T04:09:29.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c5d7ec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c581f1e30 con 0x7f8c580ce0d0 2023-11-25T04:09:29.100 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c5d7ec640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c58158700 con 0x7f8c580ce510 2023-11-25T04:09:29.101 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c56ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580cc170 0x7f8c58157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c56ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580cc170 0x7f8c58157dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35186/0 (socket says 172.21.15.2:35186) 2023-11-25T04:09:29.102 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c56ffd640 1 -- 172.21.15.2:0/1353465244 learned_addr learned my addr 172.21.15.2:0/1353465244 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c567fc640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c580ce0d0 0x7f8c581f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.103 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c577fe640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c580ce510 0x7f8c581f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c56ffd640 1 -- 172.21.15.2:0/1353465244 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c580ce510 msgr2=0x7f8c581f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.104 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c56ffd640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c580ce510 0x7f8c581f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c56ffd640 1 -- 172.21.15.2:0/1353465244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c580ce0d0 msgr2=0x7f8c581f0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c56ffd640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c580ce0d0 0x7f8c581f0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.063+0000 7f8c56ffd640 1 -- 172.21.15.2:0/1353465244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c500094d0 con 0x7f8c580cc170 2023-11-25T04:09:29.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.064+0000 7f8c56ffd640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580cc170 0x7f8c58157dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c870 tx=0x7f8c4800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:29.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.064+0000 7f8c4f7fe640 1 -- 172.21.15.2:0/1353465244 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c48003b70 con 0x7f8c580cc170 2023-11-25T04:09:29.105 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.064+0000 7f8c4f7fe640 1 -- 172.21.15.2:0/1353465244 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c48003cf0 con 0x7f8c580cc170 2023-11-25T04:09:29.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.064+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c581589e0 con 0x7f8c580cc170 2023-11-25T04:09:29.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.064+0000 7f8c4f7fe640 1 -- 172.21.15.2:0/1353465244 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4800aa90 con 0x7f8c580cc170 2023-11-25T04:09:29.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.064+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c58154690 con 0x7f8c580cc170 2023-11-25T04:09:29.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.065+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c58072720 con 0x7f8c580cc170 2023-11-25T04:09:29.106 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.065+0000 7f8c4f7fe640 1 -- 172.21.15.2:0/1353465244 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c4800abf0 con 0x7f8c580cc170 2023-11-25T04:09:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.066+0000 7f8c4f7fe640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8c3806ae40 0x7f8c3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.066+0000 7f8c4f7fe640 1 -- 172.21.15.2:0/1353465244 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8c48089040 con 0x7f8c580cc170 2023-11-25T04:09:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.066+0000 7f8c567fc640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8c3806ae40 0x7f8c3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.066+0000 7f8c567fc640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8c3806ae40 0x7f8c3806d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c58159780 tx=0x7f8c40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:29.107 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.070+0000 7f8c4f7fe640 1 -- 172.21.15.2:0/1353465244 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c48054500 con 0x7f8c580cc170 2023-11-25T04:09:29.319 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.316+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8c5804e920 con 0x7f8c580cc170 2023-11-25T04:09:29.320 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.318+0000 7f8c4f7fe640 1 -- 172.21.15.2:0/1353465244 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8c48057b20 con 0x7f8c580cc170 2023-11-25T04:09:29.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8c3806ae40 msgr2=0x7f8c3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8c3806ae40 0x7f8c3806d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8c58159780 tx=0x7f8c40008040 comp rx=0 tx=0).stop 2023-11-25T04:09:29.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580cc170 msgr2=0x7f8c58157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580cc170 0x7f8c58157dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800c870 tx=0x7f8c4800cd30 comp rx=0 tx=0).stop 2023-11-25T04:09:29.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 shutdown_connections 2023-11-25T04:09:29.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c580ce510 0x7f8c581f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8c3806ae40 0x7f8c3806d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c580ce0d0 0x7f8c581f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 --2- 172.21.15.2:0/1353465244 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8c580cc170 0x7f8c58157dc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 >> 172.21.15.2:0/1353465244 conn(0x7f8c580b1670 msgr2=0x7f8c58159e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:29.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 shutdown_connections 2023-11-25T04:09:29.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.320+0000 7f8c5d7ec640 1 -- 172.21.15.2:0/1353465244 wait complete. 2023-11-25T04:09:29.333 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-25T04:09:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.438+0000 7fba16941640 1 Processor -- start 2023-11-25T04:09:29.440 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.438+0000 7fba16941640 1 -- start start 2023-11-25T04:09:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.439+0000 7fba16941640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fba10144950 0x7fba100ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.439+0000 7fba16941640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba101446f0 con 0x7fba10144310 2023-11-25T04:09:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.439+0000 7fba16941640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba1015ba80 con 0x7fba1006cfa0 2023-11-25T04:09:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.439+0000 7fba16941640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1015bd60 con 0x7fba10144950 2023-11-25T04:09:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.439+0000 7fba0ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fba10144310 0x7fba1006c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42888/0 (socket says 172.21.15.2:42888) 2023-11-25T04:09:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.439+0000 7fba0ffff640 1 -- 172.21.15.2:0/2500554055 learned_addr learned my addr 172.21.15.2:0/2500554055 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:29.443 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.439+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 32118456 0 0) 0x7fba101446f0 con 0x7fba10144310 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.439+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9fc003520 con 0x7fba10144310 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.439+0000 7fba14ede640 1 --2- 172.21.15.2:0/2500554055 >> v2:172.21.15.66:3300/0 conn(0x7fba10144950 0x7fba100ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 657228849 0 0) 0x7fb9fc003520 con 0x7fba10144310 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 >> v2:172.21.15.66:3300/0 conn(0x7fba10144950 msgr2=0x7fba100ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 --2- 172.21.15.2:0/2500554055 >> v2:172.21.15.66:3300/0 conn(0x7fba10144950 0x7fba100ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 >> v1:172.21.15.66:6789/0 conn(0x7fba1006cfa0 legacy=0x7fba1015ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1015c040 con 0x7fba10144310 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7fb9f8001670 con 0x7fba10144310 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 >> v1:172.21.15.2:6789/0 conn(0x7fba10144310 legacy=0x7fba1006c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9fc003970 0x7fb9fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.444 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9fc005180 0x7fb9fc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1015bd60 con 0x7fb9fc0047c0 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc00c020 con 0x7fb9fc003970 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc00c1e0 con 0x7fb9fc005180 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0ffff640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9fc003970 0x7fb9fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba14ede640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9fc005180 0x7fb9fc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0f7fe640 1 -- 172.21.15.2:0/2500554055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9fc005180 msgr2=0x7fb9fc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9fc005180 0x7fb9fc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0f7fe640 1 -- 172.21.15.2:0/2500554055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9fc003970 msgr2=0x7fb9fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9fc003970 0x7fb9fc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba0f7fe640 1 -- 172.21.15.2:0/2500554055 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc003520 con 0x7fb9fc0047c0 2023-11-25T04:09:29.445 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.440+0000 7fba14ede640 1 -- 172.21.15.2:0/2500554055 reap_dead start 2023-11-25T04:09:29.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.441+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fba00001750 tx=0x7fb9fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841eb49ae74d9739 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:29.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.441+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000052d0 con 0x7fb9fc0047c0 2023-11-25T04:09:29.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.441+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0002e050 con 0x7fb9fc0047c0 2023-11-25T04:09:29.446 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.441+0000 7fba0effd640 1 -- 172.21.15.2:0/2500554055 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00003830 con 0x7fb9fc0047c0 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.442+0000 7fba16941640 1 -- 172.21.15.2:0/2500554055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9fc0047c0 msgr2=0x7fb9fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.442+0000 7fba16941640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fba00001750 tx=0x7fb9fc0057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.442+0000 7fba16941640 1 -- 172.21.15.2:0/2500554055 shutdown_connections 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.442+0000 7fba16941640 1 --2- 172.21.15.2:0/2500554055 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb9fc0047c0 0x7fb9fc004c40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.442+0000 7fba16941640 1 -- 172.21.15.2:0/2500554055 >> 172.21.15.2:0/2500554055 conn(0x7fba1006a8f0 msgr2=0x7fba1006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.442+0000 7fba16941640 1 -- 172.21.15.2:0/2500554055 shutdown_connections 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.442+0000 7fba16941640 1 -- 172.21.15.2:0/2500554055 wait complete. 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.443+0000 7fba16941640 1 Processor -- start 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.443+0000 7fba16941640 1 -- start start 2023-11-25T04:09:29.449 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba16941640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9fc0047c0 0x7fba100a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba16941640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba101f0300 0x7fba100af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba16941640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101f0780 0x7fba100af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba16941640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba10157770 con 0x7fba101f0780 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba16941640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100a99c0 con 0x7fba101f0300 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba16941640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba100a9ca0 con 0x7fb9fc0047c0 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba14ede640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101f0780 0x7fba100af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba14ede640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101f0780 0x7fba100af880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35214/0 (socket says 172.21.15.2:35214) 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba14ede640 1 -- 172.21.15.2:0/177625457 learned_addr learned my addr 172.21.15.2:0/177625457 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba0ffff640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9fc0047c0 0x7fba100a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba0f7fe640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba101f0300 0x7fba100af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba14ede640 1 -- 172.21.15.2:0/177625457 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9fc0047c0 msgr2=0x7fba100a8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.450 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba14ede640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9fc0047c0 0x7fba100a8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba14ede640 1 -- 172.21.15.2:0/177625457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba101f0300 msgr2=0x7fba100af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba14ede640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba101f0300 0x7fba100af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.444+0000 7fba14ede640 1 -- 172.21.15.2:0/177625457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100a9f80 con 0x7fba101f0780 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.445+0000 7fba14ede640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101f0780 0x7fba100af880 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fba100b3310 tx=0x7fba0800f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.445+0000 7fba0cff9640 1 -- 172.21.15.2:0/177625457 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800e040 con 0x7fba101f0780 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.445+0000 7fba0cff9640 1 -- 172.21.15.2:0/177625457 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0800f040 con 0x7fba101f0780 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.445+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba100aa260 con 0x7fba101f0780 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.445+0000 7fba0cff9640 1 -- 172.21.15.2:0/177625457 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08015430 con 0x7fba101f0780 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.445+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba100a9320 con 0x7fba101f0780 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.446+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba100aa780 con 0x7fba101f0780 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.446+0000 7fba0cff9640 1 -- 172.21.15.2:0/177625457 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba08015590 con 0x7fba101f0780 2023-11-25T04:09:29.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.447+0000 7fba0cff9640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb9f006ae40 0x7fb9f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.447+0000 7fba0ffff640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb9f006ae40 0x7fb9f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.447+0000 7fba0cff9640 1 -- 172.21.15.2:0/177625457 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fba08089b60 con 0x7fba101f0780 2023-11-25T04:09:29.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.447+0000 7fba0ffff640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb9f006ae40 0x7fb9f006d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8001c90 tx=0x7fb9f8000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:29.453 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.451+0000 7fba0cff9640 1 -- 172.21.15.2:0/177625457 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba100aa780 con 0x7fba101f0780 2023-11-25T04:09:29.697 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.696+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fba100aa780 con 0x7fba101f0780 2023-11-25T04:09:29.699 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.697+0000 7fba0cff9640 1 -- 172.21.15.2:0/177625457 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fba100aa780 con 0x7fba101f0780 2023-11-25T04:09:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb9f006ae40 msgr2=0x7fb9f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb9f006ae40 0x7fb9f006d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb9f8001c90 tx=0x7fb9f8000ed0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.702 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101f0780 msgr2=0x7fba100af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101f0780 0x7fba100af880 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fba100b3310 tx=0x7fba0800f1b0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 shutdown_connections 2023-11-25T04:09:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fba101f0780 0x7fba100af880 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb9f006ae40 0x7fb9f006d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba101f0300 0x7fba100af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 --2- 172.21.15.2:0/177625457 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9fc0047c0 0x7fba100a8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 >> 172.21.15.2:0/177625457 conn(0x7fba1006a8f0 msgr2=0x7fba100b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 shutdown_connections 2023-11-25T04:09:29.703 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.700+0000 7fba16941640 1 -- 172.21.15.2:0/177625457 wait complete. 2023-11-25T04:09:29.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-25T04:09:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.818+0000 7fbb59f53640 1 Processor -- start 2023-11-25T04:09:29.820 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.818+0000 7fbb59f53640 1 -- start start 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb59f53640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb5406a4d0 0x7fbb5406a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb59f53640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb540b4d50 0x7fbb540b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb59f53640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb540b2ee0 con 0x7fbb54144a50 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb59f53640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5406aea0 con 0x7fbb5406a4d0 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb59f53640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb540b34a0 con 0x7fbb540b4d50 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb52ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb5406a4d0 0x7fbb5406a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb52ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbb5406a4d0 0x7fbb5406a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35226/0 (socket says 172.21.15.2:35226) 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb52ffd640 1 -- 172.21.15.2:0/2710181036 learned_addr learned my addr 172.21.15.2:0/2710181036 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb52ffd640 1 -- 172.21.15.2:0/2710181036 >> v2:172.21.15.66:3300/0 conn(0x7fbb540b4d50 msgr2=0x7fbb540b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:29.822 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb53fff640 1 --2- 172.21.15.2:0/2710181036 >> v2:172.21.15.66:3300/0 conn(0x7fbb540b4d50 0x7fbb540b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.819+0000 7fbb52ffd640 1 --2- 172.21.15.2:0/2710181036 >> v2:172.21.15.66:3300/0 conn(0x7fbb540b4d50 0x7fbb540b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.820+0000 7fbb52ffd640 1 -- 172.21.15.2:0/2710181036 >> v1:172.21.15.66:6789/0 conn(0x7fbb54144a50 legacy=0x7fbb5415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.820+0000 7fbb52ffd640 1 -- 172.21.15.2:0/2710181036 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb54144e30 con 0x7fbb5406a4d0 2023-11-25T04:09:29.823 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.820+0000 7fbb53fff640 1 --2- 172.21.15.2:0/2710181036 >> v2:172.21.15.66:3300/0 conn(0x7fbb540b4d50 0x7fbb540b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.820+0000 7fbb52ffd640 1 --2- 172.21.15.2:0/2710181036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 0x7fbb5406a960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb540723b0 tx=0x7fbb4802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46eb2f5ed94a85 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.820+0000 7fbb527fc640 1 -- 172.21.15.2:0/2710181036 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48031870 con 0x7fbb5406a4d0 2023-11-25T04:09:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.820+0000 7fbb527fc640 1 -- 172.21.15.2:0/2710181036 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb480319d0 con 0x7fbb5406a4d0 2023-11-25T04:09:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.820+0000 7fbb527fc640 1 -- 172.21.15.2:0/2710181036 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb48031d60 con 0x7fbb5406a4d0 2023-11-25T04:09:29.824 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.821+0000 7fbb59f53640 1 -- 172.21.15.2:0/2710181036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 msgr2=0x7fbb5406a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.821+0000 7fbb59f53640 1 --2- 172.21.15.2:0/2710181036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 0x7fbb5406a960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb540723b0 tx=0x7fbb4802b910 comp rx=0 tx=0).stop 2023-11-25T04:09:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.821+0000 7fbb59f53640 1 -- 172.21.15.2:0/2710181036 shutdown_connections 2023-11-25T04:09:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.821+0000 7fbb59f53640 1 --2- 172.21.15.2:0/2710181036 >> v2:172.21.15.66:3300/0 conn(0x7fbb540b4d50 0x7fbb540b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.821+0000 7fbb59f53640 1 --2- 172.21.15.2:0/2710181036 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 0x7fbb5406a960 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.821+0000 7fbb59f53640 1 -- 172.21.15.2:0/2710181036 >> 172.21.15.2:0/2710181036 conn(0x7fbb540cc930 msgr2=0x7fbb540ccd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.821+0000 7fbb59f53640 1 -- 172.21.15.2:0/2710181036 shutdown_connections 2023-11-25T04:09:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.821+0000 7fbb59f53640 1 -- 172.21.15.2:0/2710181036 wait complete. 2023-11-25T04:09:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.822+0000 7fbb59f53640 1 Processor -- start 2023-11-25T04:09:29.825 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.822+0000 7fbb59f53640 1 -- start start 2023-11-25T04:09:29.827 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb59f53640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 0x7fbb54143730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb59f53640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb540b4d50 0x7fbb541301e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb59f53640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb54144a50 0x7fbb5415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb59f53640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54131840 con 0x7fbb5406a4d0 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb59f53640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54130bc0 con 0x7fbb54144a50 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb59f53640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54130ea0 con 0x7fbb540b4d50 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 0x7fbb54143730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb537fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 0x7fbb54143730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35230/0 (socket says 172.21.15.2:35230) 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb537fe640 1 -- 172.21.15.2:0/1389063255 learned_addr learned my addr 172.21.15.2:0/1389063255 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb53fff640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb54144a50 0x7fbb5415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.823+0000 7fbb52ffd640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb540b4d50 0x7fbb541301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb537fe640 1 -- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb540b4d50 msgr2=0x7fbb541301e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb537fe640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb540b4d50 0x7fbb541301e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb537fe640 1 -- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb54144a50 msgr2=0x7fbb5415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb537fe640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb54144a50 0x7fbb5415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb537fe640 1 -- 172.21.15.2:0/1389063255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb480094d0 con 0x7fbb5406a4d0 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb53fff640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb54144a50 0x7fbb5415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb52ffd640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb540b4d50 0x7fbb541301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb537fe640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 0x7fbb54143730 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400b3f0 tx=0x7fbb4400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb3bfff640 1 -- 172.21.15.2:0/1389063255 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44011830 con 0x7fbb5406a4d0 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb3bfff640 1 -- 172.21.15.2:0/1389063255 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44011990 con 0x7fbb5406a4d0 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb54131180 con 0x7fbb5406a4d0 2023-11-25T04:09:29.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb3bfff640 1 -- 172.21.15.2:0/1389063255 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44011d40 con 0x7fbb5406a4d0 2023-11-25T04:09:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.824+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb54143c70 con 0x7fbb5406a4d0 2023-11-25T04:09:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.825+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb54143e60 con 0x7fbb5406a4d0 2023-11-25T04:09:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.825+0000 7fbb3bfff640 1 -- 172.21.15.2:0/1389063255 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbb4401a400 con 0x7fbb5406a4d0 2023-11-25T04:09:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.826+0000 7fbb3bfff640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbb4006ae40 0x7fbb4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.826+0000 7fbb3bfff640 1 -- 172.21.15.2:0/1389063255 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbb44089070 con 0x7fbb5406a4d0 2023-11-25T04:09:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.826+0000 7fbb52ffd640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbb4006ae40 0x7fbb4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:29.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.826+0000 7fbb52ffd640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbb4006ae40 0x7fbb4006d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbb48036000 tx=0x7fbb4803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:29.835 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:29.830+0000 7fbb3bfff640 1 -- 172.21.15.2:0/1389063255 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbb44054500 con 0x7fbb5406a4d0 2023-11-25T04:09:30.075 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.073+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fbb5406e6a0 con 0x7fbb5406a4d0 2023-11-25T04:09:30.077 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.075+0000 7fbb3bfff640 1 -- 172.21.15.2:0/1389063255 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fbb44057b20 con 0x7fbb5406a4d0 2023-11-25T04:09:30.079 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbb4006ae40 msgr2=0x7fbb4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbb4006ae40 0x7fbb4006d300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbb48036000 tx=0x7fbb4803c040 comp rx=0 tx=0).stop 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 msgr2=0x7fbb54143730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 0x7fbb54143730 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400b3f0 tx=0x7fbb4400b8b0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 shutdown_connections 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbb4006ae40 0x7fbb4006d300 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb54144a50 0x7fbb5415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb540b4d50 0x7fbb541301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 --2- 172.21.15.2:0/1389063255 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbb5406a4d0 0x7fbb54143730 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.077+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 >> 172.21.15.2:0/1389063255 conn(0x7fbb540cc930 msgr2=0x7fbb540b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:30.080 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.078+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 shutdown_connections 2023-11-25T04:09:30.081 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.078+0000 7fbb59f53640 1 -- 172.21.15.2:0/1389063255 wait complete. 2023-11-25T04:09:30.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-25T04:09:30.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.196+0000 7f16e13e3640 1 Processor -- start 2023-11-25T04:09:30.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.196+0000 7f16e13e3640 1 -- start start 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16e13e3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16dc160b70 0x7f16dc0d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16e13e3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc0cef00 0x7f16dc161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16e13e3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16dc0ce360 con 0x7f16dc0b2aa0 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16e13e3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16dc0b2f20 con 0x7f16dc160b70 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16e13e3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc0cdd50 con 0x7f16dc0cef00 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16db7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc0cef00 0x7f16dc161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16daffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16dc160b70 0x7f16dc0d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16da7fc640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f16dc0b2aa0 0x7f16dc0ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:55856/0 (socket says 172.21.15.2:55856) 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16db7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc0cef00 0x7f16dc161230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.2:46440/0 (socket says 172.21.15.2:46440) 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.197+0000 7f16da7fc640 1 -- 172.21.15.2:0/1736830135 learned_addr learned my addr 172.21.15.2:0/1736830135 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:30.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.198+0000 7f16daffd640 1 -- 172.21.15.2:0/1736830135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc0cef00 msgr2=0x7f16dc161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.198+0000 7f16daffd640 1 --2- 172.21.15.2:0/1736830135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc0cef00 0x7f16dc161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.198+0000 7f16daffd640 1 -- 172.21.15.2:0/1736830135 >> v1:172.21.15.66:6789/0 conn(0x7f16dc0b2aa0 legacy=0x7f16dc0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.198+0000 7f16daffd640 1 -- 172.21.15.2:0/1736830135 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc0d1c70 con 0x7f16dc160b70 2023-11-25T04:09:30.201 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.198+0000 7f16db7fe640 1 --2- 172.21.15.2:0/1736830135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc0cef00 0x7f16dc161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:09:30.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16daffd640 1 --2- 172.21.15.2:0/1736830135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16dc160b70 0x7f16dc0d1570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f16d40097a0 tx=0x7f16d402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=469e8fe10d770913 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:30.202 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16d9ffb640 1 -- 172.21.15.2:0/1736830135 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4031830 con 0x7f16dc160b70 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16d9ffb640 1 -- 172.21.15.2:0/1736830135 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d4031990 con 0x7f16dc160b70 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16d9ffb640 1 -- 172.21.15.2:0/1736830135 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4031d20 con 0x7f16dc160b70 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16e13e3640 1 -- 172.21.15.2:0/1736830135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16dc160b70 msgr2=0x7f16dc0d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16e13e3640 1 --2- 172.21.15.2:0/1736830135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16dc160b70 0x7f16dc0d1570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f16d40097a0 tx=0x7f16d402b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16e13e3640 1 -- 172.21.15.2:0/1736830135 shutdown_connections 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16e13e3640 1 --2- 172.21.15.2:0/1736830135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc0cef00 0x7f16dc161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16e13e3640 1 --2- 172.21.15.2:0/1736830135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16dc160b70 0x7f16dc0d1570 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16e13e3640 1 -- 172.21.15.2:0/1736830135 >> 172.21.15.2:0/1736830135 conn(0x7f16dc09c470 msgr2=0x7f16dc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16e13e3640 1 -- 172.21.15.2:0/1736830135 shutdown_connections 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.199+0000 7f16e13e3640 1 -- 172.21.15.2:0/1736830135 wait complete. 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.201+0000 7f16e13e3640 1 Processor -- start 2023-11-25T04:09:30.203 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.201+0000 7f16e13e3640 1 -- start start 2023-11-25T04:09:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.201+0000 7f16e13e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16dc0b2aa0 0x7f16dc14a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.201+0000 7f16e13e3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16dc0cef00 0x7f16dc15fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.201+0000 7f16e13e3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc160b70 0x7f16dc15b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.201+0000 7f16e13e3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc158940 con 0x7f16dc0cef00 2023-11-25T04:09:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.201+0000 7f16e13e3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc14aa90 con 0x7f16dc0b2aa0 2023-11-25T04:09:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.201+0000 7f16e13e3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16dc15cf00 con 0x7f16dc160b70 2023-11-25T04:09:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.201+0000 7f16da7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16dc0cef00 0x7f16dc15fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.207 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16da7fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16dc0cef00 0x7f16dc15fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35246/0 (socket says 172.21.15.2:35246) 2023-11-25T04:09:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16da7fc640 1 -- 172.21.15.2:0/3147096058 learned_addr learned my addr 172.21.15.2:0/3147096058 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16daffd640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16dc0b2aa0 0x7f16dc14a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16db7fe640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc160b70 0x7f16dc15b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16da7fc640 1 -- 172.21.15.2:0/3147096058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc160b70 msgr2=0x7f16dc15b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16da7fc640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc160b70 0x7f16dc15b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16da7fc640 1 -- 172.21.15.2:0/3147096058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16dc0b2aa0 msgr2=0x7f16dc14a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16da7fc640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16dc0b2aa0 0x7f16dc14a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16da7fc640 1 -- 172.21.15.2:0/3147096058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc009a70 con 0x7f16dc0cef00 2023-11-25T04:09:30.208 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16da7fc640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16dc0cef00 0x7f16dc15fd70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f16c400c4b0 tx=0x7f16c400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16d37fe640 1 -- 172.21.15.2:0/3147096058 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4005ce0 con 0x7f16dc0cef00 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16d37fe640 1 -- 172.21.15.2:0/3147096058 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c4005e40 con 0x7f16dc0cef00 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16d37fe640 1 -- 172.21.15.2:0/3147096058 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c4007270 con 0x7f16dc0cef00 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d4009400 con 0x7f16dc0cef00 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.202+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16dc15d4c0 con 0x7f16dc0cef00 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.203+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16dc0a1150 con 0x7f16dc0cef00 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.204+0000 7f16d37fe640 1 -- 172.21.15.2:0/3147096058 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16c40073d0 con 0x7f16dc0cef00 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.204+0000 7f16d37fe640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f16bc06ae70 0x7f16bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.204+0000 7f16d37fe640 1 -- 172.21.15.2:0/3147096058 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f16c4088650 con 0x7f16dc0cef00 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.204+0000 7f16daffd640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f16bc06ae70 0x7f16bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.209 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.205+0000 7f16daffd640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f16bc06ae70 0x7f16bc06d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16d4036000 tx=0x7f16d403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:30.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.209+0000 7f16d37fe640 1 -- 172.21.15.2:0/3147096058 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f16c4053b90 con 0x7f16dc0cef00 2023-11-25T04:09:30.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.457+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f16dc0b22d0 con 0x7f16dc0cef00 2023-11-25T04:09:30.460 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.458+0000 7f16d37fe640 1 -- 172.21.15.2:0/3147096058 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f16c40170a0 con 0x7f16dc0cef00 2023-11-25T04:09:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f16bc06ae70 msgr2=0x7f16bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f16bc06ae70 0x7f16bc06d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16d4036000 tx=0x7f16d403c040 comp rx=0 tx=0).stop 2023-11-25T04:09:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16dc0cef00 msgr2=0x7f16dc15fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16dc0cef00 0x7f16dc15fd70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f16c400c4b0 tx=0x7f16c400c970 comp rx=0 tx=0).stop 2023-11-25T04:09:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 shutdown_connections 2023-11-25T04:09:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f16dc160b70 0x7f16dc15b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f16dc0cef00 0x7f16dc15fd70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f16bc06ae70 0x7f16bc06d330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.463 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 --2- 172.21.15.2:0/3147096058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16dc0b2aa0 0x7f16dc14a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 >> 172.21.15.2:0/3147096058 conn(0x7f16dc09c470 msgr2=0x7f16dc06b370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 shutdown_connections 2023-11-25T04:09:30.464 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.461+0000 7f16e13e3640 1 -- 172.21.15.2:0/3147096058 wait complete. 2023-11-25T04:09:30.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-25T04:09:30.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.579+0000 7f113de83640 1 Processor -- start 2023-11-25T04:09:30.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.579+0000 7f113de83640 1 -- start start 2023-11-25T04:09:30.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f113de83640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f11380ce800 0x7f113815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f113de83640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11380702e0 0x7f1138070740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f113de83640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f113806d120 0x7f113806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f113de83640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113806db10 con 0x7f11380702e0 2023-11-25T04:09:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f113de83640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113815abf0 con 0x7f11380ce800 2023-11-25T04:09:30.591 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f113de83640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11380cebe0 con 0x7f113806d120 2023-11-25T04:09:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f1136ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11380702e0 0x7f1138070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f1136ffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f11380702e0 0x7f1138070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35262/0 (socket says 172.21.15.2:35262) 2023-11-25T04:09:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f1136ffd640 1 -- 172.21.15.2:0/3873662803 learned_addr learned my addr 172.21.15.2:0/3873662803 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f11377fe640 1 --2- 172.21.15.2:0/3873662803 >> v2:172.21.15.66:3300/0 conn(0x7f11380ce800 0x7f113815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.592 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.580+0000 7f1137fff640 1 --2- 172.21.15.2:0/3873662803 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f113806d120 0x7f113806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.581+0000 7f1136ffd640 1 -- 172.21.15.2:0/3873662803 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f113806d120 msgr2=0x7f113806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.581+0000 7f1136ffd640 1 --2- 172.21.15.2:0/3873662803 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f113806d120 0x7f113806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.581+0000 7f1136ffd640 1 -- 172.21.15.2:0/3873662803 >> v2:172.21.15.66:3300/0 conn(0x7f11380ce800 msgr2=0x7f113815a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.581+0000 7f1136ffd640 1 --2- 172.21.15.2:0/3873662803 >> v2:172.21.15.66:3300/0 conn(0x7f11380ce800 0x7f113815a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.593 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.581+0000 7f1136ffd640 1 -- 172.21.15.2:0/3873662803 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138070da0 con 0x7f11380702e0 2023-11-25T04:09:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.581+0000 7f1136ffd640 1 --2- 172.21.15.2:0/3873662803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11380702e0 0x7f1138070740 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f11380726d0 tx=0x7f112c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91a8c771791510d server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f11367fc640 1 -- 172.21.15.2:0/3873662803 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c0317e0 con 0x7f11380702e0 2023-11-25T04:09:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f11367fc640 1 -- 172.21.15.2:0/3873662803 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112c031940 con 0x7f11380702e0 2023-11-25T04:09:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f11367fc640 1 -- 172.21.15.2:0/3873662803 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112c031cd0 con 0x7f11380702e0 2023-11-25T04:09:30.594 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f113de83640 1 -- 172.21.15.2:0/3873662803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11380702e0 msgr2=0x7f1138070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f113de83640 1 --2- 172.21.15.2:0/3873662803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11380702e0 0x7f1138070740 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f11380726d0 tx=0x7f112c02b880 comp rx=0 tx=0).stop 2023-11-25T04:09:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f113de83640 1 -- 172.21.15.2:0/3873662803 shutdown_connections 2023-11-25T04:09:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f113de83640 1 --2- 172.21.15.2:0/3873662803 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f113806d120 0x7f113806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f113de83640 1 --2- 172.21.15.2:0/3873662803 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f11380702e0 0x7f1138070740 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f113de83640 1 --2- 172.21.15.2:0/3873662803 >> v2:172.21.15.66:3300/0 conn(0x7f11380ce800 0x7f113815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.595 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f113de83640 1 -- 172.21.15.2:0/3873662803 >> 172.21.15.2:0/3873662803 conn(0x7f113806a8f0 msgr2=0x7f113806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f113de83640 1 -- 172.21.15.2:0/3873662803 shutdown_connections 2023-11-25T04:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.582+0000 7f113de83640 1 -- 172.21.15.2:0/3873662803 wait complete. 2023-11-25T04:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.583+0000 7f113de83640 1 Processor -- start 2023-11-25T04:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f113de83640 1 -- start start 2023-11-25T04:09:30.596 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f113de83640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f113806d120 0x7f11381f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f113de83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11380702e0 0x7f113814c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f113de83640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11380ce800 0x7f1138152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f113de83640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113814d870 con 0x7f113806d120 2023-11-25T04:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f113de83640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113814cc60 con 0x7f11380702e0 2023-11-25T04:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f113de83640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113814cf40 con 0x7f11380ce800 2023-11-25T04:09:30.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f11377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f113806d120 0x7f11381f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f11377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f113806d120 0x7f11381f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35270/0 (socket says 172.21.15.2:35270) 2023-11-25T04:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.584+0000 7f11377fe640 1 -- 172.21.15.2:0/3544845 learned_addr learned my addr 172.21.15.2:0/3544845 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f1136ffd640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11380702e0 0x7f113814c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f1137fff640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11380ce800 0x7f1138152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f11377fe640 1 -- 172.21.15.2:0/3544845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11380ce800 msgr2=0x7f1138152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.598 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f11377fe640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11380ce800 0x7f1138152ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f11377fe640 1 -- 172.21.15.2:0/3544845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11380702e0 msgr2=0x7f113814c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f11377fe640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11380702e0 0x7f113814c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f11377fe640 1 -- 172.21.15.2:0/3544845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0094d0 con 0x7f113806d120 2023-11-25T04:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f11377fe640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f113806d120 0x7f11381f5cb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f112800e9b0 tx=0x7f112800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f111ffff640 1 -- 172.21.15.2:0/3544845 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1128009670 con 0x7f113806d120 2023-11-25T04:09:30.599 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f111ffff640 1 -- 172.21.15.2:0/3544845 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112800c9a0 con 0x7f113806d120 2023-11-25T04:09:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113814d220 con 0x7f113806d120 2023-11-25T04:09:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f111ffff640 1 -- 172.21.15.2:0/3544845 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112800cd50 con 0x7f113806d120 2023-11-25T04:09:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.585+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11380b0400 con 0x7f113806d120 2023-11-25T04:09:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.586+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1138159b90 con 0x7f113806d120 2023-11-25T04:09:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.586+0000 7f111ffff640 1 -- 172.21.15.2:0/3544845 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1128013470 con 0x7f113806d120 2023-11-25T04:09:30.600 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.587+0000 7f111ffff640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f112406ae70 0x7f112406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.587+0000 7f111ffff640 1 -- 172.21.15.2:0/3544845 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1128089440 con 0x7f113806d120 2023-11-25T04:09:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.587+0000 7f1136ffd640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f112406ae70 0x7f112406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.601 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.587+0000 7f1136ffd640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f112406ae70 0x7f112406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f112c036000 tx=0x7f112c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:30.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.591+0000 7f111ffff640 1 -- 172.21.15.2:0/3544845 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1138159b90 con 0x7f113806d120 2023-11-25T04:09:30.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.835+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f1138159b90 con 0x7f113806d120 2023-11-25T04:09:30.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.837+0000 7f111ffff640 1 -- 172.21.15.2:0/3544845 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1138159b90 con 0x7f113806d120 2023-11-25T04:09:30.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f112406ae70 msgr2=0x7f112406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f112406ae70 0x7f112406d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f112c036000 tx=0x7f112c03d040 comp rx=0 tx=0).stop 2023-11-25T04:09:30.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f113806d120 msgr2=0x7f11381f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f113806d120 0x7f11381f5cb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f112800e9b0 tx=0x7f112800ee70 comp rx=0 tx=0).stop 2023-11-25T04:09:30.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 shutdown_connections 2023-11-25T04:09:30.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11380ce800 0x7f1138152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.845 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f112406ae70 0x7f112406d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11380702e0 0x7f113814c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 --2- 172.21.15.2:0/3544845 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f113806d120 0x7f11381f5cb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.838+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 >> 172.21.15.2:0/3544845 conn(0x7f113806a8f0 msgr2=0x7f1138071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:30.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.839+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 shutdown_connections 2023-11-25T04:09:30.846 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.839+0000 7f113de83640 1 -- 172.21.15.2:0/3544845 wait complete. 2023-11-25T04:09:30.851 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:30.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.956+0000 7f0130ba0640 1 Processor -- start 2023-11-25T04:09:30.958 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.956+0000 7f0130ba0640 1 -- start start 2023-11-25T04:09:30.959 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f0130ba0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c1609b0 0x7f012c0cfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f0130ba0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f012c0cffc0 0x7f012c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f0130ba0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c0d0420 con 0x7f012c0d1430 2023-11-25T04:09:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f0130ba0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012c0d2220 con 0x7f012c0cffc0 2023-11-25T04:09:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f0130ba0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c0b29f0 con 0x7f012c1609b0 2023-11-25T04:09:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f012bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f012c0cffc0 0x7f012c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f012bfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f012c0cffc0 0x7f012c0cec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35280/0 (socket says 172.21.15.2:35280) 2023-11-25T04:09:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f012bfff640 1 -- 172.21.15.2:0/357039277 learned_addr learned my addr 172.21.15.2:0/357039277 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f012b7fe640 1 --2- 172.21.15.2:0/357039277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c1609b0 0x7f012c0cfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.960 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f012bfff640 1 -- 172.21.15.2:0/357039277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c1609b0 msgr2=0x7f012c0cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:30.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f012bfff640 1 --2- 172.21.15.2:0/357039277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c1609b0 0x7f012c0cfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f012bfff640 1 -- 172.21.15.2:0/357039277 >> v1:172.21.15.66:6789/0 conn(0x7f012c0d1430 legacy=0x7f012c0b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.961 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.957+0000 7f012bfff640 1 -- 172.21.15.2:0/357039277 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0d1980 con 0x7f012c0cffc0 2023-11-25T04:09:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.958+0000 7f012bfff640 1 --2- 172.21.15.2:0/357039277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0cffc0 0x7f012c0cec90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0124009e50 tx=0x7f012402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bde6600fc7db62e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:30.962 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.958+0000 7f012a7fc640 1 -- 172.21.15.2:0/357039277 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012402caf0 con 0x7f012c0cffc0 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.958+0000 7f012a7fc640 1 -- 172.21.15.2:0/357039277 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012402cc50 con 0x7f012c0cffc0 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.958+0000 7f012a7fc640 1 -- 172.21.15.2:0/357039277 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01240343f0 con 0x7f012c0cffc0 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.959+0000 7f0130ba0640 1 -- 172.21.15.2:0/357039277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0cffc0 msgr2=0x7f012c0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.959+0000 7f0130ba0640 1 --2- 172.21.15.2:0/357039277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0cffc0 0x7f012c0cec90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0124009e50 tx=0x7f012402bf50 comp rx=0 tx=0).stop 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.959+0000 7f0130ba0640 1 -- 172.21.15.2:0/357039277 shutdown_connections 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.959+0000 7f0130ba0640 1 --2- 172.21.15.2:0/357039277 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0cffc0 0x7f012c0cec90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.959+0000 7f0130ba0640 1 --2- 172.21.15.2:0/357039277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c1609b0 0x7f012c0cfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.959+0000 7f0130ba0640 1 -- 172.21.15.2:0/357039277 >> 172.21.15.2:0/357039277 conn(0x7f012c09c3c0 msgr2=0x7f012c0d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.959+0000 7f0130ba0640 1 -- 172.21.15.2:0/357039277 shutdown_connections 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.959+0000 7f0130ba0640 1 -- 172.21.15.2:0/357039277 wait complete. 2023-11-25T04:09:30.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.960+0000 7f0130ba0640 1 Processor -- start 2023-11-25T04:09:30.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.960+0000 7f0130ba0640 1 -- start start 2023-11-25T04:09:30.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f0130ba0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c0cffc0 0x7f012c0c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f0130ba0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0d1430 0x7f012c14f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f0130ba0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f012c1609b0 0x7f012c14fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f0130ba0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c0c92e0 con 0x7f012c0d1430 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f0130ba0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c14d3a0 con 0x7f012c1609b0 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f0130ba0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c0c8660 con 0x7f012c0cffc0 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0d1430 0x7f012c14f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012affd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0d1430 0x7f012c14f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35290/0 (socket says 172.21.15.2:35290) 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012affd640 1 -- 172.21.15.2:0/2910682609 learned_addr learned my addr 172.21.15.2:0/2910682609 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012bfff640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f012c1609b0 0x7f012c14fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.967 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012b7fe640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c0cffc0 0x7f012c0c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012affd640 1 -- 172.21.15.2:0/2910682609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c0cffc0 msgr2=0x7f012c0c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012affd640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c0cffc0 0x7f012c0c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012affd640 1 -- 172.21.15.2:0/2910682609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f012c1609b0 msgr2=0x7f012c14fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012affd640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f012c1609b0 0x7f012c14fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.961+0000 7f012affd640 1 -- 172.21.15.2:0/2910682609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124009b30 con 0x7f012c0d1430 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.962+0000 7f012affd640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0d1430 0x7f012c14f620 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f012000c450 tx=0x7f012000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.962+0000 7f0113fff640 1 -- 172.21.15.2:0/2910682609 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01200052d0 con 0x7f012c0d1430 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.962+0000 7f0113fff640 1 -- 172.21.15.2:0/2910682609 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0120005430 con 0x7f012c0d1430 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.962+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c0c8940 con 0x7f012c0d1430 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.962+0000 7f0113fff640 1 -- 172.21.15.2:0/2910682609 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0120012870 con 0x7f012c0d1430 2023-11-25T04:09:30.968 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.962+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c0c8f00 con 0x7f012c0d1430 2023-11-25T04:09:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.963+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012c0c9420 con 0x7f012c0d1430 2023-11-25T04:09:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.963+0000 7f0113fff640 1 -- 172.21.15.2:0/2910682609 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f01200129d0 con 0x7f012c0d1430 2023-11-25T04:09:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.964+0000 7f0113fff640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f011806ae40 0x7f011806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.964+0000 7f012b7fe640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f011806ae40 0x7f011806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.964+0000 7f0113fff640 1 -- 172.21.15.2:0/2910682609 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0120088c20 con 0x7f012c0d1430 2023-11-25T04:09:30.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.964+0000 7f012b7fe640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f011806ae40 0x7f011806d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f011c006fd0 tx=0x7f011c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:30.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:30.968+0000 7f0113fff640 1 -- 172.21.15.2:0/2910682609 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f012c0c9420 con 0x7f012c0d1430 2023-11-25T04:09:31.144 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.142+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f012c0c9420 con 0x7f012c0d1430 2023-11-25T04:09:31.145 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.143+0000 7f0113fff640 1 -- 172.21.15.2:0/2910682609 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12749 (secure 0 0 0) 0x7f012c0c9420 con 0x7f012c0d1430 2023-11-25T04:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:31.145 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":29,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:09:28.176691+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f011806ae40 msgr2=0x7f011806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.147 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f011806ae40 0x7f011806d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f011c006fd0 tx=0x7f011c008040 comp rx=0 tx=0).stop 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0d1430 msgr2=0x7f012c14f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0d1430 0x7f012c14f620 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f012000c450 tx=0x7f012000c910 comp rx=0 tx=0).stop 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 shutdown_connections 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f011806ae40 0x7f011806d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f012c1609b0 0x7f012c14fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f012c0d1430 0x7f012c14f620 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 --2- 172.21.15.2:0/2910682609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f012c0cffc0 0x7f012c0c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 >> 172.21.15.2:0/2910682609 conn(0x7f012c09c3c0 msgr2=0x7f012c15efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 shutdown_connections 2023-11-25T04:09:31.148 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.145+0000 7f0130ba0640 1 -- 172.21.15.2:0/2910682609 wait complete. 2023-11-25T04:09:31.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-25T04:08:23.531706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-25T04:09:31.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-25T04:09:31.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.267+0000 7f6690461640 1 Processor -- start 2023-11-25T04:09:31.269 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.267+0000 7f6690461640 1 -- start start 2023-11-25T04:09:31.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.267+0000 7f6690461640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f66880b6b50 0x7f66880cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f6690461640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f668806bc50 0x7f668806c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f6690461640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66880b3590 con 0x7f6688099970 2023-11-25T04:09:31.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f6690461640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668806b310 con 0x7f668806bc50 2023-11-25T04:09:31.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f6690461640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880cd3a0 con 0x7f66880b6b50 2023-11-25T04:09:31.270 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f668e9fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f668806bc50 0x7f668806c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f668e9fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f668806bc50 0x7f668806c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35298/0 (socket says 172.21.15.2:35298) 2023-11-25T04:09:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f668e9fe640 1 -- 172.21.15.2:0/3081677307 learned_addr learned my addr 172.21.15.2:0/3081677307 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f668e1fd640 1 --2- 172.21.15.2:0/3081677307 >> v2:172.21.15.66:3300/0 conn(0x7f66880b6b50 0x7f66880cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f668e9fe640 1 -- 172.21.15.2:0/3081677307 >> v2:172.21.15.66:3300/0 conn(0x7f66880b6b50 msgr2=0x7f66880cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f668e9fe640 1 --2- 172.21.15.2:0/3081677307 >> v2:172.21.15.66:3300/0 conn(0x7f66880b6b50 0x7f66880cfd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f668e9fe640 1 -- 172.21.15.2:0/3081677307 >> v1:172.21.15.66:6789/0 conn(0x7f6688099970 legacy=0x7f6688099d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.271 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.268+0000 7f668e9fe640 1 -- 172.21.15.2:0/3081677307 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880b37c0 con 0x7f668806bc50 2023-11-25T04:09:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.269+0000 7f668e9fe640 1 --2- 172.21.15.2:0/3081677307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 0x7f668806c100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6688071790 tx=0x7f668002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a048d6241aa50402 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.269+0000 7f668d1fb640 1 -- 172.21.15.2:0/3081677307 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668002cbb0 con 0x7f668806bc50 2023-11-25T04:09:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.269+0000 7f668d1fb640 1 -- 172.21.15.2:0/3081677307 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668002cd10 con 0x7f668806bc50 2023-11-25T04:09:31.272 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.269+0000 7f668d1fb640 1 -- 172.21.15.2:0/3081677307 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680034610 con 0x7f668806bc50 2023-11-25T04:09:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.269+0000 7f6690461640 1 -- 172.21.15.2:0/3081677307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 msgr2=0x7f668806c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.269+0000 7f6690461640 1 --2- 172.21.15.2:0/3081677307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 0x7f668806c100 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f6688071790 tx=0x7f668002c010 comp rx=0 tx=0).stop 2023-11-25T04:09:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.270+0000 7f6690461640 1 -- 172.21.15.2:0/3081677307 shutdown_connections 2023-11-25T04:09:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.270+0000 7f6690461640 1 --2- 172.21.15.2:0/3081677307 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 0x7f668806c100 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.270+0000 7f6690461640 1 --2- 172.21.15.2:0/3081677307 >> v2:172.21.15.66:3300/0 conn(0x7f66880b6b50 0x7f66880cfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.270+0000 7f6690461640 1 -- 172.21.15.2:0/3081677307 >> 172.21.15.2:0/3081677307 conn(0x7f66880b2a70 msgr2=0x7f66880b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.270+0000 7f6690461640 1 -- 172.21.15.2:0/3081677307 shutdown_connections 2023-11-25T04:09:31.273 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.270+0000 7f6690461640 1 -- 172.21.15.2:0/3081677307 wait complete. 2023-11-25T04:09:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.271+0000 7f6690461640 1 Processor -- start 2023-11-25T04:09:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.271+0000 7f6690461640 1 -- start start 2023-11-25T04:09:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f6690461640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 0x7f668815d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.275 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f6690461640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6688099970 0x7f66880adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f6690461640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f66880b6b50 0x7f66880ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f6690461640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6688152c40 con 0x7f668806bc50 2023-11-25T04:09:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f6690461640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668815ef90 con 0x7f6688099970 2023-11-25T04:09:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f6690461640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668815da40 con 0x7f66880b6b50 2023-11-25T04:09:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668e1fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 0x7f668815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668e1fd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 0x7f668815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35314/0 (socket says 172.21.15.2:35314) 2023-11-25T04:09:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668e1fd640 1 -- 172.21.15.2:0/676659963 learned_addr learned my addr 172.21.15.2:0/676659963 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:31.276 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668e1fd640 1 -- 172.21.15.2:0/676659963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f66880b6b50 msgr2=0x7f66880ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668e1fd640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f66880b6b50 0x7f66880ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668e1fd640 1 -- 172.21.15.2:0/676659963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6688099970 msgr2=0x7f66880adbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668d9fc640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6688099970 0x7f66880adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668e1fd640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6688099970 0x7f66880adbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668e1fd640 1 -- 172.21.15.2:0/676659963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680009b30 con 0x7f668806bc50 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f668e1fd640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 0x7f668815d460 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f668400d5f0 tx=0x7f668400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f667effd640 1 -- 172.21.15.2:0/676659963 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66840125f0 con 0x7f668806bc50 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f667effd640 1 -- 172.21.15.2:0/676659963 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6684012750 con 0x7f668806bc50 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668815dd20 con 0x7f668806bc50 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f667effd640 1 -- 172.21.15.2:0/676659963 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684012b00 con 0x7f668806bc50 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.272+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668815e2e0 con 0x7f668806bc50 2023-11-25T04:09:31.277 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.274+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668809ef40 con 0x7f668806bc50 2023-11-25T04:09:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.274+0000 7f667effd640 1 -- 172.21.15.2:0/676659963 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6684012c60 con 0x7f668806bc50 2023-11-25T04:09:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.274+0000 7f667effd640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f666c06ae40 0x7f666c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.278 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.275+0000 7f668d9fc640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f666c06ae40 0x7f666c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.275+0000 7f667effd640 1 -- 172.21.15.2:0/676659963 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6684089700 con 0x7f668806bc50 2023-11-25T04:09:31.279 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.275+0000 7f668d9fc640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f666c06ae40 0x7f666c06d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f66880ae3e0 tx=0x7f6678009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:31.280 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.279+0000 7f667effd640 1 -- 172.21.15.2:0/676659963 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6684054b90 con 0x7f668806bc50 2023-11-25T04:09:31.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.453+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f668804e920 con 0x7f668806bc50 2023-11-25T04:09:31.455 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.453+0000 7f667effd640 1 -- 172.21.15.2:0/676659963 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66840581b0 con 0x7f668806bc50 2023-11-25T04:09:31.455 INFO:teuthology.orchestra.run.smithi002.stdout:pg_num: 1 2023-11-25T04:09:31.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f666c06ae40 msgr2=0x7f666c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f666c06ae40 0x7f666c06d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f66880ae3e0 tx=0x7f6678009040 comp rx=0 tx=0).stop 2023-11-25T04:09:31.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 msgr2=0x7f668815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.457 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 0x7f668815d460 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f668400d5f0 tx=0x7f668400dab0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 shutdown_connections 2023-11-25T04:09:31.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f66880b6b50 0x7f66880ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f666c06ae40 0x7f666c06d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6688099970 0x7f66880adbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 --2- 172.21.15.2:0/676659963 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f668806bc50 0x7f668815d460 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 >> 172.21.15.2:0/676659963 conn(0x7f66880b2a70 msgr2=0x7f66880cc390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:31.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 shutdown_connections 2023-11-25T04:09:31.458 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.455+0000 7f6690461640 1 -- 172.21.15.2:0/676659963 wait complete. 2023-11-25T04:09:31.468 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-25T04:09:31.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.572+0000 7fe6621c9640 1 Processor -- start 2023-11-25T04:09:31.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.573+0000 7fe6621c9640 1 -- start start 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.573+0000 7fe6621c9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe65c15d3e0 0x7fe65c0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.573+0000 7fe6621c9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0b5f90 con 0x7fe65c0d1e30 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.573+0000 7fe6621c9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe65c0b61e0 con 0x7fe65c0ced30 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.573+0000 7fe6621c9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe65c0cf170 con 0x7fe65c15d3e0 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.573+0000 7fe65b7fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fe65c15d3e0 0x7fe65c0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.573+0000 7fe65bfff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fe65c0d1e30 0x7fe65c0b3db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42894/0 (socket says 172.21.15.2:42894) 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.573+0000 7fe65bfff640 1 -- 172.21.15.2:0/2637943830 learned_addr learned my addr 172.21.15.2:0/2637943830 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.574+0000 7fe65b7fe640 1 -- 172.21.15.2:0/2637943830 >> v1:172.21.15.66:6789/0 conn(0x7fe65c0ced30 legacy=0x7fe65c0d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.574+0000 7fe65b7fe640 1 -- 172.21.15.2:0/2637943830 >> v1:172.21.15.2:6789/0 conn(0x7fe65c0d1e30 legacy=0x7fe65c0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.574+0000 7fe65a7fc640 1 -- 172.21.15.2:0/2637943830 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819186379 0 0) 0x7fe65c0b5f90 con 0x7fe65c0d1e30 2023-11-25T04:09:31.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.574+0000 7fe65b7fe640 1 -- 172.21.15.2:0/2637943830 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0b64c0 con 0x7fe65c15d3e0 2023-11-25T04:09:31.577 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe65b7fe640 1 --2- 172.21.15.2:0/2637943830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c15d3e0 0x7fe65c0ce7f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097a0 tx=0x7fe64c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3e82d151066814 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe65a7fc640 1 -- 172.21.15.2:0/2637943830 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c030610 con 0x7fe65c15d3e0 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe65a7fc640 1 -- 172.21.15.2:0/2637943830 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c030770 con 0x7fe65c15d3e0 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe65a7fc640 1 -- 172.21.15.2:0/2637943830 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c030b00 con 0x7fe65c15d3e0 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe6621c9640 1 -- 172.21.15.2:0/2637943830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c15d3e0 msgr2=0x7fe65c0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe6621c9640 1 --2- 172.21.15.2:0/2637943830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c15d3e0 0x7fe65c0ce7f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0097a0 tx=0x7fe64c02b960 comp rx=0 tx=0).stop 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe6621c9640 1 -- 172.21.15.2:0/2637943830 shutdown_connections 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe6621c9640 1 --2- 172.21.15.2:0/2637943830 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c15d3e0 0x7fe65c0ce7f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe6621c9640 1 -- 172.21.15.2:0/2637943830 >> 172.21.15.2:0/2637943830 conn(0x7fe65c09c480 msgr2=0x7fe65c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe6621c9640 1 -- 172.21.15.2:0/2637943830 shutdown_connections 2023-11-25T04:09:31.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.575+0000 7fe6621c9640 1 -- 172.21.15.2:0/2637943830 wait complete. 2023-11-25T04:09:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.576+0000 7fe6621c9640 1 Processor -- start 2023-11-25T04:09:31.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe6621c9640 1 -- start start 2023-11-25T04:09:31.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe6621c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c0ced30 0x7fe65c14aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe6621c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe65c0d1e30 0x7fe65c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe6621c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe65c15d3e0 0x7fe65c06c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe6621c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c14c210 con 0x7fe65c0ced30 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe6621c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c14c4f0 con 0x7fe65c15d3e0 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe6621c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe65c14c7d0 con 0x7fe65c0d1e30 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe65b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c0ced30 0x7fe65c14aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe65b7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c0ced30 0x7fe65c14aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35332/0 (socket says 172.21.15.2:35332) 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.577+0000 7fe65b7fe640 1 -- 172.21.15.2:0/2289041540 learned_addr learned my addr 172.21.15.2:0/2289041540 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe65bfff640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe65c15d3e0 0x7fe65c06c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe65affd640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe65c0d1e30 0x7fe65c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe65b7fe640 1 -- 172.21.15.2:0/2289041540 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe65c0d1e30 msgr2=0x7fe65c14b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe65b7fe640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe65c0d1e30 0x7fe65c14b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe65b7fe640 1 -- 172.21.15.2:0/2289041540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe65c15d3e0 msgr2=0x7fe65c06c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe65b7fe640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe65c15d3e0 0x7fe65c06c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe65b7fe640 1 -- 172.21.15.2:0/2289041540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c009400 con 0x7fe65c0ced30 2023-11-25T04:09:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe65bfff640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe65c15d3e0 0x7fe65c06c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe65b7fe640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c0ced30 0x7fe65c14aec0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0098c0 tx=0x7fe64c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe643fff640 1 -- 172.21.15.2:0/2289041540 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c03e070 con 0x7fe65c0ced30 2023-11-25T04:09:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe643fff640 1 -- 172.21.15.2:0/2289041540 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe64c039800 con 0x7fe65c0ced30 2023-11-25T04:09:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe65c14cab0 con 0x7fe65c0ced30 2023-11-25T04:09:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe643fff640 1 -- 172.21.15.2:0/2289041540 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe64c039bb0 con 0x7fe65c0ced30 2023-11-25T04:09:31.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.578+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe65c14b400 con 0x7fe65c0ced30 2023-11-25T04:09:31.583 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.579+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe65c14cfd0 con 0x7fe65c0ced30 2023-11-25T04:09:31.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.580+0000 7fe643fff640 1 -- 172.21.15.2:0/2289041540 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe64c042070 con 0x7fe65c0ced30 2023-11-25T04:09:31.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.580+0000 7fe643fff640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe64806ae70 0x7fe64806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.580+0000 7fe643fff640 1 -- 172.21.15.2:0/2289041540 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe64c0ab050 con 0x7fe65c0ced30 2023-11-25T04:09:31.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.580+0000 7fe65affd640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe64806ae70 0x7fe64806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.584 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.580+0000 7fe65affd640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe64806ae70 0x7fe64806d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0d1de0 tx=0x7fe650009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:31.586 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.584+0000 7fe643fff640 1 -- 172.21.15.2:0/2289041540 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe65c14cfd0 con 0x7fe65c0ced30 2023-11-25T04:09:31.765 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.763+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe65c14cfd0 con 0x7fe65c0ced30 2023-11-25T04:09:31.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.764+0000 7fe643fff640 1 -- 172.21.15.2:0/2289041540 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe65c14cfd0 con 0x7fe65c0ced30 2023-11-25T04:09:31.766 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:31.766 INFO:teuthology.orchestra.run.smithi002.stdout:[ 2023-11-25T04:09:31.766 INFO:teuthology.orchestra.run.smithi002.stdout: { 2023-11-25T04:09:31.766 INFO:teuthology.orchestra.run.smithi002.stdout: "poolnum": 1, 2023-11-25T04:09:31.766 INFO:teuthology.orchestra.run.smithi002.stdout: "poolname": ".mgr" 2023-11-25T04:09:31.766 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:31.766 INFO:teuthology.orchestra.run.smithi002.stdout:] 2023-11-25T04:09:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.765+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe64806ae70 msgr2=0x7fe64806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.765+0000 7fe6621c9640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe64806ae70 0x7fe64806d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe65c0d1de0 tx=0x7fe650009040 comp rx=0 tx=0).stop 2023-11-25T04:09:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.765+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c0ced30 msgr2=0x7fe65c14aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.765+0000 7fe6621c9640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c0ced30 0x7fe65c14aec0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe64c0098c0 tx=0x7fe64c0046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.765+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 shutdown_connections 2023-11-25T04:09:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.765+0000 7fe6621c9640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fe64806ae70 0x7fe64806d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.765+0000 7fe6621c9640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe65c15d3e0 0x7fe65c06c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.765+0000 7fe6621c9640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe65c0d1e30 0x7fe65c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.765+0000 7fe6621c9640 1 --2- 172.21.15.2:0/2289041540 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fe65c0ced30 0x7fe65c14aec0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.766+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 >> 172.21.15.2:0/2289041540 conn(0x7fe65c09c480 msgr2=0x7fe65c1600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:31.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.766+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 shutdown_connections 2023-11-25T04:09:31.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.766+0000 7fe6621c9640 1 -- 172.21.15.2:0/2289041540 wait complete. 2023-11-25T04:09:31.778 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-25T04:09:31.779 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-25T04:09:31.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.887+0000 7f89e06c9640 1 Processor -- start 2023-11-25T04:09:31.889 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.887+0000 7f89e06c9640 1 -- start start 2023-11-25T04:09:31.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89e06c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d809a080 0x7f89d81683e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89e06c9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d806b990 con 0x7f89d806c970 2023-11-25T04:09:31.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89e06c9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d8161230 con 0x7f89d8161d10 2023-11-25T04:09:31.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89e06c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d806bc70 con 0x7f89d809a080 2023-11-25T04:09:31.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89de465640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f89d806c970 0x7f89d806f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42906/0 (socket says 172.21.15.2:42906) 2023-11-25T04:09:31.890 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89de465640 1 -- 172.21.15.2:0/1102252522 learned_addr learned my addr 172.21.15.2:0/1102252522 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:31.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89dec66640 1 --2- 172.21.15.2:0/1102252522 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d809a080 0x7f89d81683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89dd463640 1 -- 172.21.15.2:0/1102252522 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571577464 0 0) 0x7f89d806b990 con 0x7f89d806c970 2023-11-25T04:09:31.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89dd463640 1 -- 172.21.15.2:0/1102252522 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89c4003520 con 0x7f89d806c970 2023-11-25T04:09:31.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89dd463640 1 -- 172.21.15.2:0/1102252522 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2025788526 0 0) 0x7f89d8161230 con 0x7f89d8161d10 2023-11-25T04:09:31.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89dd463640 1 -- 172.21.15.2:0/1102252522 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d806b990 con 0x7f89d8161d10 2023-11-25T04:09:31.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89dec66640 1 -- 172.21.15.2:0/1102252522 >> v1:172.21.15.66:6789/0 conn(0x7f89d8161d10 legacy=0x7f89d8099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89dec66640 1 -- 172.21.15.2:0/1102252522 >> v1:172.21.15.2:6789/0 conn(0x7f89d806c970 legacy=0x7f89d806f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.891 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.888+0000 7f89dec66640 1 -- 172.21.15.2:0/1102252522 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8161510 con 0x7f89d809a080 2023-11-25T04:09:31.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.889+0000 7f89dec66640 1 --2- 172.21.15.2:0/1102252522 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d809a080 0x7f89d81683e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009dc0 tx=0x7f89d002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6c44e0128acce22 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:31.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.889+0000 7f89dd463640 1 -- 172.21.15.2:0/1102252522 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d002ccd0 con 0x7f89d809a080 2023-11-25T04:09:31.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.889+0000 7f89dd463640 1 -- 172.21.15.2:0/1102252522 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d002ce30 con 0x7f89d809a080 2023-11-25T04:09:31.892 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.889+0000 7f89dd463640 1 -- 172.21.15.2:0/1102252522 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d0034640 con 0x7f89d809a080 2023-11-25T04:09:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.890+0000 7f89e06c9640 1 -- 172.21.15.2:0/1102252522 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d809a080 msgr2=0x7f89d81683e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.890+0000 7f89e06c9640 1 --2- 172.21.15.2:0/1102252522 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d809a080 0x7f89d81683e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89d0009dc0 tx=0x7f89d002bf20 comp rx=0 tx=0).stop 2023-11-25T04:09:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.890+0000 7f89e06c9640 1 -- 172.21.15.2:0/1102252522 shutdown_connections 2023-11-25T04:09:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.890+0000 7f89e06c9640 1 --2- 172.21.15.2:0/1102252522 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d809a080 0x7f89d81683e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.890+0000 7f89e06c9640 1 -- 172.21.15.2:0/1102252522 >> 172.21.15.2:0/1102252522 conn(0x7f89d80b2a90 msgr2=0x7f89d80b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.890+0000 7f89e06c9640 1 -- 172.21.15.2:0/1102252522 shutdown_connections 2023-11-25T04:09:31.893 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.890+0000 7f89e06c9640 1 -- 172.21.15.2:0/1102252522 wait complete. 2023-11-25T04:09:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.891+0000 7f89e06c9640 1 Processor -- start 2023-11-25T04:09:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.891+0000 7f89e06c9640 1 -- start start 2023-11-25T04:09:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89e06c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89d809a080 0x7f89d81e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89e06c9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89d8161d10 0x7f89d80c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89e06c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d81554c0 0x7f89d80c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89e06c9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d81e89d0 con 0x7f89d8161d10 2023-11-25T04:09:31.895 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89e06c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d81e7dc0 con 0x7f89d809a080 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89e06c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d81e80a0 con 0x7f89d81554c0 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89ddc64640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89d8161d10 0x7f89d80c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89ddc64640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89d8161d10 0x7f89d80c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35342/0 (socket says 172.21.15.2:35342) 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89ddc64640 1 -- 172.21.15.2:0/3108747668 learned_addr learned my addr 172.21.15.2:0/3108747668 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89dec66640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d81554c0 0x7f89d80c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89de465640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89d809a080 0x7f89d81e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89ddc64640 1 -- 172.21.15.2:0/3108747668 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d81554c0 msgr2=0x7f89d80c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89ddc64640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d81554c0 0x7f89d80c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89ddc64640 1 -- 172.21.15.2:0/3108747668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89d809a080 msgr2=0x7f89d81e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89ddc64640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89d809a080 0x7f89d81e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.892+0000 7f89ddc64640 1 -- 172.21.15.2:0/3108747668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d0009a70 con 0x7f89d8161d10 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.893+0000 7f89ddc64640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89d8161d10 0x7f89d80c9140 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c400 tx=0x7f89c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.893+0000 7f89ceffd640 1 -- 172.21.15.2:0/3108747668 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c80052d0 con 0x7f89d8161d10 2023-11-25T04:09:31.896 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.893+0000 7f89ceffd640 1 -- 172.21.15.2:0/3108747668 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c8005430 con 0x7f89d8161d10 2023-11-25T04:09:31.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.893+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d81e8380 con 0x7f89d8161d10 2023-11-25T04:09:31.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.893+0000 7f89ceffd640 1 -- 172.21.15.2:0/3108747668 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c8003810 con 0x7f89d8161d10 2023-11-25T04:09:31.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.893+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d8154e20 con 0x7f89d8161d10 2023-11-25T04:09:31.897 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.894+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d8067420 con 0x7f89d8161d10 2023-11-25T04:09:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.894+0000 7f89ceffd640 1 -- 172.21.15.2:0/3108747668 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89c8003970 con 0x7f89d8161d10 2023-11-25T04:09:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.895+0000 7f89ceffd640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f89bc06ae40 0x7f89bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.895+0000 7f89ceffd640 1 -- 172.21.15.2:0/3108747668 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f89c80887c0 con 0x7f89d8161d10 2023-11-25T04:09:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.895+0000 7f89de465640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f89bc06ae40 0x7f89bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:31.898 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.895+0000 7f89de465640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f89bc06ae40 0x7f89bc06d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f89d40011e0 tx=0x7f89d4007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:31.901 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:31.899+0000 7f89ceffd640 1 -- 172.21.15.2:0/3108747668 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89c8053d00 con 0x7f89d8161d10 2023-11-25T04:09:32.078 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.076+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f89d81e8b10 con 0x7f89d8161d10 2023-11-25T04:09:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.167+0000 7f89ceffd640 1 -- 172.21.15.2:0/3108747668 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f89d81e8b10 con 0x7f89d8161d10 2023-11-25T04:09:32.169 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_metadata' created 2023-11-25T04:09:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f89bc06ae40 msgr2=0x7f89bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f89bc06ae40 0x7f89bc06d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f89d40011e0 tx=0x7f89d4007d30 comp rx=0 tx=0).stop 2023-11-25T04:09:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89d8161d10 msgr2=0x7f89d80c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:32.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89d8161d10 0x7f89d80c9140 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f89c800c400 tx=0x7f89c800c8c0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 shutdown_connections 2023-11-25T04:09:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89d81554c0 0x7f89d80c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f89d8161d10 0x7f89d80c9140 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f89bc06ae40 0x7f89bc06d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 --2- 172.21.15.2:0/3108747668 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89d809a080 0x7f89d81e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 >> 172.21.15.2:0/3108747668 conn(0x7f89d80b2a90 msgr2=0x7f89d80af590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 shutdown_connections 2023-11-25T04:09:32.172 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.169+0000 7f89e06c9640 1 -- 172.21.15.2:0/3108747668 wait complete. 2023-11-25T04:09:32.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-25T04:09:32.299 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.297+0000 7f78336cf640 1 Processor -- start 2023-11-25T04:09:32.300 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.297+0000 7f78336cf640 1 -- start start 2023-11-25T04:09:32.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.298+0000 7f78336cf640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f782c0d1570 0x7f782c0b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:32.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.298+0000 7f78336cf640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c0cef00 0x7f782c161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:32.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.298+0000 7f78336cf640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0ce360 con 0x7f782c160b70 2023-11-25T04:09:32.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.298+0000 7f78336cf640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0d19f0 con 0x7f782c0d1570 2023-11-25T04:09:32.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.298+0000 7f78336cf640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0cdd50 con 0x7f782c0cef00 2023-11-25T04:09:32.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.298+0000 7f7830c6a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f782c0d1570 0x7f782c0b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:32.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.298+0000 7f7830c6a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f782c0d1570 0x7f782c0b2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35346/0 (socket says 172.21.15.2:35346) 2023-11-25T04:09:32.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.298+0000 7f7830c6a640 1 -- 172.21.15.2:0/2079833740 learned_addr learned my addr 172.21.15.2:0/2079833740 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:32.301 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.299+0000 7f7831c6c640 1 --2- 172.21.15.2:0/2079833740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c0cef00 0x7f782c161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:32.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.299+0000 7f7830c6a640 1 -- 172.21.15.2:0/2079833740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c0cef00 msgr2=0x7f782c161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:32.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.299+0000 7f7830c6a640 1 --2- 172.21.15.2:0/2079833740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c0cef00 0x7f782c161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.299+0000 7f7830c6a640 1 -- 172.21.15.2:0/2079833740 >> v1:172.21.15.66:6789/0 conn(0x7f782c160b70 legacy=0x7f782c0ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:32.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.299+0000 7f7830c6a640 1 -- 172.21.15.2:0/2079833740 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0d1c70 con 0x7f782c0d1570 2023-11-25T04:09:32.302 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.299+0000 7f7831c6c640 1 --2- 172.21.15.2:0/2079833740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c0cef00 0x7f782c161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f7830c6a640 1 --2- 172.21.15.2:0/2079833740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0d1570 0x7f782c0b2aa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7820009870 tx=0x7f782002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89424d8a9b182d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f782bfff640 1 -- 172.21.15.2:0/2079833740 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820030840 con 0x7f782c0d1570 2023-11-25T04:09:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f782bfff640 1 -- 172.21.15.2:0/2079833740 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78200309a0 con 0x7f782c0d1570 2023-11-25T04:09:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f782bfff640 1 -- 172.21.15.2:0/2079833740 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7820030d30 con 0x7f782c0d1570 2023-11-25T04:09:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f78336cf640 1 -- 172.21.15.2:0/2079833740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0d1570 msgr2=0x7f782c0b2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f78336cf640 1 --2- 172.21.15.2:0/2079833740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0d1570 0x7f782c0b2aa0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7820009870 tx=0x7f782002b980 comp rx=0 tx=0).stop 2023-11-25T04:09:32.303 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f78336cf640 1 -- 172.21.15.2:0/2079833740 shutdown_connections 2023-11-25T04:09:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f78336cf640 1 --2- 172.21.15.2:0/2079833740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c0cef00 0x7f782c161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f78336cf640 1 --2- 172.21.15.2:0/2079833740 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0d1570 0x7f782c0b2aa0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f78336cf640 1 -- 172.21.15.2:0/2079833740 >> 172.21.15.2:0/2079833740 conn(0x7f782c09c470 msgr2=0x7f782c0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f78336cf640 1 -- 172.21.15.2:0/2079833740 shutdown_connections 2023-11-25T04:09:32.304 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.300+0000 7f78336cf640 1 -- 172.21.15.2:0/2079833740 wait complete. 2023-11-25T04:09:32.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f78336cf640 1 Processor -- start 2023-11-25T04:09:32.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f78336cf640 1 -- start start 2023-11-25T04:09:32.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f78336cf640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0cef00 0x7f782c09dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:32.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f78336cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c0d1570 0x7f782c09efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:32.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f78336cf640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c160b70 0x7f782c09f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:32.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f78336cf640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c09e960 con 0x7f782c0cef00 2023-11-25T04:09:32.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f78336cf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0ca6b0 con 0x7f782c0d1570 2023-11-25T04:09:32.306 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f78336cf640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c15af70 con 0x7f782c160b70 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f783146b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0cef00 0x7f782c09dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f783146b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0cef00 0x7f782c09dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35356/0 (socket says 172.21.15.2:35356) 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.302+0000 7f783146b640 1 -- 172.21.15.2:0/1484274210 learned_addr learned my addr 172.21.15.2:0/1484274210 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f7830c6a640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c0d1570 0x7f782c09efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f7831c6c640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c160b70 0x7f782c09f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f783146b640 1 -- 172.21.15.2:0/1484274210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c160b70 msgr2=0x7f782c09f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f783146b640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c160b70 0x7f782c09f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f783146b640 1 -- 172.21.15.2:0/1484274210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c0d1570 msgr2=0x7f782c09efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f783146b640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c0d1570 0x7f782c09efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f783146b640 1 -- 172.21.15.2:0/1484274210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78200094d0 con 0x7f782c0cef00 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f783146b640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0cef00 0x7f782c09dd70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f782400c450 tx=0x7f782400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:32.307 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f7829ffb640 1 -- 172.21.15.2:0/1484274210 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78240052d0 con 0x7f782c0cef00 2023-11-25T04:09:32.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f7829ffb640 1 -- 172.21.15.2:0/1484274210 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7824005430 con 0x7f782c0cef00 2023-11-25T04:09:32.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c09e3a0 con 0x7f782c0cef00 2023-11-25T04:09:32.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f7829ffb640 1 -- 172.21.15.2:0/1484274210 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7824012870 con 0x7f782c0cef00 2023-11-25T04:09:32.308 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.303+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c0ca340 con 0x7f782c0cef00 2023-11-25T04:09:32.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.304+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c0ca4d0 con 0x7f782c0cef00 2023-11-25T04:09:32.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.304+0000 7f7829ffb640 1 -- 172.21.15.2:0/1484274210 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78240129d0 con 0x7f782c0cef00 2023-11-25T04:09:32.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.305+0000 7f7829ffb640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f781806ae40 0x7f781806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:32.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.305+0000 7f7829ffb640 1 -- 172.21.15.2:0/1484274210 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f7824088f70 con 0x7f782c0cef00 2023-11-25T04:09:32.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.305+0000 7f7830c6a640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f781806ae40 0x7f781806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:32.309 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.305+0000 7f7830c6a640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f781806ae40 0x7f781806d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7820036000 tx=0x7f782003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:32.311 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.309+0000 7f7829ffb640 1 -- 172.21.15.2:0/1484274210 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78240bbe90 con 0x7f782c0cef00 2023-11-25T04:09:32.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:32.485+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f782c0a1150 con 0x7f782c0cef00 2023-11-25T04:09:33.171 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.169+0000 7f7829ffb640 1 -- 172.21.15.2:0/1484274210 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7824054200 con 0x7f782c0cef00 2023-11-25T04:09:33.172 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'cephfs_data' created 2023-11-25T04:09:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.172+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f781806ae40 msgr2=0x7f781806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.172+0000 7f78336cf640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f781806ae40 0x7f781806d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7820036000 tx=0x7f782003b040 comp rx=0 tx=0).stop 2023-11-25T04:09:33.174 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.172+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0cef00 msgr2=0x7f782c09dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:33.175 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.172+0000 7f78336cf640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0cef00 0x7f782c09dd70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f782400c450 tx=0x7f782400c910 comp rx=0 tx=0).stop 2023-11-25T04:09:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.174+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 shutdown_connections 2023-11-25T04:09:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.174+0000 7f78336cf640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f782c160b70 0x7f782c09f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.176 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.174+0000 7f78336cf640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f781806ae40 0x7f781806d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.175+0000 7f78336cf640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f782c0d1570 0x7f782c09efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.175+0000 7f78336cf640 1 --2- 172.21.15.2:0/1484274210 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f782c0cef00 0x7f782c09dd70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.177 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.175+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 >> 172.21.15.2:0/1484274210 conn(0x7f782c09c470 msgr2=0x7f782c06b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:33.185 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.183+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 shutdown_connections 2023-11-25T04:09:33.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.186+0000 7f78336cf640 1 -- 172.21.15.2:0/1484274210 wait complete. 2023-11-25T04:09:33.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-25T04:09:33.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.319+0000 7f300591d640 1 Processor -- start 2023-11-25T04:09:33.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.319+0000 7f300591d640 1 -- start start 2023-11-25T04:09:33.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f300591d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f300015e810 0x7f30000ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:33.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f300591d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f300015ebf0 0x7f3000099970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:33.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f300591d640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30000cd170 con 0x7f30000cd540 2023-11-25T04:09:33.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f300591d640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30000b2260 con 0x7f300015e810 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f300591d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30000b37b0 con 0x7f300015ebf0 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2ffeffd640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f300015e810 0x7f30000ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2fff7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f30000cd540 0x7f3000099eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42912/0 (socket says 172.21.15.2:42912) 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2fff7fe640 1 -- 172.21.15.2:0/259276597 learned_addr learned my addr 172.21.15.2:0/259276597 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2ff7fff640 1 --2- 172.21.15.2:0/259276597 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f300015ebf0 0x7f3000099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2ffeffd640 1 -- 172.21.15.2:0/259276597 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f300015ebf0 msgr2=0x7f3000099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/259276597 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f300015ebf0 0x7f3000099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2ffeffd640 1 -- 172.21.15.2:0/259276597 >> v1:172.21.15.2:6789/0 conn(0x7f30000cd540 legacy=0x7f3000099eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2ffeffd640 1 -- 172.21.15.2:0/259276597 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30000cc720 con 0x7f300015e810 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2ffe7fc640 1 -- 172.21.15.2:0/259276597 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465713709 0 0) 0x7f30000cd170 con 0x7f30000cd540 2023-11-25T04:09:33.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.320+0000 7f2ff7fff640 1 --2- 172.21.15.2:0/259276597 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f300015ebf0 0x7f3000099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.321+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/259276597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015e810 0x7f30000ccc30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00097a0 tx=0x7f2ff002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c569ab6a234cd08 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.321+0000 7f2ffe7fc640 1 -- 172.21.15.2:0/259276597 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0031830 con 0x7f300015e810 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.321+0000 7f2ffe7fc640 1 -- 172.21.15.2:0/259276597 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff0031990 con 0x7f300015e810 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.321+0000 7f2ffe7fc640 1 -- 172.21.15.2:0/259276597 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0031d20 con 0x7f300015e810 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.322+0000 7f300591d640 1 -- 172.21.15.2:0/259276597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015e810 msgr2=0x7f30000ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.322+0000 7f300591d640 1 --2- 172.21.15.2:0/259276597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015e810 0x7f30000ccc30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00097a0 tx=0x7f2ff002b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.322+0000 7f300591d640 1 -- 172.21.15.2:0/259276597 shutdown_connections 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.322+0000 7f300591d640 1 --2- 172.21.15.2:0/259276597 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f300015ebf0 0x7f3000099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.322+0000 7f300591d640 1 --2- 172.21.15.2:0/259276597 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015e810 0x7f30000ccc30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.325 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.322+0000 7f300591d640 1 -- 172.21.15.2:0/259276597 >> 172.21.15.2:0/259276597 conn(0x7f30000b2a70 msgr2=0x7f30000b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:33.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.322+0000 7f300591d640 1 -- 172.21.15.2:0/259276597 shutdown_connections 2023-11-25T04:09:33.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.322+0000 7f300591d640 1 -- 172.21.15.2:0/259276597 wait complete. 2023-11-25T04:09:33.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.323+0000 7f300591d640 1 Processor -- start 2023-11-25T04:09:33.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.323+0000 7f300591d640 1 -- start start 2023-11-25T04:09:33.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f300591d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30000cd540 0x7f30001554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:33.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f300591d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f300015e810 0x7f3000099970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:33.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f300591d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015ebf0 0x7f3000099eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:33.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f300591d640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30000c3c90 con 0x7f300015ebf0 2023-11-25T04:09:33.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f300591d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3000155a30 con 0x7f300015e810 2023-11-25T04:09:33.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f300591d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30000b5dc0 con 0x7f30000cd540 2023-11-25T04:09:33.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015ebf0 0x7f3000099eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:33.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2fff7fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015ebf0 0x7f3000099eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35374/0 (socket says 172.21.15.2:35374) 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2fff7fe640 1 -- 172.21.15.2:0/75896971 learned_addr learned my addr 172.21.15.2:0/75896971 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2ff7fff640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f300015e810 0x7f3000099970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30000cd540 0x7f30001554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2fff7fe640 1 -- 172.21.15.2:0/75896971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30000cd540 msgr2=0x7f30001554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2fff7fe640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30000cd540 0x7f30001554f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2fff7fe640 1 -- 172.21.15.2:0/75896971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f300015e810 msgr2=0x7f3000099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2fff7fe640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f300015e810 0x7f3000099970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2fff7fe640 1 -- 172.21.15.2:0/75896971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff0009400 con 0x7f300015ebf0 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30000cd540 0x7f30001554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2fff7fe640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015ebf0 0x7f3000099eb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800c810 tx=0x7f2ff800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2ffcff9640 1 -- 172.21.15.2:0/75896971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff800a640 con 0x7f300015ebf0 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f2ffcff9640 1 -- 172.21.15.2:0/75896971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff800a7c0 con 0x7f300015ebf0 2023-11-25T04:09:33.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.324+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300006b780 con 0x7f300015ebf0 2023-11-25T04:09:33.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.325+0000 7f2ffcff9640 1 -- 172.21.15.2:0/75896971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff800ab70 con 0x7f300015ebf0 2023-11-25T04:09:33.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.325+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300006bd40 con 0x7f300015ebf0 2023-11-25T04:09:33.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.325+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300006b5e0 con 0x7f300015ebf0 2023-11-25T04:09:33.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.326+0000 7f2ffcff9640 1 -- 172.21.15.2:0/75896971 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ff800acd0 con 0x7f300015ebf0 2023-11-25T04:09:33.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.326+0000 7f2ffcff9640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2fe006ae40 0x7f2fe006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:33.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.327+0000 7f2ffcff9640 1 -- 172.21.15.2:0/75896971 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2ff8088d70 con 0x7f300015ebf0 2023-11-25T04:09:33.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.327+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2fe006ae40 0x7f2fe006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:33.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.327+0000 7f2ffeffd640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2fe006ae40 0x7f2fe006d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0036000 tx=0x7f2ff003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:33.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.331+0000 7f2ffcff9640 1 -- 172.21.15.2:0/75896971 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f300006b5e0 con 0x7f300015ebf0 2023-11-25T04:09:33.548 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:33.546+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f300006b5e0 con 0x7f300015ebf0 2023-11-25T04:09:34.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.184+0000 7f2ffcff9640 1 -- 172.21.15.2:0/75896971 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f300006b5e0 con 0x7f300015ebf0 2023-11-25T04:09:34.186 INFO:teuthology.orchestra.run.smithi002.stderr:new fs with metadata pool 4 and data pool 5 2023-11-25T04:09:34.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2fe006ae40 msgr2=0x7f2fe006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2fe006ae40 0x7f2fe006d300 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0036000 tx=0x7f2ff003c040 comp rx=0 tx=0).stop 2023-11-25T04:09:34.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015ebf0 msgr2=0x7f3000099eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015ebf0 0x7f3000099eb0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800c810 tx=0x7f2ff800ccd0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 shutdown_connections 2023-11-25T04:09:34.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f300015ebf0 0x7f3000099eb0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f2fe006ae40 0x7f2fe006d300 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f300015e810 0x7f3000099970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 --2- 172.21.15.2:0/75896971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30000cd540 0x7f30001554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.187+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 >> 172.21.15.2:0/75896971 conn(0x7f30000b2a70 msgr2=0x7f30000b12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:34.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.188+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 shutdown_connections 2023-11-25T04:09:34.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.188+0000 7f300591d640 1 -- 172.21.15.2:0/75896971 wait complete. 2023-11-25T04:09:34.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.334+0000 7fc5d359e640 1 Processor -- start 2023-11-25T04:09:34.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.334+0000 7fc5d359e640 1 -- start start 2023-11-25T04:09:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d359e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d0190 0x7fc5d40cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d359e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5d40d1430 0x7fc5d40ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d359e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d40d1980 con 0x7fc5d41609b0 2023-11-25T04:09:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d359e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d40d2220 con 0x7fc5d40d1430 2023-11-25T04:09:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d359e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d40b29f0 con 0x7fc5d40d0190 2023-11-25T04:09:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d2d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5d40d1430 0x7fc5d40ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d2d9d640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc5d40d1430 0x7fc5d40ce1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35380/0 (socket says 172.21.15.2:35380) 2023-11-25T04:09:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d2d9d640 1 -- 172.21.15.2:0/4193017325 learned_addr learned my addr 172.21.15.2:0/4193017325 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d1d9b640 1 --2- 172.21.15.2:0/4193017325 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d0190 0x7fc5d40cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d2d9d640 1 -- 172.21.15.2:0/4193017325 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d0190 msgr2=0x7fc5d40cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d2d9d640 1 --2- 172.21.15.2:0/4193017325 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d0190 0x7fc5d40cdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d2d9d640 1 -- 172.21.15.2:0/4193017325 >> v1:172.21.15.66:6789/0 conn(0x7fc5d41609b0 legacy=0x7fc5d40cfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d2d9d640 1 -- 172.21.15.2:0/4193017325 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d40d1c60 con 0x7fc5d40d1430 2023-11-25T04:09:34.338 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.335+0000 7fc5d1d9b640 1 --2- 172.21.15.2:0/4193017325 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d0190 0x7fc5d40cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.336+0000 7fc5d2d9d640 1 --2- 172.21.15.2:0/4193017325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d40d1430 0x7fc5d40ce1c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009870 tx=0x7fc5c402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c77f5952558824d3 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.336+0000 7fc5d159a640 1 -- 172.21.15.2:0/4193017325 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4030840 con 0x7fc5d40d1430 2023-11-25T04:09:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.336+0000 7fc5d159a640 1 -- 172.21.15.2:0/4193017325 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c40309a0 con 0x7fc5d40d1430 2023-11-25T04:09:34.339 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.336+0000 7fc5d159a640 1 -- 172.21.15.2:0/4193017325 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4030d30 con 0x7fc5d40d1430 2023-11-25T04:09:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.336+0000 7fc5d359e640 1 -- 172.21.15.2:0/4193017325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d40d1430 msgr2=0x7fc5d40ce1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.336+0000 7fc5d359e640 1 --2- 172.21.15.2:0/4193017325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d40d1430 0x7fc5d40ce1c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009870 tx=0x7fc5c402b980 comp rx=0 tx=0).stop 2023-11-25T04:09:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.337+0000 7fc5d359e640 1 -- 172.21.15.2:0/4193017325 shutdown_connections 2023-11-25T04:09:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.337+0000 7fc5d359e640 1 --2- 172.21.15.2:0/4193017325 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d40d1430 0x7fc5d40ce1c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.337+0000 7fc5d359e640 1 --2- 172.21.15.2:0/4193017325 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d0190 0x7fc5d40cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.337+0000 7fc5d359e640 1 -- 172.21.15.2:0/4193017325 >> 172.21.15.2:0/4193017325 conn(0x7fc5d409c3c0 msgr2=0x7fc5d40d3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.337+0000 7fc5d359e640 1 -- 172.21.15.2:0/4193017325 shutdown_connections 2023-11-25T04:09:34.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.337+0000 7fc5d359e640 1 -- 172.21.15.2:0/4193017325 wait complete. 2023-11-25T04:09:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.338+0000 7fc5d359e640 1 Processor -- start 2023-11-25T04:09:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.338+0000 7fc5d359e640 1 -- start start 2023-11-25T04:09:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d40d0190 0x7fc5d41f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d359e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d1430 0x7fc5d40cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d359e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d41609b0 0x7fc5d415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d359e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d41f72a0 con 0x7fc5d41609b0 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d359e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d40cb2e0 con 0x7fc5d40d0190 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d359e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d40cb5c0 con 0x7fc5d40d1430 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d41609b0 0x7fc5d415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d2d9d640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d41609b0 0x7fc5d415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35388/0 (socket says 172.21.15.2:35388) 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d2d9d640 1 -- 172.21.15.2:0/3203834116 learned_addr learned my addr 172.21.15.2:0/3203834116 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d259c640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d40d0190 0x7fc5d41f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d1d9b640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d1430 0x7fc5d40cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d2d9d640 1 -- 172.21.15.2:0/3203834116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d1430 msgr2=0x7fc5d40cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d2d9d640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d1430 0x7fc5d40cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d2d9d640 1 -- 172.21.15.2:0/3203834116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d40d0190 msgr2=0x7fc5d41f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d2d9d640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d40d0190 0x7fc5d41f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d2d9d640 1 -- 172.21.15.2:0/3203834116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40094d0 con 0x7fc5d41609b0 2023-11-25T04:09:34.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.339+0000 7fc5d2d9d640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d41609b0 0x7fc5d415cce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009870 tx=0x7fc5c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.340+0000 7fc5caffd640 1 -- 172.21.15.2:0/3203834116 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4039c90 con 0x7fc5d41609b0 2023-11-25T04:09:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.340+0000 7fc5caffd640 1 -- 172.21.15.2:0/3203834116 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c4039e10 con 0x7fc5d41609b0 2023-11-25T04:09:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.340+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d4160f10 con 0x7fc5d41609b0 2023-11-25T04:09:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.340+0000 7fc5caffd640 1 -- 172.21.15.2:0/3203834116 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c4043640 con 0x7fc5d41609b0 2023-11-25T04:09:34.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.340+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d40cbb80 con 0x7fc5d41609b0 2023-11-25T04:09:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.341+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d4073e70 con 0x7fc5d41609b0 2023-11-25T04:09:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.341+0000 7fc5caffd640 1 -- 172.21.15.2:0/3203834116 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc5c40437a0 con 0x7fc5d41609b0 2023-11-25T04:09:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.341+0000 7fc5caffd640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5b406ae40 0x7fc5b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.342+0000 7fc5caffd640 1 -- 172.21.15.2:0/3203834116 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5c403e070 con 0x7fc5d41609b0 2023-11-25T04:09:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.342+0000 7fc5d259c640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5b406ae40 0x7fc5b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.342+0000 7fc5d259c640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5b406ae40 0x7fc5b406d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0012e0 tx=0x7fc5cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:34.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.346+0000 7fc5caffd640 1 -- 172.21.15.2:0/3203834116 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc5c4077710 con 0x7fc5d41609b0 2023-11-25T04:09:34.524 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.523+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5d40a10a0 con 0x7fc5d41609b0 2023-11-25T04:09:34.525 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.524+0000 7fc5caffd640 1 -- 172.21.15.2:0/3203834116 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16474 (secure 0 0 0) 0x7fc5c407ad30 con 0x7fc5d41609b0 2023-11-25T04:09:34.526 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:34.526 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:09:33.547998+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:09:32.107662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-25T04:09:32.517411+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5b406ae40 msgr2=0x7fc5b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5b406ae40 0x7fc5b406d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc0012e0 tx=0x7fc5cc009040 comp rx=0 tx=0).stop 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d41609b0 msgr2=0x7fc5d415cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d41609b0 0x7fc5d415cce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009870 tx=0x7fc5c4004730 comp rx=0 tx=0).stop 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 shutdown_connections 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc5d41609b0 0x7fc5d415cce0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5d40d1430 0x7fc5d40cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc5b406ae40 0x7fc5b406d300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 --2- 172.21.15.2:0/3203834116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5d40d0190 0x7fc5d41f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.529 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 >> 172.21.15.2:0/3203834116 conn(0x7fc5d409c3c0 msgr2=0x7fc5d415fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 shutdown_connections 2023-11-25T04:09:34.531 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.526+0000 7fc5d359e640 1 -- 172.21.15.2:0/3203834116 wait complete. 2023-11-25T04:09:34.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:34.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.644+0000 7f8f16cc9640 1 Processor -- start 2023-11-25T04:09:34.647 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.644+0000 7f8f16cc9640 1 -- start start 2023-11-25T04:09:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.645+0000 7f8f16cc9640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8f100d0ab0 0x7f8f100cf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.645+0000 7f8f16cc9640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1006f9d0 con 0x7f8f100cce70 2023-11-25T04:09:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.645+0000 7f8f16cc9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1006c190 con 0x7f8f100d1c50 2023-11-25T04:09:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.645+0000 7f8f16cc9640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1006bfa0 con 0x7f8f100d0ab0 2023-11-25T04:09:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.645+0000 7f8f0ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8f100d0ab0 0x7f8f100cf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.645+0000 7f8f14a65640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f8f100cce70 0x7f8f10099970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42922/0 (socket says 172.21.15.2:42922) 2023-11-25T04:09:34.648 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.645+0000 7f8f0ffff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f8f100d0ab0 0x7f8f100cf390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35390/0 (socket says 172.21.15.2:35390) 2023-11-25T04:09:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.645+0000 7f8f14a65640 1 -- 172.21.15.2:0/1485390749 learned_addr learned my addr 172.21.15.2:0/1485390749 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.646+0000 7f8f0ffff640 1 -- 172.21.15.2:0/1485390749 >> v1:172.21.15.66:6789/0 conn(0x7f8f100d1c50 legacy=0x7f8f100cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.646+0000 7f8f0ffff640 1 -- 172.21.15.2:0/1485390749 >> v1:172.21.15.2:6789/0 conn(0x7f8f100cce70 legacy=0x7f8f10099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.646+0000 7f8f0ffff640 1 -- 172.21.15.2:0/1485390749 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1006c470 con 0x7f8f100d0ab0 2023-11-25T04:09:34.649 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.646+0000 7f8f0f7fe640 1 -- 172.21.15.2:0/1485390749 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474719484 0 0) 0x7f8f1006f9d0 con 0x7f8f100cce70 2023-11-25T04:09:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.646+0000 7f8f0ffff640 1 --2- 172.21.15.2:0/1485390749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100d0ab0 0x7f8f100cf390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8f000097a0 tx=0x7f8f0002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca33e208fff72d server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f0f7fe640 1 -- 172.21.15.2:0/1485390749 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00030610 con 0x7f8f100d0ab0 2023-11-25T04:09:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f0f7fe640 1 -- 172.21.15.2:0/1485390749 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f00030770 con 0x7f8f100d0ab0 2023-11-25T04:09:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f0f7fe640 1 -- 172.21.15.2:0/1485390749 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00030b00 con 0x7f8f100d0ab0 2023-11-25T04:09:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f16cc9640 1 -- 172.21.15.2:0/1485390749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100d0ab0 msgr2=0x7f8f100cf390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.653 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f16cc9640 1 --2- 172.21.15.2:0/1485390749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100d0ab0 0x7f8f100cf390 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8f000097a0 tx=0x7f8f0002b960 comp rx=0 tx=0).stop 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f16cc9640 1 -- 172.21.15.2:0/1485390749 shutdown_connections 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f16cc9640 1 --2- 172.21.15.2:0/1485390749 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100d0ab0 0x7f8f100cf390 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f16cc9640 1 -- 172.21.15.2:0/1485390749 >> 172.21.15.2:0/1485390749 conn(0x7f8f100d0f20 msgr2=0x7f8f100d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f16cc9640 1 -- 172.21.15.2:0/1485390749 shutdown_connections 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.647+0000 7f8f16cc9640 1 -- 172.21.15.2:0/1485390749 wait complete. 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.648+0000 7f8f16cc9640 1 Processor -- start 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.648+0000 7f8f16cc9640 1 -- start start 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.649+0000 7f8f16cc9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100cce70 0x7f8f101569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.649+0000 7f8f16cc9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f100d0ab0 0x7f8f100c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.649+0000 7f8f16cc9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8f100d1c50 0x7f8f100b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.654 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.649+0000 7f8f16cc9640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100b42b0 con 0x7f8f100cce70 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.649+0000 7f8f16cc9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100b4590 con 0x7f8f100d0ab0 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.649+0000 7f8f16cc9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100b4870 con 0x7f8f100d1c50 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.649+0000 7f8f14a65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100cce70 0x7f8f101569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.649+0000 7f8f14a65640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100cce70 0x7f8f101569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35402/0 (socket says 172.21.15.2:35402) 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.649+0000 7f8f14a65640 1 -- 172.21.15.2:0/4091369148 learned_addr learned my addr 172.21.15.2:0/4091369148 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f14a65640 1 -- 172.21.15.2:0/4091369148 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8f100d1c50 msgr2=0x7f8f100b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f14a65640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8f100d1c50 0x7f8f100b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f14a65640 1 -- 172.21.15.2:0/4091369148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f100d0ab0 msgr2=0x7f8f100c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f0ffff640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f100d0ab0 0x7f8f100c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f14a65640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f100d0ab0 0x7f8f100c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.655 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f14a65640 1 -- 172.21.15.2:0/4091369148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009400 con 0x7f8f100cce70 2023-11-25T04:09:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f14a65640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100cce70 0x7f8f101569c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c8c0 tx=0x7f8f0800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f0d7fa640 1 -- 172.21.15.2:0/4091369148 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800a640 con 0x7f8f100cce70 2023-11-25T04:09:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f0d7fa640 1 -- 172.21.15.2:0/4091369148 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0800a7a0 con 0x7f8f100cce70 2023-11-25T04:09:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f100b4b50 con 0x7f8f100cce70 2023-11-25T04:09:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f0d7fa640 1 -- 172.21.15.2:0/4091369148 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800ab90 con 0x7f8f100cce70 2023-11-25T04:09:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.650+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f100b5350 con 0x7f8f100cce70 2023-11-25T04:09:34.656 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.651+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f100b5070 con 0x7f8f100cce70 2023-11-25T04:09:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.652+0000 7f8f0d7fa640 1 -- 172.21.15.2:0/4091369148 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8f0800acf0 con 0x7f8f100cce70 2023-11-25T04:09:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.652+0000 7f8f0d7fa640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ef006ae70 0x7f8ef006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.652+0000 7f8f0d7fa640 1 -- 172.21.15.2:0/4091369148 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f08088af0 con 0x7f8f100cce70 2023-11-25T04:09:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.652+0000 7f8f0ffff640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ef006ae70 0x7f8ef006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.657 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.652+0000 7f8f0ffff640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ef006ae70 0x7f8ef006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f00036000 tx=0x7f8f0003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:34.658 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.656+0000 7f8f0d7fa640 1 -- 172.21.15.2:0/4091369148 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8f08053ba0 con 0x7f8f100cce70 2023-11-25T04:09:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.835+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f10067420 con 0x7f8f100cce70 2023-11-25T04:09:34.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.836+0000 7f8f0d7fa640 1 -- 172.21.15.2:0/4091369148 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f8f08018020 con 0x7f8f100cce70 2023-11-25T04:09:34.838 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:34.838 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":32,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:09:33.547998+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:09:32.107662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-25T04:09:32.517411+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ef006ae70 msgr2=0x7f8ef006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ef006ae70 0x7f8ef006d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8f00036000 tx=0x7f8f0003b040 comp rx=0 tx=0).stop 2023-11-25T04:09:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100cce70 msgr2=0x7f8f101569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100cce70 0x7f8f101569c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c8c0 tx=0x7f8f0800cd80 comp rx=0 tx=0).stop 2023-11-25T04:09:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 shutdown_connections 2023-11-25T04:09:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8f100d1c50 0x7f8f100b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f8ef006ae70 0x7f8ef006d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8f100d0ab0 0x7f8f100c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 --2- 172.21.15.2:0/4091369148 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8f100cce70 0x7f8f101569c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 >> 172.21.15.2:0/4091369148 conn(0x7f8f100d0f20 msgr2=0x7f8f100cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 shutdown_connections 2023-11-25T04:09:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.838+0000 7f8f16cc9640 1 -- 172.21.15.2:0/4091369148 wait complete. 2023-11-25T04:09:34.851 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-25T04:09:34.963 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.959+0000 7fc71b1dc640 1 Processor -- start 2023-11-25T04:09:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.959+0000 7fc71b1dc640 1 -- start start 2023-11-25T04:09:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.960+0000 7fc71b1dc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc714160b70 0x7fc7140d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.960+0000 7fc71b1dc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc7140cef00 0x7fc714161230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.964 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.960+0000 7fc71b1dc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7140ce360 con 0x7fc7140b2aa0 2023-11-25T04:09:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.960+0000 7fc71b1dc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7140b2f20 con 0x7fc714160b70 2023-11-25T04:09:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.960+0000 7fc71b1dc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7140cdd50 con 0x7fc7140cef00 2023-11-25T04:09:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.960+0000 7fc718f78640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc714160b70 0x7fc7140d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.960+0000 7fc718f78640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fc714160b70 0x7fc7140d1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35406/0 (socket says 172.21.15.2:35406) 2023-11-25T04:09:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.960+0000 7fc718f78640 1 -- 172.21.15.2:0/1414846431 learned_addr learned my addr 172.21.15.2:0/1414846431 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.961+0000 7fc719779640 1 --2- 172.21.15.2:0/1414846431 >> v2:172.21.15.66:3300/0 conn(0x7fc7140cef00 0x7fc714161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.961+0000 7fc718f78640 1 -- 172.21.15.2:0/1414846431 >> v2:172.21.15.66:3300/0 conn(0x7fc7140cef00 msgr2=0x7fc714161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.961+0000 7fc718f78640 1 --2- 172.21.15.2:0/1414846431 >> v2:172.21.15.66:3300/0 conn(0x7fc7140cef00 0x7fc714161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.961+0000 7fc718f78640 1 -- 172.21.15.2:0/1414846431 >> v1:172.21.15.66:6789/0 conn(0x7fc7140b2aa0 legacy=0x7fc7140ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.961+0000 7fc718f78640 1 -- 172.21.15.2:0/1414846431 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7140d1c70 con 0x7fc714160b70 2023-11-25T04:09:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.961+0000 7fc718f78640 1 --2- 172.21.15.2:0/1414846431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc714160b70 0x7fc7140d1570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc714072b40 tx=0x7fc70c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f327939389f8eeb0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc7137fe640 1 -- 172.21.15.2:0/1414846431 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c02cb20 con 0x7fc714160b70 2023-11-25T04:09:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc7137fe640 1 -- 172.21.15.2:0/1414846431 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70c02cc80 con 0x7fc714160b70 2023-11-25T04:09:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc7137fe640 1 -- 172.21.15.2:0/1414846431 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c0343f0 con 0x7fc714160b70 2023-11-25T04:09:34.969 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc71b1dc640 1 -- 172.21.15.2:0/1414846431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc714160b70 msgr2=0x7fc7140d1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc71b1dc640 1 --2- 172.21.15.2:0/1414846431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc714160b70 0x7fc7140d1570 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fc714072b40 tx=0x7fc70c02bf80 comp rx=0 tx=0).stop 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc71b1dc640 1 -- 172.21.15.2:0/1414846431 shutdown_connections 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc71b1dc640 1 --2- 172.21.15.2:0/1414846431 >> v2:172.21.15.66:3300/0 conn(0x7fc7140cef00 0x7fc714161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc71b1dc640 1 --2- 172.21.15.2:0/1414846431 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc714160b70 0x7fc7140d1570 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc71b1dc640 1 -- 172.21.15.2:0/1414846431 >> 172.21.15.2:0/1414846431 conn(0x7fc71409c470 msgr2=0x7fc7140d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc71b1dc640 1 -- 172.21.15.2:0/1414846431 shutdown_connections 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.962+0000 7fc71b1dc640 1 -- 172.21.15.2:0/1414846431 wait complete. 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.963+0000 7fc71b1dc640 1 Processor -- start 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.963+0000 7fc71b1dc640 1 -- start start 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc71b1dc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7140b2aa0 0x7fc71406c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc71b1dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7140cef00 0x7fc714158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc71b1dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc714160b70 0x7fc714159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc71b1dc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714159710 con 0x7fc7140cef00 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc71b1dc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc714158b00 con 0x7fc714160b70 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc71b1dc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc714158de0 con 0x7fc7140b2aa0 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc713fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7140cef00 0x7fc714158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc713fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7140cef00 0x7fc714158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35418/0 (socket says 172.21.15.2:35418) 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc713fff640 1 -- 172.21.15.2:0/3428763728 learned_addr learned my addr 172.21.15.2:0/3428763728 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.964+0000 7fc719779640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc714160b70 0x7fc714159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc718f78640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7140b2aa0 0x7fc71406c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.971 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc713fff640 1 -- 172.21.15.2:0/3428763728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7140b2aa0 msgr2=0x7fc71406c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc713fff640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7140b2aa0 0x7fc71406c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc713fff640 1 -- 172.21.15.2:0/3428763728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc714160b70 msgr2=0x7fc714159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc713fff640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc714160b70 0x7fc714159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc713fff640 1 -- 172.21.15.2:0/3428763728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c009b30 con 0x7fc7140cef00 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc713fff640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7140cef00 0x7fc714158190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc70800c400 tx=0x7fc70800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc7117fa640 1 -- 172.21.15.2:0/3428763728 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080052d0 con 0x7fc7140cef00 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc7117fa640 1 -- 172.21.15.2:0/3428763728 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc708005430 con 0x7fc7140cef00 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7141590c0 con 0x7fc7140cef00 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc7117fa640 1 -- 172.21.15.2:0/3428763728 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708003830 con 0x7fc7140cef00 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.965+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71406cb90 con 0x7fc7140cef00 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.966+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7141598c0 con 0x7fc7140cef00 2023-11-25T04:09:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.967+0000 7fc7117fa640 1 -- 172.21.15.2:0/3428763728 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc708003990 con 0x7fc7140cef00 2023-11-25T04:09:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.967+0000 7fc7117fa640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc70006ae40 0x7fc70006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.967+0000 7fc7117fa640 1 -- 172.21.15.2:0/3428763728 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc708088ac0 con 0x7fc7140cef00 2023-11-25T04:09:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.967+0000 7fc718f78640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc70006ae40 0x7fc70006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:34.973 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.968+0000 7fc718f78640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc70006ae40 0x7fc70006d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc70c035000 tx=0x7fc70c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:34.971+0000 7fc7117fa640 1 -- 172.21.15.2:0/3428763728 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7141598c0 con 0x7fc7140cef00 2023-11-25T04:09:35.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.187+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc71406cd20 con 0x7fc7140cef00 2023-11-25T04:09:35.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.195+0000 7fc7117fa640 1 -- 172.21.15.2:0/3428763728 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v14) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc7080170b0 con 0x7fc7140cef00 2023-11-25T04:09:35.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc70006ae40 msgr2=0x7fc70006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:35.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc70006ae40 0x7fc70006d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc70c035000 tx=0x7fc70c030000 comp rx=0 tx=0).stop 2023-11-25T04:09:35.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7140cef00 msgr2=0x7fc714158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:35.199 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7140cef00 0x7fc714158190 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc70800c400 tx=0x7fc70800c8c0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 shutdown_connections 2023-11-25T04:09:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fc70006ae40 0x7fc70006d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc714160b70 0x7fc714159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fc7140cef00 0x7fc714158190 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 --2- 172.21.15.2:0/3428763728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7140b2aa0 0x7fc71406c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 >> 172.21.15.2:0/3428763728 conn(0x7fc71409c470 msgr2=0x7fc7140b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 shutdown_connections 2023-11-25T04:09:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.197+0000 7fc71b1dc640 1 -- 172.21.15.2:0/3428763728 wait complete. 2023-11-25T04:09:35.211 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-25T04:09:35.212 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-25T04:09:35.321 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.319+0000 7f441b124640 1 Processor -- start 2023-11-25T04:09:35.322 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.320+0000 7f441b124640 1 -- start start 2023-11-25T04:09:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.320+0000 7f441b124640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4414160b70 0x7f44140d1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.320+0000 7f441b124640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f44140b2aa0 0x7f44140ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.320+0000 7f441b124640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44140ce360 con 0x7f44140ced30 2023-11-25T04:09:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.320+0000 7f441b124640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44140b2f20 con 0x7f44140b2aa0 2023-11-25T04:09:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.320+0000 7f441b124640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44140cdd50 con 0x7f4414160b70 2023-11-25T04:09:35.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.320+0000 7f4413fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f44140b2aa0 0x7f44140ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.320+0000 7f44196c1640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f44140ced30 0x7f44140cfb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42930/0 (socket says 172.21.15.2:42930) 2023-11-25T04:09:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.320+0000 7f44196c1640 1 -- 172.21.15.2:0/2773002026 learned_addr learned my addr 172.21.15.2:0/2773002026 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.321+0000 7f4418ec0640 1 --2- 172.21.15.2:0/2773002026 >> v2:172.21.15.66:3300/0 conn(0x7f4414160b70 0x7f44140d1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.321+0000 7f4413fff640 1 -- 172.21.15.2:0/2773002026 >> v2:172.21.15.66:3300/0 conn(0x7f4414160b70 msgr2=0x7f44140d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.321+0000 7f4413fff640 1 --2- 172.21.15.2:0/2773002026 >> v2:172.21.15.66:3300/0 conn(0x7f4414160b70 0x7f44140d1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.321+0000 7f4413fff640 1 -- 172.21.15.2:0/2773002026 >> v1:172.21.15.2:6789/0 conn(0x7f44140ced30 legacy=0x7f44140cfb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.321+0000 7f44137fe640 1 -- 172.21.15.2:0/2773002026 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344276780 0 0) 0x7f44140ce360 con 0x7f44140ced30 2023-11-25T04:09:35.324 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.321+0000 7f4413fff640 1 -- 172.21.15.2:0/2773002026 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44140d1c70 con 0x7f44140b2aa0 2023-11-25T04:09:35.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f4413fff640 1 --2- 172.21.15.2:0/2773002026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 0x7f44140ce7f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f441408ca80 tx=0x7f440002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872efc8e1ed40141 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:35.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f44137fe640 1 -- 172.21.15.2:0/2773002026 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400031830 con 0x7f44140b2aa0 2023-11-25T04:09:35.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f44137fe640 1 -- 172.21.15.2:0/2773002026 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4400031990 con 0x7f44140b2aa0 2023-11-25T04:09:35.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f44137fe640 1 -- 172.21.15.2:0/2773002026 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4400031d20 con 0x7f44140b2aa0 2023-11-25T04:09:35.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f441b124640 1 -- 172.21.15.2:0/2773002026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 msgr2=0x7f44140ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:35.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f441b124640 1 --2- 172.21.15.2:0/2773002026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 0x7f44140ce7f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f441408ca80 tx=0x7f440002b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f441b124640 1 -- 172.21.15.2:0/2773002026 shutdown_connections 2023-11-25T04:09:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f441b124640 1 --2- 172.21.15.2:0/2773002026 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 0x7f44140ce7f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f441b124640 1 --2- 172.21.15.2:0/2773002026 >> v2:172.21.15.66:3300/0 conn(0x7f4414160b70 0x7f44140d1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f441b124640 1 -- 172.21.15.2:0/2773002026 >> 172.21.15.2:0/2773002026 conn(0x7f441409c470 msgr2=0x7f44140d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f441b124640 1 -- 172.21.15.2:0/2773002026 shutdown_connections 2023-11-25T04:09:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.322+0000 7f441b124640 1 -- 172.21.15.2:0/2773002026 wait complete. 2023-11-25T04:09:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.323+0000 7f441b124640 1 Processor -- start 2023-11-25T04:09:35.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.324+0000 7f441b124640 1 -- start start 2023-11-25T04:09:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.324+0000 7f441b124640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 0x7f441409fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.324+0000 7f441b124640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140ced30 0x7f441409d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:35.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.324+0000 7f441b124640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4414160b70 0x7f44140c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.324+0000 7f441b124640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f441415dc70 con 0x7f44140b2aa0 2023-11-25T04:09:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.324+0000 7f441b124640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44140a02f0 con 0x7f44140ced30 2023-11-25T04:09:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.324+0000 7f441b124640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44140a05d0 con 0x7f4414160b70 2023-11-25T04:09:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.324+0000 7f4418ec0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 0x7f441409fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4418ec0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 0x7f441409fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35440/0 (socket says 172.21.15.2:35440) 2023-11-25T04:09:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4418ec0640 1 -- 172.21.15.2:0/1286985445 learned_addr learned my addr 172.21.15.2:0/1286985445 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4413fff640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140ced30 0x7f441409d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4418ec0640 1 -- 172.21.15.2:0/1286985445 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4414160b70 msgr2=0x7f44140c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:35.330 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4418ec0640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4414160b70 0x7f44140c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4418ec0640 1 -- 172.21.15.2:0/1286985445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140ced30 msgr2=0x7f441409d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:35.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4418ec0640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140ced30 0x7f441409d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:35.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4418ec0640 1 -- 172.21.15.2:0/1286985445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400009400 con 0x7f44140b2aa0 2023-11-25T04:09:35.331 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4413fff640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140ced30 0x7f441409d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f4418ec0640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 0x7f441409fac0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f440800d5f0 tx=0x7f440800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f44117fa640 1 -- 172.21.15.2:0/1286985445 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44080125f0 con 0x7f44140b2aa0 2023-11-25T04:09:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f44117fa640 1 -- 172.21.15.2:0/1286985445 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4408012750 con 0x7f44140b2aa0 2023-11-25T04:09:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44140a08b0 con 0x7f44140b2aa0 2023-11-25T04:09:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f44117fa640 1 -- 172.21.15.2:0/1286985445 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4408012b00 con 0x7f44140b2aa0 2023-11-25T04:09:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.325+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44140a0000 con 0x7f44140b2aa0 2023-11-25T04:09:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.326+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44140a1150 con 0x7f44140b2aa0 2023-11-25T04:09:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.327+0000 7f44117fa640 1 -- 172.21.15.2:0/1286985445 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4408012c60 con 0x7f44140b2aa0 2023-11-25T04:09:35.336 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.327+0000 7f44117fa640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f43f806ae40 0x7f43f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.327+0000 7f44117fa640 1 -- 172.21.15.2:0/1286985445 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4408089a70 con 0x7f44140b2aa0 2023-11-25T04:09:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.327+0000 7f4413fff640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f43f806ae40 0x7f43f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.328+0000 7f4413fff640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f43f806ae40 0x7f43f806d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4400036000 tx=0x7f4400008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:35.337 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.331+0000 7f44117fa640 1 -- 172.21.15.2:0/1286985445 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4408054bb0 con 0x7f44140b2aa0 2023-11-25T04:09:35.547 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:35.546+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f44140b22d0 con 0x7f44140b2aa0 2023-11-25T04:09:36.210 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.208+0000 7f44117fa640 1 -- 172.21.15.2:0/1286985445 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v15) v1 ==== 122+0+0 (secure 0 0 0) 0x7f44080581d0 con 0x7f44140b2aa0 2023-11-25T04:09:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.210+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f43f806ae40 msgr2=0x7f43f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.210+0000 7f441b124640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f43f806ae40 0x7f43f806d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4400036000 tx=0x7f4400008030 comp rx=0 tx=0).stop 2023-11-25T04:09:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.210+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 msgr2=0x7f441409fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.210+0000 7f441b124640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 0x7f441409fac0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f440800d5f0 tx=0x7f440800dab0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.211+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 shutdown_connections 2023-11-25T04:09:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.211+0000 7f441b124640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4414160b70 0x7f44140c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.211+0000 7f441b124640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f43f806ae40 0x7f43f806d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.211+0000 7f441b124640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44140ced30 0x7f441409d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.213 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.211+0000 7f441b124640 1 --2- 172.21.15.2:0/1286985445 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f44140b2aa0 0x7f441409fac0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.211+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 >> 172.21.15.2:0/1286985445 conn(0x7f441409c470 msgr2=0x7f44140b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.211+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 shutdown_connections 2023-11-25T04:09:36.214 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.211+0000 7f441b124640 1 -- 172.21.15.2:0/1286985445 wait complete. 2023-11-25T04:09:36.226 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-25T04:09:36.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:09:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.338+0000 7f22b11b7640 1 Processor -- start 2023-11-25T04:09:36.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.338+0000 7f22b11b7640 1 -- start start 2023-11-25T04:09:36.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22b11b7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f22ac142d20 0x7f22ac071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22b11b7640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22ac0b1df0 0x7f22ac06d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22b11b7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac0b3130 con 0x7f22ac06da60 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22b11b7640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac06ded0 con 0x7f22ac0b1df0 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22b11b7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac143100 con 0x7f22ac142d20 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22a259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22ac0b1df0 0x7f22ac06d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22a259c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f22ac0b1df0 0x7f22ac06d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35448/0 (socket says 172.21.15.2:35448) 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22a259c640 1 -- 172.21.15.2:0/461762411 learned_addr learned my addr 172.21.15.2:0/461762411 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22aad9d640 1 --2- 172.21.15.2:0/461762411 >> v2:172.21.15.66:3300/0 conn(0x7f22ac142d20 0x7f22ac071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22a259c640 1 -- 172.21.15.2:0/461762411 >> v2:172.21.15.66:3300/0 conn(0x7f22ac142d20 msgr2=0x7f22ac071f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22a259c640 1 --2- 172.21.15.2:0/461762411 >> v2:172.21.15.66:3300/0 conn(0x7f22ac142d20 0x7f22ac071f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22a259c640 1 -- 172.21.15.2:0/461762411 >> v1:172.21.15.66:6789/0 conn(0x7f22ac06da60 legacy=0x7f22ac0b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.339+0000 7f22a259c640 1 -- 172.21.15.2:0/461762411 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0b2250 con 0x7f22ac0b1df0 2023-11-25T04:09:36.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.340+0000 7f22a259c640 1 --2- 172.21.15.2:0/461762411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 0x7f22ac06d520 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06ba70 tx=0x7f229402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55826b1b748366c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.340+0000 7f22aa59c640 1 -- 172.21.15.2:0/461762411 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294031870 con 0x7f22ac0b1df0 2023-11-25T04:09:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.340+0000 7f22aa59c640 1 -- 172.21.15.2:0/461762411 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22940319d0 con 0x7f22ac0b1df0 2023-11-25T04:09:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.340+0000 7f22aa59c640 1 -- 172.21.15.2:0/461762411 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294031d60 con 0x7f22ac0b1df0 2023-11-25T04:09:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.341+0000 7f22b11b7640 1 -- 172.21.15.2:0/461762411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 msgr2=0x7f22ac06d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.341+0000 7f22b11b7640 1 --2- 172.21.15.2:0/461762411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 0x7f22ac06d520 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f22ac06ba70 tx=0x7f229402b910 comp rx=0 tx=0).stop 2023-11-25T04:09:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.341+0000 7f22b11b7640 1 -- 172.21.15.2:0/461762411 shutdown_connections 2023-11-25T04:09:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.341+0000 7f22b11b7640 1 --2- 172.21.15.2:0/461762411 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 0x7f22ac06d520 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.341+0000 7f22b11b7640 1 --2- 172.21.15.2:0/461762411 >> v2:172.21.15.66:3300/0 conn(0x7f22ac142d20 0x7f22ac071f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.341+0000 7f22b11b7640 1 -- 172.21.15.2:0/461762411 >> 172.21.15.2:0/461762411 conn(0x7f22ac0b0af0 msgr2=0x7f22ac0b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.341+0000 7f22b11b7640 1 -- 172.21.15.2:0/461762411 shutdown_connections 2023-11-25T04:09:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.341+0000 7f22b11b7640 1 -- 172.21.15.2:0/461762411 wait complete. 2023-11-25T04:09:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.342+0000 7f22b11b7640 1 Processor -- start 2023-11-25T04:09:36.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.342+0000 7f22b11b7640 1 -- start start 2023-11-25T04:09:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22b11b7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22ac06da60 0x7f22ac13d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22b11b7640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 0x7f22ac13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22b11b7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac142d20 0x7f22ac140400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22b11b7640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac1fb640 con 0x7f22ac0b1df0 2023-11-25T04:09:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22b11b7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0aba60 con 0x7f22ac142d20 2023-11-25T04:09:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22b11b7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0a8570 con 0x7f22ac06da60 2023-11-25T04:09:36.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22a259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 0x7f22ac13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22a259c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 0x7f22ac13fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35452/0 (socket says 172.21.15.2:35452) 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22a259c640 1 -- 172.21.15.2:0/3260612837 learned_addr learned my addr 172.21.15.2:0/3260612837 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22ab59e640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac142d20 0x7f22ac140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22aad9d640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22ac06da60 0x7f22ac13d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22a259c640 1 -- 172.21.15.2:0/3260612837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22ac06da60 msgr2=0x7f22ac13d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22a259c640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22ac06da60 0x7f22ac13d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22a259c640 1 -- 172.21.15.2:0/3260612837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac142d20 msgr2=0x7f22ac140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22a259c640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac142d20 0x7f22ac140400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22a259c640 1 -- 172.21.15.2:0/3260612837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22940094d0 con 0x7f22ac0b1df0 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.343+0000 7f22ab59e640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac142d20 0x7f22ac140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.344+0000 7f22a259c640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 0x7f22ac13fec0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f229402b950 tx=0x7f22940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:36.348 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.344+0000 7f22a3fff640 1 -- 172.21.15.2:0/3260612837 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229403ad30 con 0x7f22ac0b1df0 2023-11-25T04:09:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.344+0000 7f22a3fff640 1 -- 172.21.15.2:0/3260612837 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22940443f0 con 0x7f22ac0b1df0 2023-11-25T04:09:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.344+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ac0a8850 con 0x7f22ac0b1df0 2023-11-25T04:09:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.344+0000 7f22a3fff640 1 -- 172.21.15.2:0/3260612837 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22940447a0 con 0x7f22ac0b1df0 2023-11-25T04:09:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.344+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac0a8e10 con 0x7f22ac0b1df0 2023-11-25T04:09:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.345+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac067420 con 0x7f22ac0b1df0 2023-11-25T04:09:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.345+0000 7f22a3fff640 1 -- 172.21.15.2:0/3260612837 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f229404d450 con 0x7f22ac0b1df0 2023-11-25T04:09:36.349 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.346+0000 7f22a3fff640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f228c06ae40 0x7f228c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.346+0000 7f22a3fff640 1 -- 172.21.15.2:0/3260612837 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f229402d040 con 0x7f22ac0b1df0 2023-11-25T04:09:36.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.346+0000 7f22aad9d640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f228c06ae40 0x7f228c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.350 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.346+0000 7f22aad9d640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f228c06ae40 0x7f228c06d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f229c006fd0 tx=0x7f229c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:36.354 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.350+0000 7f22a3fff640 1 -- 172.21.15.2:0/3260612837 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2294076cd0 con 0x7f22ac0b1df0 2023-11-25T04:09:36.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:09:36.528 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:09:36.563 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.561+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22ac140d70 con 0x7f22ac0b1df0 2023-11-25T04:09:36.564 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.562+0000 7f22a3fff640 1 -- 172.21.15.2:0/3260612837 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f2294035070 con 0x7f22ac0b1df0 2023-11-25T04:09:36.564 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:36.564 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3409201819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3409201819},{"type":"v1","addr":"172.21.15.66:6835","nonce":3409201819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5077,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1057929535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1057929535},{"type":"v1","addr":"172.21.15.66:6834","nonce":1057929535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2836978310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":2836978310},{"type":"v1","addr":"172.21.15.2:6837","nonce":2836978310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:09:33.548399+0000","modified":"2023-11-25T04:09:35.547521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6836/1180484123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1180484123},{"type":"v1","addr":"172.21.15.2:6836","nonce":1180484123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-25T04:09:36.564 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 15 2023-11-25T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f228c06ae40 msgr2=0x7f228c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f228c06ae40 0x7f228c06d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f229c006fd0 tx=0x7f229c008040 comp rx=0 tx=0).stop 2023-11-25T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 msgr2=0x7f22ac13fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 0x7f22ac13fec0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f229402b950 tx=0x7f22940046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 shutdown_connections 2023-11-25T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f228c06ae40 0x7f228c06d300 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22ac142d20 0x7f22ac140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.566 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f22ac0b1df0 0x7f22ac13fec0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 --2- 172.21.15.2:0/3260612837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22ac06da60 0x7f22ac13d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 >> 172.21.15.2:0/3260612837 conn(0x7f22ac0b0af0 msgr2=0x7f22ac0b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 shutdown_connections 2023-11-25T04:09:36.567 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.564+0000 7f22b11b7640 1 -- 172.21.15.2:0/3260612837 wait complete. 2023-11-25T04:09:36.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-25T04:09:36.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.740+0000 7f7d4afb0640 1 Processor -- start 2023-11-25T04:09:36.742 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.740+0000 7f7d4afb0640 1 -- start start 2023-11-25T04:09:36.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.740+0000 7f7d4afb0640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7d440b2690 0x7f7d4415d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.740+0000 7f7d4afb0640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4406e9e0 con 0x7f7d4406a8b0 2023-11-25T04:09:36.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.741+0000 7f7d4afb0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4406de60 con 0x7f7d4406cc50 2023-11-25T04:09:36.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.741+0000 7f7d4afb0640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4406d0d0 con 0x7f7d440b2690 2023-11-25T04:09:36.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.741+0000 7f7d48d4c640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f7d440b2690 0x7f7d4415d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.741+0000 7f7d4954d640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f7d4406a8b0 0x7f7d4406ad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42944/0 (socket says 172.21.15.2:42944) 2023-11-25T04:09:36.743 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.741+0000 7f7d4954d640 1 -- 172.21.15.2:0/338883766 learned_addr learned my addr 172.21.15.2:0/338883766 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:36.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.741+0000 7f7d48d4c640 1 -- 172.21.15.2:0/338883766 >> v1:172.21.15.66:6789/0 conn(0x7f7d4406cc50 legacy=0x7f7d440b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:36.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.741+0000 7f7d48d4c640 1 -- 172.21.15.2:0/338883766 >> v1:172.21.15.2:6789/0 conn(0x7f7d4406a8b0 legacy=0x7f7d4406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.744 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.741+0000 7f7d48d4c640 1 -- 172.21.15.2:0/338883766 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4406d2e0 con 0x7f7d440b2690 2023-11-25T04:09:36.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d48d4c640 1 --2- 172.21.15.2:0/338883766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440b2690 0x7f7d4415d800 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7d380097a0 tx=0x7f7d3802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae31e9cde5283cc server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:36.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d437fe640 1 -- 172.21.15.2:0/338883766 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3802e070 con 0x7f7d440b2690 2023-11-25T04:09:36.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d437fe640 1 -- 172.21.15.2:0/338883766 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d380315a0 con 0x7f7d440b2690 2023-11-25T04:09:36.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d437fe640 1 -- 172.21.15.2:0/338883766 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38031930 con 0x7f7d440b2690 2023-11-25T04:09:36.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d4afb0640 1 -- 172.21.15.2:0/338883766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440b2690 msgr2=0x7f7d4415d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d4afb0640 1 --2- 172.21.15.2:0/338883766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440b2690 0x7f7d4415d800 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7d380097a0 tx=0x7f7d3802b840 comp rx=0 tx=0).stop 2023-11-25T04:09:36.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d4afb0640 1 -- 172.21.15.2:0/338883766 shutdown_connections 2023-11-25T04:09:36.745 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d4afb0640 1 --2- 172.21.15.2:0/338883766 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d440b2690 0x7f7d4415d800 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d4afb0640 1 -- 172.21.15.2:0/338883766 >> 172.21.15.2:0/338883766 conn(0x7f7d440cf6a0 msgr2=0x7f7d440cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:36.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.742+0000 7f7d4afb0640 1 -- 172.21.15.2:0/338883766 shutdown_connections 2023-11-25T04:09:36.746 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.743+0000 7f7d4afb0640 1 -- 172.21.15.2:0/338883766 wait complete. 2023-11-25T04:09:36.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.744+0000 7f7d4afb0640 1 Processor -- start 2023-11-25T04:09:36.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.744+0000 7f7d4afb0640 1 -- start start 2023-11-25T04:09:36.748 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.744+0000 7f7d4afb0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d4406a8b0 0x7f7d44154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d4afb0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d4406cc50 0x7f7d440b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d4afb0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d440b2690 0x7f7d441f6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d4afb0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4415f9e0 con 0x7f7d4406a8b0 2023-11-25T04:09:36.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d4afb0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4415f080 con 0x7f7d4406cc50 2023-11-25T04:09:36.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d4afb0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4415f320 con 0x7f7d440b2690 2023-11-25T04:09:36.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d48d4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d4406a8b0 0x7f7d44154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d48d4c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d4406a8b0 0x7f7d44154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35476/0 (socket says 172.21.15.2:35476) 2023-11-25T04:09:36.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d48d4c640 1 -- 172.21.15.2:0/3471668744 learned_addr learned my addr 172.21.15.2:0/3471668744 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:36.749 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d43fff640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d4406cc50 0x7f7d440b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d4954d640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d440b2690 0x7f7d441f6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d48d4c640 1 -- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d440b2690 msgr2=0x7f7d441f6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d48d4c640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d440b2690 0x7f7d441f6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d48d4c640 1 -- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d4406cc50 msgr2=0x7f7d440b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d48d4c640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d4406cc50 0x7f7d440b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d48d4c640 1 -- 172.21.15.2:0/3471668744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38009400 con 0x7f7d4406a8b0 2023-11-25T04:09:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d4954d640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d440b2690 0x7f7d441f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d43fff640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d4406cc50 0x7f7d440b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:36.750 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d48d4c640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d4406a8b0 0x7f7d44154650 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7d38034040 tx=0x7f7d380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d417fa640 1 -- 172.21.15.2:0/3471668744 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38032900 con 0x7f7d4406a8b0 2023-11-25T04:09:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d417fa640 1 -- 172.21.15.2:0/3471668744 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d38032a80 con 0x7f7d4406a8b0 2023-11-25T04:09:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.745+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4415f600 con 0x7f7d4406a8b0 2023-11-25T04:09:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.746+0000 7f7d417fa640 1 -- 172.21.15.2:0/3471668744 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38032e30 con 0x7f7d4406a8b0 2023-11-25T04:09:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.746+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d44154c30 con 0x7f7d4406a8b0 2023-11-25T04:09:36.751 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.747+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4415f790 con 0x7f7d4406a8b0 2023-11-25T04:09:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.747+0000 7f7d417fa640 1 -- 172.21.15.2:0/3471668744 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d3803b3f0 con 0x7f7d4406a8b0 2023-11-25T04:09:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.747+0000 7f7d417fa640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7d2806ae40 0x7f7d2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.747+0000 7f7d417fa640 1 -- 172.21.15.2:0/3471668744 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d380ab720 con 0x7f7d4406a8b0 2023-11-25T04:09:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.747+0000 7f7d43fff640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7d2806ae40 0x7f7d2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:36.752 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.748+0000 7f7d43fff640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7d2806ae40 0x7f7d2806d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7d44157eb0 tx=0x7f7d30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.752+0000 7f7d417fa640 1 -- 172.21.15.2:0/3471668744 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d38076730 con 0x7f7d4406a8b0 2023-11-25T04:09:36.930 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.928+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d44067420 con 0x7f7d4406a8b0 2023-11-25T04:09:36.931 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.929+0000 7f7d417fa640 1 -- 172.21.15.2:0/3471668744 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f7d38079d50 con 0x7f7d4406a8b0 2023-11-25T04:09:36.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:36.931 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":33,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","created":"2023-11-25T04:08:11.233901+0000","modified":"2023-11-25T04:09:35.195806+0000","last_up_change":"2023-11-25T04:08:22.000782+0000","last_in_change":"2023-11-25T04:08:13.508344+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-25T04:08:23.531706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-25T04:09:32.107662+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-25T04:09:32.517411+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"44938ca7-aceb-48bf-b5cd-a09207612789","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6801","nonce":1139472044}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6803","nonce":1139472044}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6807","nonce":1139472044}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":1139472044},{"type":"v1","addr":"172.21.15.2:6805","nonce":1139472044}]},"public_addr":"172.21.15.2:6801/1139472044","cluster_addr":"172.21.15.2:6803/1139472044","heartbeat_back_addr":"172.21.15.2:6807/1139472044","heartbeat_front_addr":"172.21.15.2:6805/1139472044","state":["exists","up"]},{"osd":1,"uuid":"8ccfc905-ca85-49a2-b8de-55b046520b69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6809","nonce":320707223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6811","nonce":320707223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6815","nonce":320707223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":320707223},{"type":"v1","addr":"172.21.15.2:6813","nonce":320707223}]},"public_addr":"172.21.15.2:6809/320707223","cluster_addr":"172.21.15.2:6811/320707223","heartbeat_back_addr":"172.21.15.2:6815/320707223","heartbeat_front_addr":"172.21.15.2:6813/320707223","state":["exists","up"]},{"osd":2,"uuid":"e3cfe9ea-a431-4cf6-b975-9c0ae7ce2114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6817","nonce":2090563035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6819","nonce":2090563035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6825","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6827","nonce":2090563035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6821","nonce":2090563035},{"type":"v1","addr":"172.21.15.2:6823","nonce":2090563035}]},"public_addr":"172.21.15.2:6817/2090563035","cluster_addr":"172.21.15.2:6819/2090563035","heartbeat_back_addr":"172.21.15.2:6827/2090563035","heartbeat_front_addr":"172.21.15.2:6823/2090563035","state":["exists","up"]},{"osd":3,"uuid":"0b6d6f7a-fd76-43b0-a900-b7b28a3c6c49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6822","nonce":2242650320}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6826","nonce":2242650320}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6831","nonce":2242650320}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":2242650320},{"type":"v1","addr":"172.21.15.2:6829","nonce":2242650320}]},"public_addr":"172.21.15.2:6822/2242650320","cluster_addr":"172.21.15.2:6826/2242650320","heartbeat_back_addr":"172.21.15.2:6831/2242650320","heartbeat_front_addr":"172.21.15.2:6829/2242650320","state":["exists","up"]},{"osd":4,"uuid":"642a0a7a-ab80-492d-b1b1-2ea579d98bb0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6825","nonce":783473334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6827","nonce":783473334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6831","nonce":783473334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":783473334},{"type":"v1","addr":"172.21.15.66:6829","nonce":783473334}]},"public_addr":"172.21.15.66:6825/783473334","cluster_addr":"172.21.15.66:6827/783473334","heartbeat_back_addr":"172.21.15.66:6831/783473334","heartbeat_front_addr":"172.21.15.66:6829/783473334","state":["exists","up"]},{"osd":5,"uuid":"f50fedc1-4042-49ff-845c-219ddccc5211","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6801","nonce":2128834759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6803","nonce":2128834759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6810","nonce":2128834759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":2128834759},{"type":"v1","addr":"172.21.15.66:6806","nonce":2128834759}]},"public_addr":"172.21.15.66:6801/2128834759","cluster_addr":"172.21.15.66:6803/2128834759","heartbeat_back_addr":"172.21.15.66:6810/2128834759","heartbeat_front_addr":"172.21.15.66:6806/2128834759","state":["exists","up"]},{"osd":6,"uuid":"320e932d-0878-4a4a-9cd1-4778a48f8390","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6807","nonce":1011790605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6811","nonce":1011790605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6815","nonce":1011790605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":1011790605},{"type":"v1","addr":"172.21.15.66:6813","nonce":1011790605}]},"public_addr":"172.21.15.66:6807/1011790605","cluster_addr":"172.21.15.66:6811/1011790605","heartbeat_back_addr":"172.21.15.66:6815/1011790605","heartbeat_front_addr":"172.21.15.66:6813/1011790605","state":["exists","up"]},{"osd":7,"uuid":"ec16e94a-6184-41c7-8d89-d034f7a106a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6817","nonce":3662709756}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6819","nonce":3662709756}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6823","nonce":3662709756}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":3662709756},{"type":"v1","addr":"172.21.15.66:6821","nonce":3662709756}]},"public_addr":"172.21.15.66:6817/3662709756","cluster_addr":"172.21.15.66:6819/3662709756","heartbeat_back_addr":"172.21.15.66:6823/3662709756","heartbeat_front_addr":"172.21.15.66:6821/3662709756","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.657311+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669629+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.713532+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.669453+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.709255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.652243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.536594+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-25T04:08:18.649433+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-25T04:09:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7d2806ae40 msgr2=0x7f7d2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7d2806ae40 0x7f7d2806d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7d44157eb0 tx=0x7f7d30009040 comp rx=0 tx=0).stop 2023-11-25T04:09:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d4406a8b0 msgr2=0x7f7d44154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d4406a8b0 0x7f7d44154650 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7d38034040 tx=0x7f7d380046c0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.933 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 shutdown_connections 2023-11-25T04:09:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d440b2690 0x7f7d441f6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f7d2806ae40 0x7f7d2806d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d4406cc50 0x7f7d440b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 --2- 172.21.15.2:0/3471668744 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f7d4406a8b0 0x7f7d44154650 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 >> 172.21.15.2:0/3471668744 conn(0x7f7d440cf6a0 msgr2=0x7f7d440ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 shutdown_connections 2023-11-25T04:09:36.934 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:36.931+0000 7f7d4afb0640 1 -- 172.21.15.2:0/3471668744 wait complete. 2023-11-25T04:09:36.944 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-25T04:09:36.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-25T04:09:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.048+0000 7fd83cc15640 1 Processor -- start 2023-11-25T04:09:37.050 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.048+0000 7fd83cc15640 1 -- start start 2023-11-25T04:09:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.049+0000 7fd83cc15640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8380d1720 0x7fd8380d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.049+0000 7fd83cc15640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8380b3db0 0x7fd8380b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.049+0000 7fd83cc15640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8380b5f90 con 0x7fd83815d3e0 2023-11-25T04:09:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.049+0000 7fd83cc15640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8380d20a0 con 0x7fd8380b3db0 2023-11-25T04:09:37.051 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.049+0000 7fd83cc15640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380b61e0 con 0x7fd8380d1720 2023-11-25T04:09:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.049+0000 7fd83659c640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fd83815d3e0 0x7fd8380ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42960/0 (socket says 172.21.15.2:42960) 2023-11-25T04:09:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.049+0000 7fd83659c640 1 -- 172.21.15.2:0/2369414570 learned_addr learned my addr 172.21.15.2:0/2369414570 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd836d9d640 1 --2- 172.21.15.2:0/2369414570 >> v2:172.21.15.66:3300/0 conn(0x7fd8380b3db0 0x7fd8380b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd835d9b640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8380d1720 0x7fd8380d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561858097 0 0) 0x7fd8380b5f90 con 0x7fd83815d3e0 2023-11-25T04:09:37.055 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd824003520 con 0x7fd83815d3e0 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3670723899 0 0) 0x7fd824003520 con 0x7fd83815d3e0 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8380d1720 msgr2=0x7fd8380d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8380d1720 0x7fd8380d1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 >> v2:172.21.15.66:3300/0 conn(0x7fd8380b3db0 msgr2=0x7fd8380b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 --2- 172.21.15.2:0/2369414570 >> v2:172.21.15.66:3300/0 conn(0x7fd8380b3db0 0x7fd8380b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8380b64c0 con 0x7fd83815d3e0 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7fd8280019f0 con 0x7fd83815d3e0 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd836d9d640 1 --2- 172.21.15.2:0/2369414570 >> v2:172.21.15.66:3300/0 conn(0x7fd8380b3db0 0x7fd8380b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 >> v1:172.21.15.2:6789/0 conn(0x7fd83815d3e0 legacy=0x7fd8380ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.056 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8380d1720 0x7fd824003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd824003ef0 0x7fd8240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd824004d00 0x7fd824005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380d20a0 con 0x7fd824004d00 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380b61e0 con 0x7fd824003ef0 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82400b980 con 0x7fd8380d1720 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd836d9d640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd824004d00 0x7fd824005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd83659c640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8380d1720 0x7fd824003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.050+0000 7fd835d9b640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd824003ef0 0x7fd8240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.051+0000 7fd836d9d640 1 -- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8380d1720 msgr2=0x7fd824003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.051+0000 7fd836d9d640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8380d1720 0x7fd824003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.051+0000 7fd836d9d640 1 -- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd824003ef0 msgr2=0x7fd8240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.051+0000 7fd836d9d640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd824003ef0 0x7fd8240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.057 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.051+0000 7fd836d9d640 1 -- 172.21.15.2:0/2369414570 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824003520 con 0x7fd824004d00 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.051+0000 7fd836d9d640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd824004d00 0x7fd824005180 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd830009c90 tx=0x7fd8240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d79319549a51e server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.051+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83002c980 con 0x7fd824004d00 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.051+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83002cae0 con 0x7fd824004d00 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.051+0000 7fd83559a640 1 -- 172.21.15.2:0/2369414570 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830034440 con 0x7fd824004d00 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.052+0000 7fd83cc15640 1 -- 172.21.15.2:0/2369414570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd824004d00 msgr2=0x7fd824005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.052+0000 7fd83cc15640 1 --2- 172.21.15.2:0/2369414570 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd824004d00 0x7fd824005180 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd830009c90 tx=0x7fd8240057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.052+0000 7fd836d9d640 1 -- 172.21.15.2:0/2369414570 reap_dead start 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.052+0000 7fd83cc15640 1 -- 172.21.15.2:0/2369414570 shutdown_connections 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.052+0000 7fd83cc15640 1 -- 172.21.15.2:0/2369414570 >> 172.21.15.2:0/2369414570 conn(0x7fd83809c480 msgr2=0x7fd8380d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.052+0000 7fd83cc15640 1 -- 172.21.15.2:0/2369414570 shutdown_connections 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.052+0000 7fd83cc15640 1 -- 172.21.15.2:0/2369414570 wait complete. 2023-11-25T04:09:37.058 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.053+0000 7fd83cc15640 1 Processor -- start 2023-11-25T04:09:37.059 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.053+0000 7fd83cc15640 1 -- start start 2023-11-25T04:09:37.060 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd83cc15640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd824004d00 0x7fd8380b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd83cc15640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8381600f0 0x7fd8380b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd83cc15640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8381f25b0 0x7fd8380b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd83cc15640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381606b0 con 0x7fd8381600f0 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd83cc15640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8380b3c30 con 0x7fd8381f25b0 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd83cc15640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd838151e50 con 0x7fd824004d00 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd835d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8381600f0 0x7fd8380b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd835d9b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8381600f0 0x7fd8380b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35496/0 (socket says 172.21.15.2:35496) 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd835d9b640 1 -- 172.21.15.2:0/524794070 learned_addr learned my addr 172.21.15.2:0/524794070 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd836d9d640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8381f25b0 0x7fd8380b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.054+0000 7fd83659c640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd824004d00 0x7fd8380b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd835d9b640 1 -- 172.21.15.2:0/524794070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd824004d00 msgr2=0x7fd8380b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.061 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd835d9b640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd824004d00 0x7fd8380b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd835d9b640 1 -- 172.21.15.2:0/524794070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8381f25b0 msgr2=0x7fd8380b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd835d9b640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8381f25b0 0x7fd8380b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd835d9b640 1 -- 172.21.15.2:0/524794070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83815f900 con 0x7fd8381600f0 2023-11-25T04:09:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd835d9b640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8381600f0 0x7fd8380b36f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd820011910 tx=0x7fd820011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd82effd640 1 -- 172.21.15.2:0/524794070 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82000fa30 con 0x7fd8381600f0 2023-11-25T04:09:37.062 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd82effd640 1 -- 172.21.15.2:0/524794070 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82000fb90 con 0x7fd8381600f0 2023-11-25T04:09:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83815fbe0 con 0x7fd8381600f0 2023-11-25T04:09:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd82effd640 1 -- 172.21.15.2:0/524794070 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820014440 con 0x7fd8381600f0 2023-11-25T04:09:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.055+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8381f2a60 con 0x7fd8381600f0 2023-11-25T04:09:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.056+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8380b0780 con 0x7fd8381600f0 2023-11-25T04:09:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.057+0000 7fd82effd640 1 -- 172.21.15.2:0/524794070 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd8200145a0 con 0x7fd8381600f0 2023-11-25T04:09:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.057+0000 7fd82effd640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd81806ae40 0x7fd81806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.057+0000 7fd82effd640 1 -- 172.21.15.2:0/524794070 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd820089d00 con 0x7fd8381600f0 2023-11-25T04:09:37.063 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.057+0000 7fd83659c640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd81806ae40 0x7fd81806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.057+0000 7fd83659c640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd81806ae40 0x7fd81806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd8280013d0 tx=0x7fd828006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:37.064 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.061+0000 7fd82effd640 1 -- 172.21.15.2:0/524794070 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd820054db0 con 0x7fd8381600f0 2023-11-25T04:09:37.237 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.235+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 --> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8380b2300 con 0x7fd81806ae40 2023-11-25T04:09:37.244 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.242+0000 7fd82effd640 1 -- 172.21.15.2:0/524794070 <== mgr.4107 v2:172.21.15.2:6832/523998843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277010 (secure 0 0 0) 0x7fd8380b2300 con 0x7fd81806ae40 2023-11-25T04:09:37.247 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:37.249 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-25T04:09:37.251 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd81806ae40 msgr2=0x7fd81806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd81806ae40 0x7fd81806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd8280013d0 tx=0x7fd828006040 comp rx=0 tx=0).stop 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8381600f0 msgr2=0x7fd8380b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8381600f0 0x7fd8380b36f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd820011910 tx=0x7fd820011d10 comp rx=0 tx=0).stop 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 shutdown_connections 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fd81806ae40 0x7fd81806d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8381f25b0 0x7fd8380b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fd8381600f0 0x7fd8380b36f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 --2- 172.21.15.2:0/524794070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd824004d00 0x7fd8380b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 >> 172.21.15.2:0/524794070 conn(0x7fd83809c480 msgr2=0x7fd8380b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:37.252 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 shutdown_connections 2023-11-25T04:09:37.253 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.245+0000 7fd83cc15640 1 -- 172.21.15.2:0/524794070 wait complete. 2023-11-25T04:09:37.258 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-11-25T04:09:35.489018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236580,"kb_used_data":3712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738140,"statfs":{"total":773094113280,"available":772851855360,"internally_reserved":0,"allocated":3801088,"data_stored":2165130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000563"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178326+0000","last_change":"2023-11-25T04:09:32.178326+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178326+0000","last_undegraded":"2023-11-25T04:09:32.178326+0000","last_fullsized":"2023-11-25T04:09:32.178326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.272430+0000","last_change":"2023-11-25T04:09:32.272430+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.272430+0000","last_undegraded":"2023-11-25T04:09:32.272430+0000","last_fullsized":"2023-11-25T04:09:32.272430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173702+0000","last_change":"2023-11-25T04:09:32.173702+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173702+0000","last_undegraded":"2023-11-25T04:09:32.173702+0000","last_fullsized":"2023-11-25T04:09:32.173702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174659+0000","last_change":"2023-11-25T04:09:32.174659+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174659+0000","last_undegraded":"2023-11-25T04:09:32.174659+0000","last_fullsized":"2023-11-25T04:09:32.174659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172083+0000","last_change":"2023-11-25T04:09:32.172083+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172083+0000","last_undegraded":"2023-11-25T04:09:32.172083+0000","last_fullsized":"2023-11-25T04:09:32.172083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171376+0000","last_change":"2023-11-25T04:09:32.171376+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171376+0000","last_undegraded":"2023-11-25T04:09:32.171376+0000","last_fullsized":"2023-11-25T04:09:32.171376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173558+0000","last_change":"2023-11-25T04:09:32.173558+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173558+0000","last_undegraded":"2023-11-25T04:09:32.173558+0000","last_fullsized":"2023-11-25T04:09:32.173558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172061+0000","last_change":"2023-11-25T04:09:32.172061+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172061+0000","last_undegraded":"2023-11-25T04:09:32.172061+0000","last_fullsized":"2023-11-25T04:09:32.172061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173584+0000","last_change":"2023-11-25T04:09:32.173584+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173584+0000","last_undegraded":"2023-11-25T04:09:32.173584+0000","last_fullsized":"2023-11-25T04:09:32.173584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271615+0000","last_change":"2023-11-25T04:09:32.271615+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271615+0000","last_undegraded":"2023-11-25T04:09:32.271615+0000","last_fullsized":"2023-11-25T04:09:32.271615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172016+0000","last_change":"2023-11-25T04:09:32.172016+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172016+0000","last_undegraded":"2023-11-25T04:09:32.172016+0000","last_fullsized":"2023-11-25T04:09:32.172016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173634+0000","last_change":"2023-11-25T04:09:32.173634+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173634+0000","last_undegraded":"2023-11-25T04:09:32.173634+0000","last_fullsized":"2023-11-25T04:09:32.173634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171387+0000","last_change":"2023-11-25T04:09:32.171387+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171387+0000","last_undegraded":"2023-11-25T04:09:32.171387+0000","last_fullsized":"2023-11-25T04:09:32.171387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175712+0000","last_change":"2023-11-25T04:09:32.175712+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175712+0000","last_undegraded":"2023-11-25T04:09:32.175712+0000","last_fullsized":"2023-11-25T04:09:32.175712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174028+0000","last_change":"2023-11-25T04:09:32.174028+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174028+0000","last_undegraded":"2023-11-25T04:09:32.174028+0000","last_fullsized":"2023-11-25T04:09:32.174028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174336+0000","last_change":"2023-11-25T04:09:32.174336+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174336+0000","last_undegraded":"2023-11-25T04:09:32.174336+0000","last_fullsized":"2023-11-25T04:09:32.174336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.176194+0000","last_change":"2023-11-25T04:09:32.176194+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.176194+0000","last_undegraded":"2023-11-25T04:09:32.176194+0000","last_fullsized":"2023-11-25T04:09:32.176194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171323+0000","last_change":"2023-11-25T04:09:32.171323+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171323+0000","last_undegraded":"2023-11-25T04:09:32.171323+0000","last_fullsized":"2023-11-25T04:09:32.171323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171309+0000","last_change":"2023-11-25T04:09:32.171309+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171309+0000","last_undegraded":"2023-11-25T04:09:32.171309+0000","last_fullsized":"2023-11-25T04:09:32.171309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171323+0000","last_change":"2023-11-25T04:09:32.171323+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171323+0000","last_undegraded":"2023-11-25T04:09:32.171323+0000","last_fullsized":"2023-11-25T04:09:32.171323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271982+0000","last_change":"2023-11-25T04:09:32.271982+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271982+0000","last_undegraded":"2023-11-25T04:09:32.271982+0000","last_fullsized":"2023-11-25T04:09:32.271982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178311+0000","last_change":"2023-11-25T04:09:32.178311+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178311+0000","last_undegraded":"2023-11-25T04:09:32.178311+0000","last_fullsized":"2023-11-25T04:09:32.178311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173106+0000","last_change":"2023-11-25T04:09:32.173106+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173106+0000","last_undegraded":"2023-11-25T04:09:32.173106+0000","last_fullsized":"2023-11-25T04:09:32.173106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171916+0000","last_change":"2023-11-25T04:09:32.171916+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171916+0000","last_undegraded":"2023-11-25T04:09:32.171916+0000","last_fullsized":"2023-11-25T04:09:32.171916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175342+0000","last_change":"2023-11-25T04:09:32.175342+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175342+0000","last_undegraded":"2023-11-25T04:09:32.175342+0000","last_fullsized":"2023-11-25T04:09:32.175342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.272008+0000","last_change":"2023-11-25T04:09:32.272008+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.272008+0000","last_undegraded":"2023-11-25T04:09:32.272008+0000","last_fullsized":"2023-11-25T04:09:32.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175311+0000","last_change":"2023-11-25T04:09:32.175311+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175311+0000","last_undegraded":"2023-11-25T04:09:32.175311+0000","last_fullsized":"2023-11-25T04:09:32.175311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271617+0000","last_change":"2023-11-25T04:09:32.271617+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271617+0000","last_undegraded":"2023-11-25T04:09:32.271617+0000","last_fullsized":"2023-11-25T04:09:32.271617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175364+0000","last_change":"2023-11-25T04:09:32.175364+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175364+0000","last_undegraded":"2023-11-25T04:09:32.175364+0000","last_fullsized":"2023-11-25T04:09:32.175364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172592+0000","last_change":"2023-11-25T04:09:32.172592+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172592+0000","last_undegraded":"2023-11-25T04:09:32.172592+0000","last_fullsized":"2023-11-25T04:09:32.172592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173558+0000","last_change":"2023-11-25T04:09:32.173558+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173558+0000","last_undegraded":"2023-11-25T04:09:32.173558+0000","last_fullsized":"2023-11-25T04:09:32.173558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178266+0000","last_change":"2023-11-25T04:09:32.178266+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178266+0000","last_undegraded":"2023-11-25T04:09:32.178266+0000","last_fullsized":"2023-11-25T04:09:32.178266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-25T04:09:28.576511+0000","last_change":"2023-11-25T04:08:24.570240+0000","last_active":"2023-11-25T04:09:28.576511+0000","last_peered":"2023-11-25T04:09:28.576511+0000","last_clean":"2023-11-25T04:09:28.576511+0000","last_became_active":"2023-11-25T04:08:24.569371+0000","last_became_peered":"2023-11-25T04:08:24.569371+0000","last_unstale":"2023-11-25T04:09:28.576511+0000","last_undegraded":"2023-11-25T04:09:28.576511+0000","last_fullsized":"2023-11-25T04:09:28.576511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_clean_scrub_stamp":"2023-11-25T04:08:23.534401+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:28.293127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":917504,"data_stored":711963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.374}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68799999999999994}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.5},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.622}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.64600000000000002}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.81000000000000005}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.78900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.307},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.432}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41899999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40600000000000003}]},{"osd":6,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33100000000000002}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.37}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.30299999999999999}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.41399999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.443}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.435},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.48999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.374},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":711963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.33200000000000002}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-25T04:09:37.265 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-25T04:09:37.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.403+0000 7f393f41e640 1 Processor -- start 2023-11-25T04:09:37.405 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.403+0000 7f393f41e640 1 -- start start 2023-11-25T04:09:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.404+0000 7f393f41e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393809a080 0x7f39380b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.404+0000 7f393f41e640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f39380b2610 0x7f39380b1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.404+0000 7f393f41e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39380b0660 con 0x7f393815d900 2023-11-25T04:09:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.404+0000 7f393f41e640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f393806c900 con 0x7f39380b2610 2023-11-25T04:09:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.404+0000 7f393f41e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f393806cbe0 con 0x7f393809a080 2023-11-25T04:09:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.404+0000 7f393d9bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f39380b2610 0x7f39380b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.404+0000 7f393d9bb640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f39380b2610 0x7f39380b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35506/0 (socket says 172.21.15.2:35506) 2023-11-25T04:09:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.404+0000 7f393d9bb640 1 -- 172.21.15.2:0/3397897047 learned_addr learned my addr 172.21.15.2:0/3397897047 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:37.407 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.405+0000 7f393c9b9640 1 --2- 172.21.15.2:0/3397897047 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393809a080 0x7f39380b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.405+0000 7f393d9bb640 1 -- 172.21.15.2:0/3397897047 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393809a080 msgr2=0x7f39380b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:37.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.405+0000 7f393d9bb640 1 --2- 172.21.15.2:0/3397897047 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393809a080 0x7f39380b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.405+0000 7f393d9bb640 1 -- 172.21.15.2:0/3397897047 >> v1:172.21.15.66:6789/0 conn(0x7f393815d900 legacy=0x7f3938099970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:37.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.405+0000 7f393d9bb640 1 -- 172.21.15.2:0/3397897047 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f393806cec0 con 0x7f39380b2610 2023-11-25T04:09:37.408 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.405+0000 7f393c9b9640 1 --2- 172.21.15.2:0/3397897047 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393809a080 0x7f39380b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:37.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.405+0000 7f393d9bb640 1 --2- 172.21.15.2:0/3397897047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 0x7f39380b1310 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3928009e50 tx=0x7f392802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c51fa4642c5e196 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:37.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f3937fff640 1 -- 172.21.15.2:0/3397897047 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392802ca70 con 0x7f39380b2610 2023-11-25T04:09:37.409 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f3937fff640 1 -- 172.21.15.2:0/3397897047 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392802cbd0 con 0x7f39380b2610 2023-11-25T04:09:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f3937fff640 1 -- 172.21.15.2:0/3397897047 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39280343f0 con 0x7f39380b2610 2023-11-25T04:09:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f393f41e640 1 -- 172.21.15.2:0/3397897047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 msgr2=0x7f39380b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f393f41e640 1 --2- 172.21.15.2:0/3397897047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 0x7f39380b1310 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f3928009e50 tx=0x7f392802bed0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f393f41e640 1 -- 172.21.15.2:0/3397897047 shutdown_connections 2023-11-25T04:09:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f393f41e640 1 --2- 172.21.15.2:0/3397897047 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 0x7f39380b1310 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f393f41e640 1 --2- 172.21.15.2:0/3397897047 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393809a080 0x7f39380b0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.411 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f393f41e640 1 -- 172.21.15.2:0/3397897047 >> 172.21.15.2:0/3397897047 conn(0x7f39380b2a70 msgr2=0x7f39380b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:37.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f393f41e640 1 -- 172.21.15.2:0/3397897047 shutdown_connections 2023-11-25T04:09:37.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.406+0000 7f393f41e640 1 -- 172.21.15.2:0/3397897047 wait complete. 2023-11-25T04:09:37.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.407+0000 7f393f41e640 1 Processor -- start 2023-11-25T04:09:37.412 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.407+0000 7f393f41e640 1 -- start start 2023-11-25T04:09:37.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393f41e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f393809a080 0x7f39380af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393f41e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 0x7f39380adbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393f41e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393815d900 0x7f393815dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.414 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393f41e640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380afa10 con 0x7f39380b2610 2023-11-25T04:09:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393f41e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39380ae430 con 0x7f393809a080 2023-11-25T04:09:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393f41e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39380ae710 con 0x7f393815d900 2023-11-25T04:09:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393c9b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 0x7f39380adbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393c9b9640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 0x7f39380adbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35518/0 (socket says 172.21.15.2:35518) 2023-11-25T04:09:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393c9b9640 1 -- 172.21.15.2:0/1540112995 learned_addr learned my addr 172.21.15.2:0/1540112995 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393d1ba640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f393809a080 0x7f39380af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.408+0000 7f393d9bb640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393815d900 0x7f393815dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f393c9b9640 1 -- 172.21.15.2:0/1540112995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393815d900 msgr2=0x7f393815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.415 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f393c9b9640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393815d900 0x7f393815dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f393c9b9640 1 -- 172.21.15.2:0/1540112995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f393809a080 msgr2=0x7f39380af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f393c9b9640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f393809a080 0x7f39380af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f393c9b9640 1 -- 172.21.15.2:0/1540112995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3928009b30 con 0x7f39380b2610 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f393c9b9640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 0x7f39380adbc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c7f0 tx=0x7f392c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f3935ffb640 1 -- 172.21.15.2:0/1540112995 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c007820 con 0x7f39380b2610 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f3935ffb640 1 -- 172.21.15.2:0/1540112995 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f392c007980 con 0x7f39380b2610 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39380ae9f0 con 0x7f39380b2610 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f3935ffb640 1 -- 172.21.15.2:0/1540112995 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c007cf0 con 0x7f39380b2610 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.409+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39380aefb0 con 0x7f39380b2610 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.410+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f393815d440 con 0x7f39380b2610 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.411+0000 7f3935ffb640 1 -- 172.21.15.2:0/1540112995 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f392c0113f0 con 0x7f39380b2610 2023-11-25T04:09:37.416 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.411+0000 7f3935ffb640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f392406ae40 0x7f392406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.411+0000 7f3935ffb640 1 -- 172.21.15.2:0/1540112995 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f392c089810 con 0x7f39380b2610 2023-11-25T04:09:37.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.411+0000 7f393d1ba640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f392406ae40 0x7f392406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.412+0000 7f393d1ba640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f392406ae40 0x7f392406d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3930004f60 tx=0x7f3930007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:37.417 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.415+0000 7f3935ffb640 1 -- 172.21.15.2:0/1540112995 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f392c054a00 con 0x7f39380b2610 2023-11-25T04:09:37.590 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.588+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 --> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39380b36e0 con 0x7f392406ae40 2023-11-25T04:09:37.597 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.595+0000 7f3935ffb640 1 -- 172.21.15.2:0/1540112995 <== mgr.4107 v2:172.21.15.2:6832/523998843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277010 (secure 0 0 0) 0x7f3930003940 con 0x7f392406ae40 2023-11-25T04:09:37.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:37.601 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-25T04:09:37.602 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f392406ae40 msgr2=0x7f392406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f392406ae40 0x7f392406d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3930004f60 tx=0x7f3930007e30 comp rx=0 tx=0).stop 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 msgr2=0x7f39380adbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 0x7f39380adbc0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f392c00c7f0 tx=0x7f392c00ccb0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 shutdown_connections 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f393815d900 0x7f393815dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f39380b2610 0x7f39380adbc0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f392406ae40 0x7f392406d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 --2- 172.21.15.2:0/1540112995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f393809a080 0x7f39380af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 >> 172.21.15.2:0/1540112995 conn(0x7f39380b2a70 msgr2=0x7f39380d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 shutdown_connections 2023-11-25T04:09:37.603 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.598+0000 7f393f41e640 1 -- 172.21.15.2:0/1540112995 wait complete. 2023-11-25T04:09:37.610 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-25T04:09:37.489314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236580,"kb_used_data":3712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738140,"statfs":{"total":773094113280,"available":772851855360,"internally_reserved":0,"allocated":3801088,"data_stored":2165130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.320540"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178326+0000","last_change":"2023-11-25T04:09:32.178326+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178326+0000","last_undegraded":"2023-11-25T04:09:32.178326+0000","last_fullsized":"2023-11-25T04:09:32.178326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.272430+0000","last_change":"2023-11-25T04:09:32.272430+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.272430+0000","last_undegraded":"2023-11-25T04:09:32.272430+0000","last_fullsized":"2023-11-25T04:09:32.272430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173702+0000","last_change":"2023-11-25T04:09:32.173702+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173702+0000","last_undegraded":"2023-11-25T04:09:32.173702+0000","last_fullsized":"2023-11-25T04:09:32.173702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174659+0000","last_change":"2023-11-25T04:09:32.174659+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174659+0000","last_undegraded":"2023-11-25T04:09:32.174659+0000","last_fullsized":"2023-11-25T04:09:32.174659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172083+0000","last_change":"2023-11-25T04:09:32.172083+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172083+0000","last_undegraded":"2023-11-25T04:09:32.172083+0000","last_fullsized":"2023-11-25T04:09:32.172083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171376+0000","last_change":"2023-11-25T04:09:32.171376+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171376+0000","last_undegraded":"2023-11-25T04:09:32.171376+0000","last_fullsized":"2023-11-25T04:09:32.171376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173558+0000","last_change":"2023-11-25T04:09:32.173558+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173558+0000","last_undegraded":"2023-11-25T04:09:32.173558+0000","last_fullsized":"2023-11-25T04:09:32.173558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172061+0000","last_change":"2023-11-25T04:09:32.172061+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172061+0000","last_undegraded":"2023-11-25T04:09:32.172061+0000","last_fullsized":"2023-11-25T04:09:32.172061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173584+0000","last_change":"2023-11-25T04:09:32.173584+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173584+0000","last_undegraded":"2023-11-25T04:09:32.173584+0000","last_fullsized":"2023-11-25T04:09:32.173584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271615+0000","last_change":"2023-11-25T04:09:32.271615+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271615+0000","last_undegraded":"2023-11-25T04:09:32.271615+0000","last_fullsized":"2023-11-25T04:09:32.271615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172016+0000","last_change":"2023-11-25T04:09:32.172016+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172016+0000","last_undegraded":"2023-11-25T04:09:32.172016+0000","last_fullsized":"2023-11-25T04:09:32.172016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173634+0000","last_change":"2023-11-25T04:09:32.173634+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173634+0000","last_undegraded":"2023-11-25T04:09:32.173634+0000","last_fullsized":"2023-11-25T04:09:32.173634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171387+0000","last_change":"2023-11-25T04:09:32.171387+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171387+0000","last_undegraded":"2023-11-25T04:09:32.171387+0000","last_fullsized":"2023-11-25T04:09:32.171387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175712+0000","last_change":"2023-11-25T04:09:32.175712+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175712+0000","last_undegraded":"2023-11-25T04:09:32.175712+0000","last_fullsized":"2023-11-25T04:09:32.175712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174028+0000","last_change":"2023-11-25T04:09:32.174028+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174028+0000","last_undegraded":"2023-11-25T04:09:32.174028+0000","last_fullsized":"2023-11-25T04:09:32.174028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174336+0000","last_change":"2023-11-25T04:09:32.174336+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174336+0000","last_undegraded":"2023-11-25T04:09:32.174336+0000","last_fullsized":"2023-11-25T04:09:32.174336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.176194+0000","last_change":"2023-11-25T04:09:32.176194+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.176194+0000","last_undegraded":"2023-11-25T04:09:32.176194+0000","last_fullsized":"2023-11-25T04:09:32.176194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171323+0000","last_change":"2023-11-25T04:09:32.171323+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171323+0000","last_undegraded":"2023-11-25T04:09:32.171323+0000","last_fullsized":"2023-11-25T04:09:32.171323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171309+0000","last_change":"2023-11-25T04:09:32.171309+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171309+0000","last_undegraded":"2023-11-25T04:09:32.171309+0000","last_fullsized":"2023-11-25T04:09:32.171309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171323+0000","last_change":"2023-11-25T04:09:32.171323+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171323+0000","last_undegraded":"2023-11-25T04:09:32.171323+0000","last_fullsized":"2023-11-25T04:09:32.171323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271982+0000","last_change":"2023-11-25T04:09:32.271982+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271982+0000","last_undegraded":"2023-11-25T04:09:32.271982+0000","last_fullsized":"2023-11-25T04:09:32.271982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178311+0000","last_change":"2023-11-25T04:09:32.178311+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178311+0000","last_undegraded":"2023-11-25T04:09:32.178311+0000","last_fullsized":"2023-11-25T04:09:32.178311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173106+0000","last_change":"2023-11-25T04:09:32.173106+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173106+0000","last_undegraded":"2023-11-25T04:09:32.173106+0000","last_fullsized":"2023-11-25T04:09:32.173106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171916+0000","last_change":"2023-11-25T04:09:32.171916+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171916+0000","last_undegraded":"2023-11-25T04:09:32.171916+0000","last_fullsized":"2023-11-25T04:09:32.171916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175342+0000","last_change":"2023-11-25T04:09:32.175342+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175342+0000","last_undegraded":"2023-11-25T04:09:32.175342+0000","last_fullsized":"2023-11-25T04:09:32.175342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.272008+0000","last_change":"2023-11-25T04:09:32.272008+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.272008+0000","last_undegraded":"2023-11-25T04:09:32.272008+0000","last_fullsized":"2023-11-25T04:09:32.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175311+0000","last_change":"2023-11-25T04:09:32.175311+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175311+0000","last_undegraded":"2023-11-25T04:09:32.175311+0000","last_fullsized":"2023-11-25T04:09:32.175311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271617+0000","last_change":"2023-11-25T04:09:32.271617+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271617+0000","last_undegraded":"2023-11-25T04:09:32.271617+0000","last_fullsized":"2023-11-25T04:09:32.271617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175364+0000","last_change":"2023-11-25T04:09:32.175364+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175364+0000","last_undegraded":"2023-11-25T04:09:32.175364+0000","last_fullsized":"2023-11-25T04:09:32.175364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172592+0000","last_change":"2023-11-25T04:09:32.172592+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172592+0000","last_undegraded":"2023-11-25T04:09:32.172592+0000","last_fullsized":"2023-11-25T04:09:32.172592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173558+0000","last_change":"2023-11-25T04:09:32.173558+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173558+0000","last_undegraded":"2023-11-25T04:09:32.173558+0000","last_fullsized":"2023-11-25T04:09:32.173558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178266+0000","last_change":"2023-11-25T04:09:32.178266+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178266+0000","last_undegraded":"2023-11-25T04:09:32.178266+0000","last_fullsized":"2023-11-25T04:09:32.178266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-25T04:09:28.576511+0000","last_change":"2023-11-25T04:08:24.570240+0000","last_active":"2023-11-25T04:09:28.576511+0000","last_peered":"2023-11-25T04:09:28.576511+0000","last_clean":"2023-11-25T04:09:28.576511+0000","last_became_active":"2023-11-25T04:08:24.569371+0000","last_became_peered":"2023-11-25T04:08:24.569371+0000","last_unstale":"2023-11-25T04:09:28.576511+0000","last_undegraded":"2023-11-25T04:09:28.576511+0000","last_fullsized":"2023-11-25T04:09:28.576511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_clean_scrub_stamp":"2023-11-25T04:08:23.534401+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:28.293127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":917504,"data_stored":711963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.374}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68799999999999994}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.5},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.622}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.64600000000000002}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.81000000000000005}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.78900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.307},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.432}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41899999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40600000000000003}]},{"osd":6,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33100000000000002}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.37}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.30299999999999999}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.41399999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.443}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.435},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.48999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.374},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":711963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.33200000000000002}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-25T04:09:37.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-25T04:09:37.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.756+0000 7f567b0ee640 1 Processor -- start 2023-11-25T04:09:37.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.756+0000 7f567b0ee640 1 -- start start 2023-11-25T04:09:37.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f567b0ee640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567415d460 0x7f56740d1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f567b0ee640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56740d2010 0x7f56740d30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f567b0ee640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f56740d3620 0x7f56740cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f567b0ee640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56740d3ab0 con 0x7f56740d2010 2023-11-25T04:09:37.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f567b0ee640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56740cf260 con 0x7f56740d3620 2023-11-25T04:09:37.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f567b0ee640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56740ceca0 con 0x7f567415d460 2023-11-25T04:09:37.766 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f5673fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56740d2010 0x7f56740d30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f5673fff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f56740d2010 0x7f56740d30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35530/0 (socket says 172.21.15.2:35530) 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f5673fff640 1 -- 172.21.15.2:0/3232231240 learned_addr learned my addr 172.21.15.2:0/3232231240 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f5678e8a640 1 --2- 172.21.15.2:0/3232231240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567415d460 0x7f56740d1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f567968b640 1 --2- 172.21.15.2:0/3232231240 >> v2:172.21.15.66:3300/0 conn(0x7f56740d3620 0x7f56740cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f5673fff640 1 -- 172.21.15.2:0/3232231240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567415d460 msgr2=0x7f56740d1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f5673fff640 1 --2- 172.21.15.2:0/3232231240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567415d460 0x7f56740d1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f5673fff640 1 -- 172.21.15.2:0/3232231240 >> v2:172.21.15.66:3300/0 conn(0x7f56740d3620 msgr2=0x7f56740cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f5673fff640 1 --2- 172.21.15.2:0/3232231240 >> v2:172.21.15.66:3300/0 conn(0x7f56740d3620 0x7f56740cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.757+0000 7f5673fff640 1 -- 172.21.15.2:0/3232231240 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56740cef80 con 0x7f56740d2010 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.758+0000 7f5673fff640 1 --2- 172.21.15.2:0/3232231240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56740d2010 0x7f56740d30e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f56740b30a0 tx=0x7f566802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe22d3864852cf32 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:37.767 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.758+0000 7f56737fe640 1 -- 172.21.15.2:0/3232231240 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668031870 con 0x7f56740d2010 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.758+0000 7f56737fe640 1 -- 172.21.15.2:0/3232231240 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56680319d0 con 0x7f56740d2010 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.758+0000 7f56737fe640 1 -- 172.21.15.2:0/3232231240 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668031d60 con 0x7f56740d2010 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.759+0000 7f567b0ee640 1 -- 172.21.15.2:0/3232231240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56740d2010 msgr2=0x7f56740d30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.759+0000 7f567b0ee640 1 --2- 172.21.15.2:0/3232231240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56740d2010 0x7f56740d30e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f56740b30a0 tx=0x7f566802b910 comp rx=0 tx=0).stop 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.759+0000 7f567b0ee640 1 -- 172.21.15.2:0/3232231240 shutdown_connections 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.759+0000 7f567b0ee640 1 --2- 172.21.15.2:0/3232231240 >> v2:172.21.15.66:3300/0 conn(0x7f56740d3620 0x7f56740cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.759+0000 7f567b0ee640 1 --2- 172.21.15.2:0/3232231240 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f56740d2010 0x7f56740d30e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.759+0000 7f567b0ee640 1 --2- 172.21.15.2:0/3232231240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567415d460 0x7f56740d1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.759+0000 7f567b0ee640 1 -- 172.21.15.2:0/3232231240 >> 172.21.15.2:0/3232231240 conn(0x7f567408cb60 msgr2=0x7f567409c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:37.768 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.759+0000 7f567b0ee640 1 -- 172.21.15.2:0/3232231240 shutdown_connections 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.759+0000 7f567b0ee640 1 -- 172.21.15.2:0/3232231240 wait complete. 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.760+0000 7f567b0ee640 1 Processor -- start 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.760+0000 7f567b0ee640 1 -- start start 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f567b0ee640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56740d2010 0x7f56740ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f567b0ee640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56740d3620 0x7f56741f7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f567b0ee640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567415d460 0x7f567415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f567b0ee640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740cacf0 con 0x7f567415d460 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f567b0ee640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56740cafd0 con 0x7f56740d2010 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f567b0ee640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56740cb2b0 con 0x7f56740d3620 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f567968b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567415d460 0x7f567415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f567968b640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567415d460 0x7f567415a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35540/0 (socket says 172.21.15.2:35540) 2023-11-25T04:09:37.769 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f567968b640 1 -- 172.21.15.2:0/4242181798 learned_addr learned my addr 172.21.15.2:0/4242181798 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f5678e8a640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56740d2010 0x7f56740ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.761+0000 7f5673fff640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56740d3620 0x7f56741f7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f567968b640 1 -- 172.21.15.2:0/4242181798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56740d3620 msgr2=0x7f56741f7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f567968b640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56740d3620 0x7f56741f7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f567968b640 1 -- 172.21.15.2:0/4242181798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56740d2010 msgr2=0x7f56740ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f567968b640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56740d2010 0x7f56740ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f567968b640 1 -- 172.21.15.2:0/4242181798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680094d0 con 0x7f567415d460 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f567968b640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567415d460 0x7f567415a9f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f566c00eed0 tx=0x7f566c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f56717fa640 1 -- 172.21.15.2:0/4242181798 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c010040 con 0x7f567415d460 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f56717fa640 1 -- 172.21.15.2:0/4242181798 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566c014400 con 0x7f567415d460 2023-11-25T04:09:37.770 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f56717fa640 1 -- 172.21.15.2:0/4242181798 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c009ea0 con 0x7f567415d460 2023-11-25T04:09:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56740cb590 con 0x7f567415d460 2023-11-25T04:09:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.762+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56741f83f0 con 0x7f567415d460 2023-11-25T04:09:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.763+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56741f8640 con 0x7f567415d460 2023-11-25T04:09:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.763+0000 7f56717fa640 1 -- 172.21.15.2:0/4242181798 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f566c0147b0 con 0x7f567415d460 2023-11-25T04:09:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.764+0000 7f56717fa640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f566006ae40 0x7f566006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.764+0000 7f56717fa640 1 -- 172.21.15.2:0/4242181798 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f566c089ba0 con 0x7f567415d460 2023-11-25T04:09:37.771 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.764+0000 7f5678e8a640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f566006ae40 0x7f566006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.764+0000 7f5678e8a640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f566006ae40 0x7f566006d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5664009b40 tx=0x7f5664009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:37.772 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.768+0000 7f56717fa640 1 -- 172.21.15.2:0/4242181798 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f566c054d00 con 0x7f567415d460 2023-11-25T04:09:37.942 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.940+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 --> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56740afde0 con 0x7f566006ae40 2023-11-25T04:09:37.949 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.947+0000 7f56717fa640 1 -- 172.21.15.2:0/4242181798 <== mgr.4107 v2:172.21.15.2:6832/523998843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277010 (secure 0 0 0) 0x7f5664011a60 con 0x7f566006ae40 2023-11-25T04:09:37.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:37.953 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-25T04:09:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f566006ae40 msgr2=0x7f566006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.954 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f566006ae40 0x7f566006d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5664009b40 tx=0x7f5664009190 comp rx=0 tx=0).stop 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567415d460 msgr2=0x7f567415a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567415d460 0x7f567415a9f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f566c00eed0 tx=0x7f566c00b480 comp rx=0 tx=0).stop 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 shutdown_connections 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f567415d460 0x7f567415a9f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56740d3620 0x7f56741f7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f566006ae40 0x7f566006d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 --2- 172.21.15.2:0/4242181798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56740d2010 0x7f56740ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 >> 172.21.15.2:0/4242181798 conn(0x7f567408cb60 msgr2=0x7f567406b240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 shutdown_connections 2023-11-25T04:09:37.955 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:37.950+0000 7f567b0ee640 1 -- 172.21.15.2:0/4242181798 wait complete. 2023-11-25T04:09:37.963 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-25T04:09:37.489314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236580,"kb_used_data":3712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738140,"statfs":{"total":773094113280,"available":772851855360,"internally_reserved":0,"allocated":3801088,"data_stored":2165130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.320540"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178326+0000","last_change":"2023-11-25T04:09:32.178326+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178326+0000","last_undegraded":"2023-11-25T04:09:32.178326+0000","last_fullsized":"2023-11-25T04:09:32.178326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.272430+0000","last_change":"2023-11-25T04:09:32.272430+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.272430+0000","last_undegraded":"2023-11-25T04:09:32.272430+0000","last_fullsized":"2023-11-25T04:09:32.272430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173702+0000","last_change":"2023-11-25T04:09:32.173702+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173702+0000","last_undegraded":"2023-11-25T04:09:32.173702+0000","last_fullsized":"2023-11-25T04:09:32.173702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174659+0000","last_change":"2023-11-25T04:09:32.174659+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174659+0000","last_undegraded":"2023-11-25T04:09:32.174659+0000","last_fullsized":"2023-11-25T04:09:32.174659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172083+0000","last_change":"2023-11-25T04:09:32.172083+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172083+0000","last_undegraded":"2023-11-25T04:09:32.172083+0000","last_fullsized":"2023-11-25T04:09:32.172083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171376+0000","last_change":"2023-11-25T04:09:32.171376+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171376+0000","last_undegraded":"2023-11-25T04:09:32.171376+0000","last_fullsized":"2023-11-25T04:09:32.171376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173558+0000","last_change":"2023-11-25T04:09:32.173558+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173558+0000","last_undegraded":"2023-11-25T04:09:32.173558+0000","last_fullsized":"2023-11-25T04:09:32.173558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172061+0000","last_change":"2023-11-25T04:09:32.172061+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172061+0000","last_undegraded":"2023-11-25T04:09:32.172061+0000","last_fullsized":"2023-11-25T04:09:32.172061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173584+0000","last_change":"2023-11-25T04:09:32.173584+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173584+0000","last_undegraded":"2023-11-25T04:09:32.173584+0000","last_fullsized":"2023-11-25T04:09:32.173584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271615+0000","last_change":"2023-11-25T04:09:32.271615+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271615+0000","last_undegraded":"2023-11-25T04:09:32.271615+0000","last_fullsized":"2023-11-25T04:09:32.271615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172016+0000","last_change":"2023-11-25T04:09:32.172016+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172016+0000","last_undegraded":"2023-11-25T04:09:32.172016+0000","last_fullsized":"2023-11-25T04:09:32.172016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173634+0000","last_change":"2023-11-25T04:09:32.173634+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173634+0000","last_undegraded":"2023-11-25T04:09:32.173634+0000","last_fullsized":"2023-11-25T04:09:32.173634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171387+0000","last_change":"2023-11-25T04:09:32.171387+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171387+0000","last_undegraded":"2023-11-25T04:09:32.171387+0000","last_fullsized":"2023-11-25T04:09:32.171387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175712+0000","last_change":"2023-11-25T04:09:32.175712+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175712+0000","last_undegraded":"2023-11-25T04:09:32.175712+0000","last_fullsized":"2023-11-25T04:09:32.175712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174028+0000","last_change":"2023-11-25T04:09:32.174028+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174028+0000","last_undegraded":"2023-11-25T04:09:32.174028+0000","last_fullsized":"2023-11-25T04:09:32.174028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174336+0000","last_change":"2023-11-25T04:09:32.174336+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174336+0000","last_undegraded":"2023-11-25T04:09:32.174336+0000","last_fullsized":"2023-11-25T04:09:32.174336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.176194+0000","last_change":"2023-11-25T04:09:32.176194+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.176194+0000","last_undegraded":"2023-11-25T04:09:32.176194+0000","last_fullsized":"2023-11-25T04:09:32.176194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171323+0000","last_change":"2023-11-25T04:09:32.171323+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171323+0000","last_undegraded":"2023-11-25T04:09:32.171323+0000","last_fullsized":"2023-11-25T04:09:32.171323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171309+0000","last_change":"2023-11-25T04:09:32.171309+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171309+0000","last_undegraded":"2023-11-25T04:09:32.171309+0000","last_fullsized":"2023-11-25T04:09:32.171309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171323+0000","last_change":"2023-11-25T04:09:32.171323+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171323+0000","last_undegraded":"2023-11-25T04:09:32.171323+0000","last_fullsized":"2023-11-25T04:09:32.171323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271982+0000","last_change":"2023-11-25T04:09:32.271982+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271982+0000","last_undegraded":"2023-11-25T04:09:32.271982+0000","last_fullsized":"2023-11-25T04:09:32.271982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178311+0000","last_change":"2023-11-25T04:09:32.178311+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178311+0000","last_undegraded":"2023-11-25T04:09:32.178311+0000","last_fullsized":"2023-11-25T04:09:32.178311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173106+0000","last_change":"2023-11-25T04:09:32.173106+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173106+0000","last_undegraded":"2023-11-25T04:09:32.173106+0000","last_fullsized":"2023-11-25T04:09:32.173106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171916+0000","last_change":"2023-11-25T04:09:32.171916+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171916+0000","last_undegraded":"2023-11-25T04:09:32.171916+0000","last_fullsized":"2023-11-25T04:09:32.171916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175342+0000","last_change":"2023-11-25T04:09:32.175342+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175342+0000","last_undegraded":"2023-11-25T04:09:32.175342+0000","last_fullsized":"2023-11-25T04:09:32.175342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.272008+0000","last_change":"2023-11-25T04:09:32.272008+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.272008+0000","last_undegraded":"2023-11-25T04:09:32.272008+0000","last_fullsized":"2023-11-25T04:09:32.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175311+0000","last_change":"2023-11-25T04:09:32.175311+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175311+0000","last_undegraded":"2023-11-25T04:09:32.175311+0000","last_fullsized":"2023-11-25T04:09:32.175311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271617+0000","last_change":"2023-11-25T04:09:32.271617+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271617+0000","last_undegraded":"2023-11-25T04:09:32.271617+0000","last_fullsized":"2023-11-25T04:09:32.271617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175364+0000","last_change":"2023-11-25T04:09:32.175364+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175364+0000","last_undegraded":"2023-11-25T04:09:32.175364+0000","last_fullsized":"2023-11-25T04:09:32.175364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172592+0000","last_change":"2023-11-25T04:09:32.172592+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172592+0000","last_undegraded":"2023-11-25T04:09:32.172592+0000","last_fullsized":"2023-11-25T04:09:32.172592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173558+0000","last_change":"2023-11-25T04:09:32.173558+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173558+0000","last_undegraded":"2023-11-25T04:09:32.173558+0000","last_fullsized":"2023-11-25T04:09:32.173558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178266+0000","last_change":"2023-11-25T04:09:32.178266+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178266+0000","last_undegraded":"2023-11-25T04:09:32.178266+0000","last_fullsized":"2023-11-25T04:09:32.178266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-25T04:09:28.576511+0000","last_change":"2023-11-25T04:08:24.570240+0000","last_active":"2023-11-25T04:09:28.576511+0000","last_peered":"2023-11-25T04:09:28.576511+0000","last_clean":"2023-11-25T04:09:28.576511+0000","last_became_active":"2023-11-25T04:08:24.569371+0000","last_became_peered":"2023-11-25T04:08:24.569371+0000","last_unstale":"2023-11-25T04:09:28.576511+0000","last_undegraded":"2023-11-25T04:09:28.576511+0000","last_fullsized":"2023-11-25T04:09:28.576511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_clean_scrub_stamp":"2023-11-25T04:08:23.534401+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:28.293127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":917504,"data_stored":711963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.374}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68799999999999994}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.5},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.622}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.64600000000000002}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.81000000000000005}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.78900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.307},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.432}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41899999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40600000000000003}]},{"osd":6,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33100000000000002}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.37}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.30299999999999999}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.41399999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.443}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.435},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.48999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.374},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":711963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.33200000000000002}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-25T04:09:37.968 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-25T04:09:37.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-25T04:09:37.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-25T04:09:37.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-25T04:09:37.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-25T04:09:37.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-25T04:09:37.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-25T04:09:37.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-25T04:09:37.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-25T04:09:37.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-25T04:09:37.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-25T04:09:37.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-25T04:09:37.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-25T04:09:37.975 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-25T04:09:37.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.178326+0000', 'last_change': '2023-11-25T04:09:32.178326+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.178326+0000', 'last_undegraded': '2023-11-25T04:09:32.178326+0000', 'last_fullsized': '2023-11-25T04:09:32.178326+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-25T04:09:37.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-25T04:09:37.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-25T04:09:37.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.272430+0000', 'last_change': '2023-11-25T04:09:32.272430+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.272430+0000', 'last_undegraded': '2023-11-25T04:09:32.272430+0000', 'last_fullsized': '2023-11-25T04:09:32.272430+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-25T04:09:37.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.173702+0000', 'last_change': '2023-11-25T04:09:32.173702+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.173702+0000', 'last_undegraded': '2023-11-25T04:09:32.173702+0000', 'last_fullsized': '2023-11-25T04:09:32.173702+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.174659+0000', 'last_change': '2023-11-25T04:09:32.174659+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.174659+0000', 'last_undegraded': '2023-11-25T04:09:32.174659+0000', 'last_fullsized': '2023-11-25T04:09:32.174659+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-25T04:09:37.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.172083+0000', 'last_change': '2023-11-25T04:09:32.172083+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.172083+0000', 'last_undegraded': '2023-11-25T04:09:32.172083+0000', 'last_fullsized': '2023-11-25T04:09:32.172083+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-25T04:09:37.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-25T04:09:37.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-25T04:09:37.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.171376+0000', 'last_change': '2023-11-25T04:09:32.171376+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.171376+0000', 'last_undegraded': '2023-11-25T04:09:32.171376+0000', 'last_fullsized': '2023-11-25T04:09:32.171376+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-25T04:09:37.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-25T04:09:37.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-25T04:09:37.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.173558+0000', 'last_change': '2023-11-25T04:09:32.173558+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.173558+0000', 'last_undegraded': '2023-11-25T04:09:32.173558+0000', 'last_fullsized': '2023-11-25T04:09:32.173558+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-25T04:09:37.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-25T04:09:37.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-25T04:09:37.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.172061+0000', 'last_change': '2023-11-25T04:09:32.172061+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.172061+0000', 'last_undegraded': '2023-11-25T04:09:32.172061+0000', 'last_fullsized': '2023-11-25T04:09:32.172061+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-25T04:09:37.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-25T04:09:37.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-25T04:09:37.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.173584+0000', 'last_change': '2023-11-25T04:09:32.173584+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.173584+0000', 'last_undegraded': '2023-11-25T04:09:32.173584+0000', 'last_fullsized': '2023-11-25T04:09:32.173584+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-25T04:09:37.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-25T04:09:37.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-25T04:09:37.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.271615+0000', 'last_change': '2023-11-25T04:09:32.271615+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.271615+0000', 'last_undegraded': '2023-11-25T04:09:32.271615+0000', 'last_fullsized': '2023-11-25T04:09:32.271615+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-25T04:09:37.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-25T04:09:37.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-25T04:09:37.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.172016+0000', 'last_change': '2023-11-25T04:09:32.172016+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.172016+0000', 'last_undegraded': '2023-11-25T04:09:32.172016+0000', 'last_fullsized': '2023-11-25T04:09:32.172016+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-25T04:09:37.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.173634+0000', 'last_change': '2023-11-25T04:09:32.173634+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.173634+0000', 'last_undegraded': '2023-11-25T04:09:32.173634+0000', 'last_fullsized': '2023-11-25T04:09:32.173634+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.171387+0000', 'last_change': '2023-11-25T04:09:32.171387+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.171387+0000', 'last_undegraded': '2023-11-25T04:09:32.171387+0000', 'last_fullsized': '2023-11-25T04:09:32.171387+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-25T04:09:37.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.175712+0000', 'last_change': '2023-11-25T04:09:32.175712+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.175712+0000', 'last_undegraded': '2023-11-25T04:09:32.175712+0000', 'last_fullsized': '2023-11-25T04:09:32.175712+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-25T04:09:37.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-25T04:09:37.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-25T04:09:37.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.174028+0000', 'last_change': '2023-11-25T04:09:32.174028+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.174028+0000', 'last_undegraded': '2023-11-25T04:09:32.174028+0000', 'last_fullsized': '2023-11-25T04:09:32.174028+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-25T04:09:37.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-25T04:09:37.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-25T04:09:37.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.174336+0000', 'last_change': '2023-11-25T04:09:32.174336+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.174336+0000', 'last_undegraded': '2023-11-25T04:09:32.174336+0000', 'last_fullsized': '2023-11-25T04:09:32.174336+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-25T04:09:37.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-25T04:09:37.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-25T04:09:37.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.176194+0000', 'last_change': '2023-11-25T04:09:32.176194+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.176194+0000', 'last_undegraded': '2023-11-25T04:09:32.176194+0000', 'last_fullsized': '2023-11-25T04:09:32.176194+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-25T04:09:37.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-25T04:09:37.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-25T04:09:37.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.171323+0000', 'last_change': '2023-11-25T04:09:32.171323+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.171323+0000', 'last_undegraded': '2023-11-25T04:09:32.171323+0000', 'last_fullsized': '2023-11-25T04:09:32.171323+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-25T04:09:37.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-25T04:09:37.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.171309+0000', 'last_change': '2023-11-25T04:09:32.171309+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.171309+0000', 'last_undegraded': '2023-11-25T04:09:32.171309+0000', 'last_fullsized': '2023-11-25T04:09:32.171309+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.171323+0000', 'last_change': '2023-11-25T04:09:32.171323+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.171323+0000', 'last_undegraded': '2023-11-25T04:09:32.171323+0000', 'last_fullsized': '2023-11-25T04:09:32.171323+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-25T04:09:37.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.271982+0000', 'last_change': '2023-11-25T04:09:32.271982+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.271982+0000', 'last_undegraded': '2023-11-25T04:09:32.271982+0000', 'last_fullsized': '2023-11-25T04:09:32.271982+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-25T04:09:37.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-25T04:09:37.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-25T04:09:37.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.178311+0000', 'last_change': '2023-11-25T04:09:32.178311+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.178311+0000', 'last_undegraded': '2023-11-25T04:09:32.178311+0000', 'last_fullsized': '2023-11-25T04:09:32.178311+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-25T04:09:37.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-25T04:09:37.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-25T04:09:37.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.173106+0000', 'last_change': '2023-11-25T04:09:32.173106+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.173106+0000', 'last_undegraded': '2023-11-25T04:09:32.173106+0000', 'last_fullsized': '2023-11-25T04:09:32.173106+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-25T04:09:37.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-25T04:09:37.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-25T04:09:37.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.171916+0000', 'last_change': '2023-11-25T04:09:32.171916+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.171916+0000', 'last_undegraded': '2023-11-25T04:09:32.171916+0000', 'last_fullsized': '2023-11-25T04:09:32.171916+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-25T04:09:37.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-25T04:09:37.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-25T04:09:37.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.175342+0000', 'last_change': '2023-11-25T04:09:32.175342+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.175342+0000', 'last_undegraded': '2023-11-25T04:09:32.175342+0000', 'last_fullsized': '2023-11-25T04:09:32.175342+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-25T04:09:37.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-25T04:09:37.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-25T04:09:37.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.272008+0000', 'last_change': '2023-11-25T04:09:32.272008+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.272008+0000', 'last_undegraded': '2023-11-25T04:09:32.272008+0000', 'last_fullsized': '2023-11-25T04:09:32.272008+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-25T04:09:37.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-25T04:09:37.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:37.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-25T04:09:37.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.175311+0000', 'last_change': '2023-11-25T04:09:32.175311+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.175311+0000', 'last_undegraded': '2023-11-25T04:09:32.175311+0000', 'last_fullsized': '2023-11-25T04:09:32.175311+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-25T04:09:37.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-25T04:09:38.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:38.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-25T04:09:38.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.271617+0000', 'last_change': '2023-11-25T04:09:32.271617+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.271617+0000', 'last_undegraded': '2023-11-25T04:09:32.271617+0000', 'last_fullsized': '2023-11-25T04:09:32.271617+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-11-25T04:09:38.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-25T04:09:38.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:38.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-25T04:09:38.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.175364+0000', 'last_change': '2023-11-25T04:09:32.175364+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.175364+0000', 'last_undegraded': '2023-11-25T04:09:32.175364+0000', 'last_fullsized': '2023-11-25T04:09:32.175364+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-25T04:09:38.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-25T04:09:38.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:38.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-25T04:09:38.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.172592+0000', 'last_change': '2023-11-25T04:09:32.172592+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.172592+0000', 'last_undegraded': '2023-11-25T04:09:32.172592+0000', 'last_fullsized': '2023-11-25T04:09:32.172592+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-25T04:09:38.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-25T04:09:38.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:38.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-25T04:09:38.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.173558+0000', 'last_change': '2023-11-25T04:09:32.173558+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.173558+0000', 'last_undegraded': '2023-11-25T04:09:32.173558+0000', 'last_fullsized': '2023-11-25T04:09:32.173558+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-25T04:09:38.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-25T04:09:38.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-25T04:09:33.168438+0000', 'last_change': '2023-11-25T04:09:33.168438+0000', 'last_active': '2023-11-25T04:09:33.168438+0000', 'last_peered': '2023-11-25T04:09:33.168438+0000', 'last_clean': '2023-11-25T04:09:33.168438+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:33.168438+0000', 'last_undegraded': '2023-11-25T04:09:33.168438+0000', 'last_fullsized': '2023-11-25T04:09:33.168438+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:33.168438+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-25T04:09:38.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-25T04:09:38.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 30, 'state': 'creating+peering', 'last_fresh': '2023-11-25T04:09:32.178266+0000', 'last_change': '2023-11-25T04:09:32.178266+0000', 'last_active': '2023-11-25T04:09:32.164558+0000', 'last_peered': '2023-11-25T04:09:32.164558+0000', 'last_clean': '2023-11-25T04:09:32.164558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-25T04:09:32.178266+0000', 'last_undegraded': '2023-11-25T04:09:32.178266+0000', 'last_fullsized': '2023-11-25T04:09:32.178266+0000', 'mapping_epoch': 30, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 30, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'last_clean_scrub_stamp': '2023-11-25T04:09:32.164558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-25T04:09:38.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-25T04:09:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.111+0000 7f818d53a640 1 Processor -- start 2023-11-25T04:09:38.114 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.111+0000 7f818d53a640 1 -- start start 2023-11-25T04:09:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.112+0000 7f818d53a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8188099970 0x7f8188099d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.112+0000 7f818d53a640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81880cf890 0x7f81880b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.112+0000 7f818d53a640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81880d0070 con 0x7f818809a530 2023-11-25T04:09:38.121 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.112+0000 7f818d53a640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81880cbb50 con 0x7f81880cf890 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.112+0000 7f818d53a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f818809a290 con 0x7f8188099970 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.112+0000 7f81877fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f81880cf890 0x7f81880b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.112+0000 7f817ffff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f818809a530 0x7f81880cc8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42964/0 (socket says 172.21.15.2:42964) 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.112+0000 7f817ffff640 1 -- 172.21.15.2:0/208645625 learned_addr learned my addr 172.21.15.2:0/208645625 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.112+0000 7f8186ffd640 1 --2- 172.21.15.2:0/208645625 >> v2:172.21.15.66:3300/0 conn(0x7f8188099970 0x7f8188099d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.113+0000 7f81877fe640 1 -- 172.21.15.2:0/208645625 >> v2:172.21.15.66:3300/0 conn(0x7f8188099970 msgr2=0x7f8188099d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.113+0000 7f81877fe640 1 --2- 172.21.15.2:0/208645625 >> v2:172.21.15.66:3300/0 conn(0x7f8188099970 0x7f8188099d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.113+0000 7f81877fe640 1 -- 172.21.15.2:0/208645625 >> v1:172.21.15.2:6789/0 conn(0x7f818809a530 legacy=0x7f81880cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.113+0000 7f81867fc640 1 -- 172.21.15.2:0/208645625 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208597152 0 0) 0x7f8170001110 con 0x7f818809a530 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.113+0000 7f81877fe640 1 -- 172.21.15.2:0/208645625 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81880cfd90 con 0x7f81880cf890 2023-11-25T04:09:38.122 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.113+0000 7f81877fe640 1 --2- 172.21.15.2:0/208645625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81880cf890 0x7f81880b0780 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8188071a20 tx=0x7f818002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634da555700df7ac server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f81867fc640 1 -- 172.21.15.2:0/208645625 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818002cc80 con 0x7f81880cf890 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f81867fc640 1 -- 172.21.15.2:0/208645625 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818002cde0 con 0x7f81880cf890 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f81867fc640 1 -- 172.21.15.2:0/208645625 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180034660 con 0x7f81880cf890 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f818d53a640 1 -- 172.21.15.2:0/208645625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81880cf890 msgr2=0x7f81880b0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f818d53a640 1 --2- 172.21.15.2:0/208645625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81880cf890 0x7f81880b0780 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8188071a20 tx=0x7f818002bed0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f818d53a640 1 -- 172.21.15.2:0/208645625 shutdown_connections 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f818d53a640 1 --2- 172.21.15.2:0/208645625 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f81880cf890 0x7f81880b0780 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f818d53a640 1 --2- 172.21.15.2:0/208645625 >> v2:172.21.15.66:3300/0 conn(0x7f8188099970 0x7f8188099d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f818d53a640 1 -- 172.21.15.2:0/208645625 >> 172.21.15.2:0/208645625 conn(0x7f81880b2a70 msgr2=0x7f81880b2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f818d53a640 1 -- 172.21.15.2:0/208645625 shutdown_connections 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.114+0000 7f818d53a640 1 -- 172.21.15.2:0/208645625 wait complete. 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.115+0000 7f818d53a640 1 Processor -- start 2023-11-25T04:09:38.123 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.115+0000 7f818d53a640 1 -- start start 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.116+0000 7f818d53a640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8188099970 0x7f81880c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.116+0000 7f818d53a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f818809a530 0x7f8188152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.116+0000 7f818d53a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81880cf890 0x7f81880b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.116+0000 7f818d53a640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81880afed0 con 0x7f8188099970 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.116+0000 7f818d53a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81880c50b0 con 0x7f818809a530 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.116+0000 7f818d53a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81880c5390 con 0x7f81880cf890 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.116+0000 7f8186ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8188099970 0x7f81880c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.116+0000 7f8186ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8188099970 0x7f81880c4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35566/0 (socket says 172.21.15.2:35566) 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.116+0000 7f8186ffd640 1 -- 172.21.15.2:0/2462424709 learned_addr learned my addr 172.21.15.2:0/2462424709 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f817ffff640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f818809a530 0x7f8188152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f8186ffd640 1 -- 172.21.15.2:0/2462424709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81880cf890 msgr2=0x7f81880b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f8186ffd640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81880cf890 0x7f81880b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.124 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f8186ffd640 1 -- 172.21.15.2:0/2462424709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f818809a530 msgr2=0x7f8188152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f8186ffd640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f818809a530 0x7f8188152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f8186ffd640 1 -- 172.21.15.2:0/2462424709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009a70 con 0x7f8188099970 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f817ffff640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f818809a530 0x7f8188152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f8186ffd640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8188099970 0x7f81880c4ab0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f817800d800 tx=0x7f817800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f817f7fe640 1 -- 172.21.15.2:0/2462424709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817800b6c0 con 0x7f8188099970 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f817f7fe640 1 -- 172.21.15.2:0/2462424709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817800b820 con 0x7f8188099970 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81880b0170 con 0x7f8188099970 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f817f7fe640 1 -- 172.21.15.2:0/2462424709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817800bbb0 con 0x7f8188099970 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.117+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81880b21b0 con 0x7f8188099970 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.118+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81880c48c0 con 0x7f8188099970 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.118+0000 7f817f7fe640 1 -- 172.21.15.2:0/2462424709 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f817800bd10 con 0x7f8188099970 2023-11-25T04:09:38.125 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.119+0000 7f817f7fe640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f816806ae40 0x7f816806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.119+0000 7f817ffff640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f816806ae40 0x7f816806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.119+0000 7f817f7fe640 1 -- 172.21.15.2:0/2462424709 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8178089b20 con 0x7f8188099970 2023-11-25T04:09:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.119+0000 7f817ffff640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f816806ae40 0x7f816806d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8170001370 tx=0x7f8170009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:38.126 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.123+0000 7f817f7fe640 1 -- 172.21.15.2:0/2462424709 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8178054c60 con 0x7f8188099970 2023-11-25T04:09:38.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.371+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8188067420 con 0x7f8188099970 2023-11-25T04:09:38.374 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.372+0000 7f817f7fe640 1 -- 172.21.15.2:0/2462424709 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1655 (secure 0 0 0) 0x7f8178058280 con 0x7f8188099970 2023-11-25T04:09:38.374 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:38.374 INFO:teuthology.orchestra.run.smithi002.stdout:{"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":87,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":33,"num_osds":8,"num_up_osds":8,"osd_up_since":1700885302,"num_in_osds":8,"osd_in_since":1700885293,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242257920,"bytes_avail":772851855360,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":15,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5199}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-11-25T04:09:23.487162+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-25T04:09:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f816806ae40 msgr2=0x7f816806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f816806ae40 0x7f816806d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8170001370 tx=0x7f8170009040 comp rx=0 tx=0).stop 2023-11-25T04:09:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8188099970 msgr2=0x7f81880c4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8188099970 0x7f81880c4ab0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f817800d800 tx=0x7f817800dcc0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.376 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 shutdown_connections 2023-11-25T04:09:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81880cf890 0x7f81880b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f816806ae40 0x7f816806d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f818809a530 0x7f8188152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 --2- 172.21.15.2:0/2462424709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f8188099970 0x7f81880c4ab0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 >> 172.21.15.2:0/2462424709 conn(0x7f81880b2a70 msgr2=0x7f81880cd990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 shutdown_connections 2023-11-25T04:09:38.377 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.374+0000 7f818d53a640 1 -- 172.21.15.2:0/2462424709 wait complete. 2023-11-25T04:09:38.387 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-25T04:09:38.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-25T04:09:38.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.492+0000 7f66027dc640 1 Processor -- start 2023-11-25T04:09:38.495 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.492+0000 7f66027dc640 1 -- start start 2023-11-25T04:09:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.493+0000 7f66027dc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65fc15d3e0 0x7f65fc0ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.496 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.493+0000 7f66027dc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f65fc0d1e30 0x7f65fc0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.493+0000 7f66027dc640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65fc0b5f90 con 0x7f65fc0ced30 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.493+0000 7f66027dc640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc0cf170 con 0x7f65fc15d3e0 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.493+0000 7f66027dc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65fc0b61e0 con 0x7f65fc0d1e30 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.493+0000 7f65fbfff640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f65fc15d3e0 0x7f65fc0ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.493+0000 7f65fb7fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f65fc0ced30 0x7f65fc0d1720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:42980/0 (socket says 172.21.15.2:42980) 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.493+0000 7f65fb7fe640 1 -- 172.21.15.2:0/232496980 learned_addr learned my addr 172.21.15.2:0/232496980 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.494+0000 7f6600d79640 1 --2- 172.21.15.2:0/232496980 >> v2:172.21.15.66:3300/0 conn(0x7f65fc0d1e30 0x7f65fc0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.494+0000 7f65fbfff640 1 -- 172.21.15.2:0/232496980 >> v2:172.21.15.66:3300/0 conn(0x7f65fc0d1e30 msgr2=0x7f65fc0b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.494+0000 7f65fbfff640 1 --2- 172.21.15.2:0/232496980 >> v2:172.21.15.66:3300/0 conn(0x7f65fc0d1e30 0x7f65fc0b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.494+0000 7f65faffd640 1 -- 172.21.15.2:0/232496980 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224336279 0 0) 0x7f65fc0b5f90 con 0x7f65fc0ced30 2023-11-25T04:09:38.497 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.494+0000 7f65fbfff640 1 -- 172.21.15.2:0/232496980 >> v1:172.21.15.2:6789/0 conn(0x7f65fc0ced30 legacy=0x7f65fc0d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.494+0000 7f65fbfff640 1 -- 172.21.15.2:0/232496980 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65fc0b64c0 con 0x7f65fc15d3e0 2023-11-25T04:09:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.494+0000 7f65fbfff640 1 --2- 172.21.15.2:0/232496980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 0x7f65fc0ce7f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0cdc30 tx=0x7f65ec02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a27481b895a167 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f65faffd640 1 -- 172.21.15.2:0/232496980 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec030610 con 0x7f65fc15d3e0 2023-11-25T04:09:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f65faffd640 1 -- 172.21.15.2:0/232496980 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ec030770 con 0x7f65fc15d3e0 2023-11-25T04:09:38.498 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f65faffd640 1 -- 172.21.15.2:0/232496980 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ec030b00 con 0x7f65fc15d3e0 2023-11-25T04:09:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f66027dc640 1 -- 172.21.15.2:0/232496980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 msgr2=0x7f65fc0ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f66027dc640 1 --2- 172.21.15.2:0/232496980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 0x7f65fc0ce7f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0cdc30 tx=0x7f65ec02b960 comp rx=0 tx=0).stop 2023-11-25T04:09:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f66027dc640 1 -- 172.21.15.2:0/232496980 shutdown_connections 2023-11-25T04:09:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f66027dc640 1 --2- 172.21.15.2:0/232496980 >> v2:172.21.15.66:3300/0 conn(0x7f65fc0d1e30 0x7f65fc0b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f66027dc640 1 --2- 172.21.15.2:0/232496980 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 0x7f65fc0ce7f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.502 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f66027dc640 1 -- 172.21.15.2:0/232496980 >> 172.21.15.2:0/232496980 conn(0x7f65fc09c480 msgr2=0x7f65fc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f66027dc640 1 -- 172.21.15.2:0/232496980 shutdown_connections 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.495+0000 7f66027dc640 1 -- 172.21.15.2:0/232496980 wait complete. 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.496+0000 7f66027dc640 1 Processor -- start 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f66027dc640 1 -- start start 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f66027dc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65fc0ced30 0x7f65fc0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f66027dc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc0d1e30 0x7f65fc0c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f66027dc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 0x7f65fc1592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f66027dc640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc158e80 con 0x7f65fc15d3e0 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f66027dc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc0c9270 con 0x7f65fc0d1e30 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f66027dc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65fc158200 con 0x7f65fc0ced30 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f6600d79640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 0x7f65fc1592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.503 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f6600d79640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 0x7f65fc1592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:35580/0 (socket says 172.21.15.2:35580) 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.497+0000 7f6600d79640 1 -- 172.21.15.2:0/3707988879 learned_addr learned my addr 172.21.15.2:0/3707988879 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f65fb7fe640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc0d1e30 0x7f65fc0c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f65fbfff640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65fc0ced30 0x7f65fc0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f6600d79640 1 -- 172.21.15.2:0/3707988879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65fc0ced30 msgr2=0x7f65fc0ccc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f6600d79640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65fc0ced30 0x7f65fc0ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f6600d79640 1 -- 172.21.15.2:0/3707988879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc0d1e30 msgr2=0x7f65fc0c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f6600d79640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc0d1e30 0x7f65fc0c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f6600d79640 1 -- 172.21.15.2:0/3707988879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec009400 con 0x7f65fc15d3e0 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f65fb7fe640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc0d1e30 0x7f65fc0c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f6600d79640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 0x7f65fc1592a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f65f400cd70 tx=0x7f65f400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:38.504 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f65f8ff9640 1 -- 172.21.15.2:0/3707988879 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4003b90 con 0x7f65fc15d3e0 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f65f8ff9640 1 -- 172.21.15.2:0/3707988879 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f4003cf0 con 0x7f65fc15d3e0 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65fc1584e0 con 0x7f65fc15d3e0 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f65f8ff9640 1 -- 172.21.15.2:0/3707988879 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4004240 con 0x7f65fc15d3e0 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.498+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc158aa0 con 0x7f65fc15d3e0 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.499+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65fc158fc0 con 0x7f65fc15d3e0 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.500+0000 7f65f8ff9640 1 -- 172.21.15.2:0/3707988879 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65f40043a0 con 0x7f65fc15d3e0 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.500+0000 7f65f8ff9640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f65e806ae40 0x7f65e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.500+0000 7f65f8ff9640 1 -- 172.21.15.2:0/3707988879 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65f4012070 con 0x7f65fc15d3e0 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.500+0000 7f65fbfff640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f65e806ae40 0x7f65e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:38.505 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.500+0000 7f65fbfff640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f65e806ae40 0x7f65e806d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f65ec036000 tx=0x7f65ec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:38.506 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.504+0000 7f65f8ff9640 1 -- 172.21.15.2:0/3707988879 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f65fc158fc0 con 0x7f65fc15d3e0 2023-11-25T04:09:38.678 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.676+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 --> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65fc0b6d60 con 0x7f65e806ae40 2023-11-25T04:09:38.684 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.683+0000 7f65f8ff9640 1 -- 172.21.15.2:0/3707988879 <== mgr.4107 v2:172.21.15.2:6832/523998843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277010 (secure 0 0 0) 0x7f65ec03f040 con 0x7f65e806ae40 2023-11-25T04:09:38.690 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:38.691 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-25T04:09:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f65e806ae40 msgr2=0x7f65e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f65e806ae40 0x7f65e806d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f65ec036000 tx=0x7f65ec008030 comp rx=0 tx=0).stop 2023-11-25T04:09:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 msgr2=0x7f65fc1592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 0x7f65fc1592a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f65f400cd70 tx=0x7f65f400a660 comp rx=0 tx=0).stop 2023-11-25T04:09:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 shutdown_connections 2023-11-25T04:09:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f65fc15d3e0 0x7f65fc1592a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f65e806ae40 0x7f65e806d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.693 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65fc0d1e30 0x7f65fc0c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 --2- 172.21.15.2:0/3707988879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65fc0ced30 0x7f65fc0ccc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 >> 172.21.15.2:0/3707988879 conn(0x7f65fc09c480 msgr2=0x7f65fc0c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 shutdown_connections 2023-11-25T04:09:38.694 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:38.686+0000 7f66027dc640 1 -- 172.21.15.2:0/3707988879 wait complete. 2023-11-25T04:09:38.698 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-25T04:09:37.489314+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236580,"kb_used_data":3712,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738140,"statfs":{"total":773094113280,"available":772851855360,"internally_reserved":0,"allocated":3801088,"data_stored":2165130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.320540"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178326+0000","last_change":"2023-11-25T04:09:32.178326+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178326+0000","last_undegraded":"2023-11-25T04:09:32.178326+0000","last_fullsized":"2023-11-25T04:09:32.178326+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.272430+0000","last_change":"2023-11-25T04:09:32.272430+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.272430+0000","last_undegraded":"2023-11-25T04:09:32.272430+0000","last_fullsized":"2023-11-25T04:09:32.272430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173702+0000","last_change":"2023-11-25T04:09:32.173702+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173702+0000","last_undegraded":"2023-11-25T04:09:32.173702+0000","last_fullsized":"2023-11-25T04:09:32.173702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174659+0000","last_change":"2023-11-25T04:09:32.174659+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174659+0000","last_undegraded":"2023-11-25T04:09:32.174659+0000","last_fullsized":"2023-11-25T04:09:32.174659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172083+0000","last_change":"2023-11-25T04:09:32.172083+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172083+0000","last_undegraded":"2023-11-25T04:09:32.172083+0000","last_fullsized":"2023-11-25T04:09:32.172083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171376+0000","last_change":"2023-11-25T04:09:32.171376+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171376+0000","last_undegraded":"2023-11-25T04:09:32.171376+0000","last_fullsized":"2023-11-25T04:09:32.171376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173558+0000","last_change":"2023-11-25T04:09:32.173558+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173558+0000","last_undegraded":"2023-11-25T04:09:32.173558+0000","last_fullsized":"2023-11-25T04:09:32.173558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172061+0000","last_change":"2023-11-25T04:09:32.172061+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172061+0000","last_undegraded":"2023-11-25T04:09:32.172061+0000","last_fullsized":"2023-11-25T04:09:32.172061+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173584+0000","last_change":"2023-11-25T04:09:32.173584+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173584+0000","last_undegraded":"2023-11-25T04:09:32.173584+0000","last_fullsized":"2023-11-25T04:09:32.173584+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271615+0000","last_change":"2023-11-25T04:09:32.271615+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271615+0000","last_undegraded":"2023-11-25T04:09:32.271615+0000","last_fullsized":"2023-11-25T04:09:32.271615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172016+0000","last_change":"2023-11-25T04:09:32.172016+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172016+0000","last_undegraded":"2023-11-25T04:09:32.172016+0000","last_fullsized":"2023-11-25T04:09:32.172016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173634+0000","last_change":"2023-11-25T04:09:32.173634+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173634+0000","last_undegraded":"2023-11-25T04:09:32.173634+0000","last_fullsized":"2023-11-25T04:09:32.173634+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171387+0000","last_change":"2023-11-25T04:09:32.171387+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171387+0000","last_undegraded":"2023-11-25T04:09:32.171387+0000","last_fullsized":"2023-11-25T04:09:32.171387+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175712+0000","last_change":"2023-11-25T04:09:32.175712+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175712+0000","last_undegraded":"2023-11-25T04:09:32.175712+0000","last_fullsized":"2023-11-25T04:09:32.175712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174028+0000","last_change":"2023-11-25T04:09:32.174028+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174028+0000","last_undegraded":"2023-11-25T04:09:32.174028+0000","last_fullsized":"2023-11-25T04:09:32.174028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.174336+0000","last_change":"2023-11-25T04:09:32.174336+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.174336+0000","last_undegraded":"2023-11-25T04:09:32.174336+0000","last_fullsized":"2023-11-25T04:09:32.174336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.176194+0000","last_change":"2023-11-25T04:09:32.176194+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.176194+0000","last_undegraded":"2023-11-25T04:09:32.176194+0000","last_fullsized":"2023-11-25T04:09:32.176194+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171323+0000","last_change":"2023-11-25T04:09:32.171323+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171323+0000","last_undegraded":"2023-11-25T04:09:32.171323+0000","last_fullsized":"2023-11-25T04:09:32.171323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171309+0000","last_change":"2023-11-25T04:09:32.171309+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171309+0000","last_undegraded":"2023-11-25T04:09:32.171309+0000","last_fullsized":"2023-11-25T04:09:32.171309+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171323+0000","last_change":"2023-11-25T04:09:32.171323+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171323+0000","last_undegraded":"2023-11-25T04:09:32.171323+0000","last_fullsized":"2023-11-25T04:09:32.171323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271982+0000","last_change":"2023-11-25T04:09:32.271982+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271982+0000","last_undegraded":"2023-11-25T04:09:32.271982+0000","last_fullsized":"2023-11-25T04:09:32.271982+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178311+0000","last_change":"2023-11-25T04:09:32.178311+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178311+0000","last_undegraded":"2023-11-25T04:09:32.178311+0000","last_fullsized":"2023-11-25T04:09:32.178311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173106+0000","last_change":"2023-11-25T04:09:32.173106+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173106+0000","last_undegraded":"2023-11-25T04:09:32.173106+0000","last_fullsized":"2023-11-25T04:09:32.173106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.171916+0000","last_change":"2023-11-25T04:09:32.171916+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.171916+0000","last_undegraded":"2023-11-25T04:09:32.171916+0000","last_fullsized":"2023-11-25T04:09:32.171916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175342+0000","last_change":"2023-11-25T04:09:32.175342+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175342+0000","last_undegraded":"2023-11-25T04:09:32.175342+0000","last_fullsized":"2023-11-25T04:09:32.175342+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.272008+0000","last_change":"2023-11-25T04:09:32.272008+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.272008+0000","last_undegraded":"2023-11-25T04:09:32.272008+0000","last_fullsized":"2023-11-25T04:09:32.272008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175311+0000","last_change":"2023-11-25T04:09:32.175311+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175311+0000","last_undegraded":"2023-11-25T04:09:32.175311+0000","last_fullsized":"2023-11-25T04:09:32.175311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.271617+0000","last_change":"2023-11-25T04:09:32.271617+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.271617+0000","last_undegraded":"2023-11-25T04:09:32.271617+0000","last_fullsized":"2023-11-25T04:09:32.271617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.175364+0000","last_change":"2023-11-25T04:09:32.175364+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.175364+0000","last_undegraded":"2023-11-25T04:09:32.175364+0000","last_fullsized":"2023-11-25T04:09:32.175364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.172592+0000","last_change":"2023-11-25T04:09:32.172592+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.172592+0000","last_undegraded":"2023-11-25T04:09:32.172592+0000","last_fullsized":"2023-11-25T04:09:32.172592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.173558+0000","last_change":"2023-11-25T04:09:32.173558+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.173558+0000","last_undegraded":"2023-11-25T04:09:32.173558+0000","last_fullsized":"2023-11-25T04:09:32.173558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-25T04:09:33.168438+0000","last_change":"2023-11-25T04:09:33.168438+0000","last_active":"2023-11-25T04:09:33.168438+0000","last_peered":"2023-11-25T04:09:33.168438+0000","last_clean":"2023-11-25T04:09:33.168438+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:33.168438+0000","last_undegraded":"2023-11-25T04:09:33.168438+0000","last_fullsized":"2023-11-25T04:09:33.168438+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":30,"state":"creating+peering","last_fresh":"2023-11-25T04:09:32.178266+0000","last_change":"2023-11-25T04:09:32.178266+0000","last_active":"2023-11-25T04:09:32.164558+0000","last_peered":"2023-11-25T04:09:32.164558+0000","last_clean":"2023-11-25T04:09:32.164558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-25T04:09:32.178266+0000","last_undegraded":"2023-11-25T04:09:32.178266+0000","last_fullsized":"2023-11-25T04:09:32.178266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-11-25T04:09:28.576511+0000","last_change":"2023-11-25T04:08:24.570240+0000","last_active":"2023-11-25T04:09:28.576511+0000","last_peered":"2023-11-25T04:09:28.576511+0000","last_clean":"2023-11-25T04:09:28.576511+0000","last_became_active":"2023-11-25T04:08:24.569371+0000","last_became_peered":"2023-11-25T04:08:24.569371+0000","last_unstale":"2023-11-25T04:09:28.576511+0000","last_undegraded":"2023-11-25T04:09:28.576511+0000","last_fullsized":"2023-11-25T04:09:28.576511+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_clean_scrub_stamp":"2023-11-25T04:08:23.534401+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:28.293127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":917504,"data_stored":711963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.48799999999999999}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.374}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.439}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55200000000000005}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.502},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.70199999999999996}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.498},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68799999999999994}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.57899999999999996}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.39900000000000002}]},{"osd":3,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.47499999999999998}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.66800000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.45600000000000002}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.5},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.622}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.57999999999999996}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.64600000000000002}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.81000000000000005}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.78900000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.57799999999999996}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.50600000000000001}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.56399999999999995}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.68000000000000005}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.68999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.307},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.35299999999999998}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.33400000000000002}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.432}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41899999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.40600000000000003}]},{"osd":6,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":335872,"data_stored":127412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33100000000000002}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.37}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.30299999999999999}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.41399999999999998}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.443}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.435},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.48999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31508,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340332,"statfs":{"total":96636764160,"available":96604499968,"internally_reserved":0,"allocated":323584,"data_stored":121595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.34899999999999998}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.374},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.30099999999999999}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.39700000000000002}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.48599999999999999}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.501}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.53700000000000003}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":711963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.33200000000000002}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.79700000000000004}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.77400000000000002}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-25T04:09:39.168 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T04:09:39.166+0000 7f60767a8640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-25T04:09:41.708 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-25T04:09:41.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.824+0000 7fb58d2ad640 1 Processor -- start 2023-11-25T04:09:41.826 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.824+0000 7fb58d2ad640 1 -- start start 2023-11-25T04:09:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb58d2ad640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb58806dc30 0x7fb588071f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb58d2ad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5880b1df0 0x7fb5880cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb58d2ad640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5880b3130 con 0x7fb588142d20 2023-11-25T04:09:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb58d2ad640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5880b2280 con 0x7fb58806dc30 2023-11-25T04:09:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb58d2ad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb588143100 con 0x7fb5880b1df0 2023-11-25T04:09:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb5867fc640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fb58806dc30 0x7fb588071f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb586ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb588142d20 0x7fb58806d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35432/0 (socket says 172.21.15.2:35432) 2023-11-25T04:09:41.828 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb586ffd640 1 -- 172.21.15.2:0/3781437971 learned_addr learned my addr 172.21.15.2:0/3781437971 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb5877fe640 1 --2- 172.21.15.2:0/3781437971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5880b1df0 0x7fb5880cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb5867fc640 1 -- 172.21.15.2:0/3781437971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5880b1df0 msgr2=0x7fb5880cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb5867fc640 1 --2- 172.21.15.2:0/3781437971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5880b1df0 0x7fb5880cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb5867fc640 1 -- 172.21.15.2:0/3781437971 >> v1:172.21.15.2:6789/0 conn(0x7fb588142d20 legacy=0x7fb58806d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.826+0000 7fb5867fc640 1 -- 172.21.15.2:0/3781437971 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5880b2520 con 0x7fb58806dc30 2023-11-25T04:09:41.829 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.825+0000 7fb585ffb640 1 -- 172.21.15.2:0/3781437971 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1574904388 0 0) 0x7fb5880b3130 con 0x7fb588142d20 2023-11-25T04:09:41.830 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.826+0000 7fb5867fc640 1 --2- 172.21.15.2:0/3781437971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58806dc30 0x7fb588071f00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb5700097a0 tx=0x7fb57002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167b66b8a53c738b server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.826+0000 7fb585ffb640 1 -- 172.21.15.2:0/3781437971 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570031830 con 0x7fb58806dc30 2023-11-25T04:09:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.826+0000 7fb585ffb640 1 -- 172.21.15.2:0/3781437971 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb570031990 con 0x7fb58806dc30 2023-11-25T04:09:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.826+0000 7fb585ffb640 1 -- 172.21.15.2:0/3781437971 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570031d20 con 0x7fb58806dc30 2023-11-25T04:09:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.827+0000 7fb58d2ad640 1 -- 172.21.15.2:0/3781437971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58806dc30 msgr2=0x7fb588071f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.827+0000 7fb58d2ad640 1 --2- 172.21.15.2:0/3781437971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58806dc30 0x7fb588071f00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb5700097a0 tx=0x7fb57002b8d0 comp rx=0 tx=0).stop 2023-11-25T04:09:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.827+0000 7fb58d2ad640 1 -- 172.21.15.2:0/3781437971 shutdown_connections 2023-11-25T04:09:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.827+0000 7fb58d2ad640 1 --2- 172.21.15.2:0/3781437971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5880b1df0 0x7fb5880cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:41.831 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.827+0000 7fb58d2ad640 1 --2- 172.21.15.2:0/3781437971 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb58806dc30 0x7fb588071f00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.827+0000 7fb58d2ad640 1 -- 172.21.15.2:0/3781437971 >> 172.21.15.2:0/3781437971 conn(0x7fb5880b0af0 msgr2=0x7fb5880b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.827+0000 7fb58d2ad640 1 -- 172.21.15.2:0/3781437971 shutdown_connections 2023-11-25T04:09:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.827+0000 7fb58d2ad640 1 -- 172.21.15.2:0/3781437971 wait complete. 2023-11-25T04:09:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.828+0000 7fb58d2ad640 1 Processor -- start 2023-11-25T04:09:41.832 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.828+0000 7fb58d2ad640 1 -- start start 2023-11-25T04:09:41.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb58d2ad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb58806dc30 0x7fb5880cd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:41.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb58d2ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5880b1df0 0x7fb58814d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:41.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb58d2ad640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb588142d20 0x7fb5880aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:41.836 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb58d2ad640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58814b710 con 0x7fb588142d20 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb58d2ad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5880ac9a0 con 0x7fb5880b1df0 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb58d2ad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58814e6d0 con 0x7fb58806dc30 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb588142d20 0x7fb5880aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb5877fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb588142d20 0x7fb5880aa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54964/0 (socket says 172.21.15.2:54964) 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb5877fe640 1 -- 172.21.15.2:0/2466922834 learned_addr learned my addr 172.21.15.2:0/2466922834 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb5867fc640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5880b1df0 0x7fb58814d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.829+0000 7fb586ffd640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb58806dc30 0x7fb5880cd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb5877fe640 1 -- 172.21.15.2:0/2466922834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb58806dc30 msgr2=0x7fb5880cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb5877fe640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb58806dc30 0x7fb5880cd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb5877fe640 1 -- 172.21.15.2:0/2466922834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5880b1df0 msgr2=0x7fb58814d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb5877fe640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5880b1df0 0x7fb58814d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb5877fe640 1 -- 172.21.15.2:0/2466922834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570009400 con 0x7fb588142d20 2023-11-25T04:09:41.837 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb5877fe640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb588142d20 0x7fb5880aa980 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb578007e40 tx=0x7fb57800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb57f7fe640 1 -- 172.21.15.2:0/2466922834 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578014620 con 0x7fb588142d20 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb57f7fe640 1 -- 172.21.15.2:0/2466922834 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57800ee90 con 0x7fb588142d20 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb58814de30 con 0x7fb588142d20 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb57f7fe640 1 -- 172.21.15.2:0/2466922834 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5780149e0 con 0x7fb588142d20 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.830+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb58814e3f0 con 0x7fb588142d20 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.831+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb588067420 con 0x7fb588142d20 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.832+0000 7fb57f7fe640 1 -- 172.21.15.2:0/2466922834 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb578014b40 con 0x7fb588142d20 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.832+0000 7fb57f7fe640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb56806ae70 0x7fb56806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.832+0000 7fb57f7fe640 1 -- 172.21.15.2:0/2466922834 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb578089e00 con 0x7fb588142d20 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.832+0000 7fb586ffd640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb56806ae70 0x7fb56806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:41.838 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.833+0000 7fb586ffd640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb56806ae70 0x7fb56806d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb580007fd0 tx=0x7fb580007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:41.839 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:41.837+0000 7fb57f7fe640 1 -- 172.21.15.2:0/2466922834 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb578054f60 con 0x7fb588142d20 2023-11-25T04:09:42.011 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.009+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 --> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5880725b0 con 0x7fb56806ae70 2023-11-25T04:09:42.018 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.016+0000 7fb57f7fe640 1 -- 172.21.15.2:0/2466922834 <== mgr.4107 v2:172.21.15.2:6832/523998843 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289136 (secure 0 0 0) 0x7fb5880725b0 con 0x7fb56806ae70 2023-11-25T04:09:42.021 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2023-11-25T04:09:42.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb56806ae70 msgr2=0x7fb56806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.024 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb56806ae70 0x7fb56806d330 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb580007fd0 tx=0x7fb580007de0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb588142d20 msgr2=0x7fb5880aa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb588142d20 0x7fb5880aa980 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb578007e40 tx=0x7fb57800e4b0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 shutdown_connections 2023-11-25T04:09:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb588142d20 0x7fb5880aa980 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb56806ae70 0x7fb56806d330 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5880b1df0 0x7fb58814d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 --2- 172.21.15.2:0/2466922834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb58806dc30 0x7fb5880cd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 >> 172.21.15.2:0/2466922834 conn(0x7fb5880b0af0 msgr2=0x7fb5880b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:42.025 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 shutdown_connections 2023-11-25T04:09:42.026 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.020+0000 7fb58d2ad640 1 -- 172.21.15.2:0/2466922834 wait complete. 2023-11-25T04:09:42.032 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-25T04:09:41.490288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236984,"kb_used_data":4136,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737736,"statfs":{"total":773094113280,"available":772851441664,"internally_reserved":0,"allocated":4235264,"data_stored":2359588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001578"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.297697+0000","last_change":"2023-11-25T04:09:34.210934+0000","last_active":"2023-11-25T04:09:35.297697+0000","last_peered":"2023-11-25T04:09:35.297697+0000","last_clean":"2023-11-25T04:09:35.297697+0000","last_became_active":"2023-11-25T04:09:34.210649+0000","last_became_peered":"2023-11-25T04:09:34.210649+0000","last_unstale":"2023-11-25T04:09:35.297697+0000","last_undegraded":"2023-11-25T04:09:35.297697+0000","last_fullsized":"2023-11-25T04:09:35.297697+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:07:35.439419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204784+0000","last_change":"2023-11-25T04:09:34.203655+0000","last_active":"2023-11-25T04:09:35.204784+0000","last_peered":"2023-11-25T04:09:35.204784+0000","last_clean":"2023-11-25T04:09:35.204784+0000","last_became_active":"2023-11-25T04:09:34.202489+0000","last_became_peered":"2023-11-25T04:09:34.202489+0000","last_unstale":"2023-11-25T04:09:35.204784+0000","last_undegraded":"2023-11-25T04:09:35.204784+0000","last_fullsized":"2023-11-25T04:09:35.204784+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:46:36.361049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504853+0000","last_change":"2023-11-25T04:09:34.216235+0000","last_active":"2023-11-25T04:09:35.504853+0000","last_peered":"2023-11-25T04:09:35.504853+0000","last_clean":"2023-11-25T04:09:35.504853+0000","last_became_active":"2023-11-25T04:09:34.215978+0000","last_became_peered":"2023-11-25T04:09:34.215978+0000","last_unstale":"2023-11-25T04:09:35.504853+0000","last_undegraded":"2023-11-25T04:09:35.504853+0000","last_fullsized":"2023-11-25T04:09:35.504853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:03:56.796427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205489+0000","last_change":"2023-11-25T04:09:34.215658+0000","last_active":"2023-11-25T04:09:35.205489+0000","last_peered":"2023-11-25T04:09:35.205489+0000","last_clean":"2023-11-25T04:09:35.205489+0000","last_became_active":"2023-11-25T04:09:34.215366+0000","last_became_peered":"2023-11-25T04:09:34.215366+0000","last_unstale":"2023-11-25T04:09:35.205489+0000","last_undegraded":"2023-11-25T04:09:35.205489+0000","last_fullsized":"2023-11-25T04:09:35.205489+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:15:00.146335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.487197+0000","last_change":"2023-11-25T04:09:34.205615+0000","last_active":"2023-11-25T04:09:35.487197+0000","last_peered":"2023-11-25T04:09:35.487197+0000","last_clean":"2023-11-25T04:09:35.487197+0000","last_became_active":"2023-11-25T04:09:34.205365+0000","last_became_peered":"2023-11-25T04:09:34.205365+0000","last_unstale":"2023-11-25T04:09:35.487197+0000","last_undegraded":"2023-11-25T04:09:35.487197+0000","last_fullsized":"2023-11-25T04:09:35.487197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:36:56.102022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204392+0000","last_change":"2023-11-25T04:09:34.199684+0000","last_active":"2023-11-25T04:09:35.204392+0000","last_peered":"2023-11-25T04:09:35.204392+0000","last_clean":"2023-11-25T04:09:35.204392+0000","last_became_active":"2023-11-25T04:09:34.199361+0000","last_became_peered":"2023-11-25T04:09:34.199361+0000","last_unstale":"2023-11-25T04:09:35.204392+0000","last_undegraded":"2023-11-25T04:09:35.204392+0000","last_fullsized":"2023-11-25T04:09:35.204392+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:05:17.659569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504803+0000","last_change":"2023-11-25T04:09:34.209203+0000","last_active":"2023-11-25T04:09:35.504803+0000","last_peered":"2023-11-25T04:09:35.504803+0000","last_clean":"2023-11-25T04:09:35.504803+0000","last_became_active":"2023-11-25T04:09:34.208913+0000","last_became_peered":"2023-11-25T04:09:34.208913+0000","last_unstale":"2023-11-25T04:09:35.504803+0000","last_undegraded":"2023-11-25T04:09:35.504803+0000","last_fullsized":"2023-11-25T04:09:35.504803+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:48:58.279948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504405+0000","last_change":"2023-11-25T04:09:34.204599+0000","last_active":"2023-11-25T04:09:35.504405+0000","last_peered":"2023-11-25T04:09:35.504405+0000","last_clean":"2023-11-25T04:09:35.504405+0000","last_became_active":"2023-11-25T04:09:34.204336+0000","last_became_peered":"2023-11-25T04:09:34.204336+0000","last_unstale":"2023-11-25T04:09:35.504405+0000","last_undegraded":"2023-11-25T04:09:35.504405+0000","last_fullsized":"2023-11-25T04:09:35.504405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:14:04.217902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205764+0000","last_change":"2023-11-25T04:09:34.215741+0000","last_active":"2023-11-25T04:09:35.205764+0000","last_peered":"2023-11-25T04:09:35.205764+0000","last_clean":"2023-11-25T04:09:35.205764+0000","last_became_active":"2023-11-25T04:09:34.215471+0000","last_became_peered":"2023-11-25T04:09:34.215471+0000","last_unstale":"2023-11-25T04:09:35.205764+0000","last_undegraded":"2023-11-25T04:09:35.205764+0000","last_fullsized":"2023-11-25T04:09:35.205764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:59:10.847293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205691+0000","last_change":"2023-11-25T04:09:34.218577+0000","last_active":"2023-11-25T04:09:35.205691+0000","last_peered":"2023-11-25T04:09:35.205691+0000","last_clean":"2023-11-25T04:09:35.205691+0000","last_became_active":"2023-11-25T04:09:34.218288+0000","last_became_peered":"2023-11-25T04:09:34.218288+0000","last_unstale":"2023-11-25T04:09:35.205691+0000","last_undegraded":"2023-11-25T04:09:35.205691+0000","last_fullsized":"2023-11-25T04:09:35.205691+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:04:26.287468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504755+0000","last_change":"2023-11-25T04:09:34.218490+0000","last_active":"2023-11-25T04:09:35.504755+0000","last_peered":"2023-11-25T04:09:35.504755+0000","last_clean":"2023-11-25T04:09:35.504755+0000","last_became_active":"2023-11-25T04:09:34.218178+0000","last_became_peered":"2023-11-25T04:09:34.218178+0000","last_unstale":"2023-11-25T04:09:35.504755+0000","last_undegraded":"2023-11-25T04:09:35.504755+0000","last_fullsized":"2023-11-25T04:09:35.504755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:05:17.659569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.505196+0000","last_change":"2023-11-25T04:09:34.198411+0000","last_active":"2023-11-25T04:09:35.505196+0000","last_peered":"2023-11-25T04:09:35.505196+0000","last_clean":"2023-11-25T04:09:35.505196+0000","last_became_active":"2023-11-25T04:09:34.198115+0000","last_became_peered":"2023-11-25T04:09:34.198115+0000","last_unstale":"2023-11-25T04:09:35.505196+0000","last_undegraded":"2023-11-25T04:09:35.505196+0000","last_fullsized":"2023-11-25T04:09:35.505196+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:22:18.980254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.487152+0000","last_change":"2023-11-25T04:09:34.216553+0000","last_active":"2023-11-25T04:09:35.487152+0000","last_peered":"2023-11-25T04:09:35.487152+0000","last_clean":"2023-11-25T04:09:35.487152+0000","last_became_active":"2023-11-25T04:09:34.216272+0000","last_became_peered":"2023-11-25T04:09:34.216272+0000","last_unstale":"2023-11-25T04:09:35.487152+0000","last_undegraded":"2023-11-25T04:09:35.487152+0000","last_fullsized":"2023-11-25T04:09:35.487152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:18:06.680261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204531+0000","last_change":"2023-11-25T04:09:34.207810+0000","last_active":"2023-11-25T04:09:35.204531+0000","last_peered":"2023-11-25T04:09:35.204531+0000","last_clean":"2023-11-25T04:09:35.204531+0000","last_became_active":"2023-11-25T04:09:34.207544+0000","last_became_peered":"2023-11-25T04:09:34.207544+0000","last_unstale":"2023-11-25T04:09:35.204531+0000","last_undegraded":"2023-11-25T04:09:35.204531+0000","last_fullsized":"2023-11-25T04:09:35.204531+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:37:26.347890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504522+0000","last_change":"2023-11-25T04:09:34.206695+0000","last_active":"2023-11-25T04:09:35.504522+0000","last_peered":"2023-11-25T04:09:35.504522+0000","last_clean":"2023-11-25T04:09:35.504522+0000","last_became_active":"2023-11-25T04:09:34.206372+0000","last_became_peered":"2023-11-25T04:09:34.206372+0000","last_unstale":"2023-11-25T04:09:35.504522+0000","last_undegraded":"2023-11-25T04:09:35.504522+0000","last_fullsized":"2023-11-25T04:09:35.504522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:48:58.279948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.505012+0000","last_change":"2023-11-25T04:09:34.203116+0000","last_active":"2023-11-25T04:09:35.505012+0000","last_peered":"2023-11-25T04:09:35.505012+0000","last_clean":"2023-11-25T04:09:35.505012+0000","last_became_active":"2023-11-25T04:09:34.202819+0000","last_became_peered":"2023-11-25T04:09:34.202819+0000","last_unstale":"2023-11-25T04:09:35.505012+0000","last_undegraded":"2023-11-25T04:09:35.505012+0000","last_fullsized":"2023-11-25T04:09:35.505012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:03:56.796427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.505367+0000","last_change":"2023-11-25T04:09:34.208211+0000","last_active":"2023-11-25T04:09:35.505367+0000","last_peered":"2023-11-25T04:09:35.505367+0000","last_clean":"2023-11-25T04:09:35.505367+0000","last_became_active":"2023-11-25T04:09:34.207921+0000","last_became_peered":"2023-11-25T04:09:34.207921+0000","last_unstale":"2023-11-25T04:09:35.505367+0000","last_undegraded":"2023-11-25T04:09:35.505367+0000","last_fullsized":"2023-11-25T04:09:35.505367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:22:18.980254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204834+0000","last_change":"2023-11-25T04:09:34.211684+0000","last_active":"2023-11-25T04:09:35.204834+0000","last_peered":"2023-11-25T04:09:35.204834+0000","last_clean":"2023-11-25T04:09:35.204834+0000","last_became_active":"2023-11-25T04:09:34.210981+0000","last_became_peered":"2023-11-25T04:09:34.210981+0000","last_unstale":"2023-11-25T04:09:35.204834+0000","last_undegraded":"2023-11-25T04:09:35.204834+0000","last_fullsized":"2023-11-25T04:09:35.204834+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:22:18.980254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204431+0000","last_change":"2023-11-25T04:09:34.218332+0000","last_active":"2023-11-25T04:09:35.204431+0000","last_peered":"2023-11-25T04:09:35.204431+0000","last_clean":"2023-11-25T04:09:35.204431+0000","last_became_active":"2023-11-25T04:09:34.218024+0000","last_became_peered":"2023-11-25T04:09:34.218024+0000","last_unstale":"2023-11-25T04:09:35.204431+0000","last_undegraded":"2023-11-25T04:09:35.204431+0000","last_fullsized":"2023-11-25T04:09:35.204431+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:48:58.279948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.487250+0000","last_change":"2023-11-25T04:09:34.210535+0000","last_active":"2023-11-25T04:09:35.487250+0000","last_peered":"2023-11-25T04:09:35.487250+0000","last_clean":"2023-11-25T04:09:35.487250+0000","last_became_active":"2023-11-25T04:09:34.210240+0000","last_became_peered":"2023-11-25T04:09:34.210240+0000","last_unstale":"2023-11-25T04:09:35.487250+0000","last_undegraded":"2023-11-25T04:09:35.487250+0000","last_fullsized":"2023-11-25T04:09:35.487250+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:24:31.152006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205838+0000","last_change":"2023-11-25T04:09:34.203866+0000","last_active":"2023-11-25T04:09:35.205838+0000","last_peered":"2023-11-25T04:09:35.205838+0000","last_clean":"2023-11-25T04:09:35.205838+0000","last_became_active":"2023-11-25T04:09:34.203198+0000","last_became_peered":"2023-11-25T04:09:34.203198+0000","last_unstale":"2023-11-25T04:09:35.205838+0000","last_undegraded":"2023-11-25T04:09:35.205838+0000","last_fullsized":"2023-11-25T04:09:35.205838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:15:00.146335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205251+0000","last_change":"2023-11-25T04:09:34.201653+0000","last_active":"2023-11-25T04:09:35.205251+0000","last_peered":"2023-11-25T04:09:35.205251+0000","last_clean":"2023-11-25T04:09:35.205251+0000","last_became_active":"2023-11-25T04:09:34.201255+0000","last_became_peered":"2023-11-25T04:09:34.201255+0000","last_unstale":"2023-11-25T04:09:35.205251+0000","last_undegraded":"2023-11-25T04:09:35.205251+0000","last_fullsized":"2023-11-25T04:09:35.205251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:50:14.918194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504009+0000","last_change":"2023-11-25T04:09:34.198745+0000","last_active":"2023-11-25T04:09:35.504009+0000","last_peered":"2023-11-25T04:09:35.504009+0000","last_clean":"2023-11-25T04:09:35.504009+0000","last_became_active":"2023-11-25T04:09:34.198490+0000","last_became_peered":"2023-11-25T04:09:34.198490+0000","last_unstale":"2023-11-25T04:09:35.504009+0000","last_undegraded":"2023-11-25T04:09:35.504009+0000","last_fullsized":"2023-11-25T04:09:35.504009+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:23:56.678041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504386+0000","last_change":"2023-11-25T04:09:34.206259+0000","last_active":"2023-11-25T04:09:35.504386+0000","last_peered":"2023-11-25T04:09:35.504386+0000","last_clean":"2023-11-25T04:09:35.504386+0000","last_became_active":"2023-11-25T04:09:34.205974+0000","last_became_peered":"2023-11-25T04:09:34.205974+0000","last_unstale":"2023-11-25T04:09:35.504386+0000","last_undegraded":"2023-11-25T04:09:35.504386+0000","last_fullsized":"2023-11-25T04:09:35.504386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:05:17.659569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205692+0000","last_change":"2023-11-25T04:09:34.218241+0000","last_active":"2023-11-25T04:09:35.205692+0000","last_peered":"2023-11-25T04:09:35.205692+0000","last_clean":"2023-11-25T04:09:35.205692+0000","last_became_active":"2023-11-25T04:09:34.217957+0000","last_became_peered":"2023-11-25T04:09:34.217957+0000","last_unstale":"2023-11-25T04:09:35.205692+0000","last_undegraded":"2023-11-25T04:09:35.205692+0000","last_fullsized":"2023-11-25T04:09:35.205692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:29:01.708255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204856+0000","last_change":"2023-11-25T04:09:34.210472+0000","last_active":"2023-11-25T04:09:35.204856+0000","last_peered":"2023-11-25T04:09:35.204856+0000","last_clean":"2023-11-25T04:09:35.204856+0000","last_became_active":"2023-11-25T04:09:34.206569+0000","last_became_peered":"2023-11-25T04:09:34.206569+0000","last_unstale":"2023-11-25T04:09:35.204856+0000","last_undegraded":"2023-11-25T04:09:35.204856+0000","last_fullsized":"2023-11-25T04:09:35.204856+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:12:56.992867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205836+0000","last_change":"2023-11-25T04:09:34.215629+0000","last_active":"2023-11-25T04:09:35.205836+0000","last_peered":"2023-11-25T04:09:35.205836+0000","last_clean":"2023-11-25T04:09:35.205836+0000","last_became_active":"2023-11-25T04:09:34.215353+0000","last_became_peered":"2023-11-25T04:09:34.215353+0000","last_unstale":"2023-11-25T04:09:35.205836+0000","last_undegraded":"2023-11-25T04:09:35.205836+0000","last_fullsized":"2023-11-25T04:09:35.205836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:11:00.888285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.505316+0000","last_change":"2023-11-25T04:09:34.196192+0000","last_active":"2023-11-25T04:09:35.505316+0000","last_peered":"2023-11-25T04:09:35.505316+0000","last_clean":"2023-11-25T04:09:35.505316+0000","last_became_active":"2023-11-25T04:09:34.195874+0000","last_became_peered":"2023-11-25T04:09:34.195874+0000","last_unstale":"2023-11-25T04:09:35.505316+0000","last_undegraded":"2023-11-25T04:09:35.505316+0000","last_fullsized":"2023-11-25T04:09:35.505316+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:12:56.992867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205684+0000","last_change":"2023-11-25T04:09:34.203427+0000","last_active":"2023-11-25T04:09:35.205684+0000","last_peered":"2023-11-25T04:09:35.205684+0000","last_clean":"2023-11-25T04:09:35.205684+0000","last_became_active":"2023-11-25T04:09:34.202855+0000","last_became_peered":"2023-11-25T04:09:34.202855+0000","last_unstale":"2023-11-25T04:09:35.205684+0000","last_undegraded":"2023-11-25T04:09:35.205684+0000","last_fullsized":"2023-11-25T04:09:35.205684+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:50:32.006214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504864+0000","last_change":"2023-11-25T04:09:34.207959+0000","last_active":"2023-11-25T04:09:35.504864+0000","last_peered":"2023-11-25T04:09:35.504864+0000","last_clean":"2023-11-25T04:09:35.504864+0000","last_became_active":"2023-11-25T04:09:34.207246+0000","last_became_peered":"2023-11-25T04:09:34.207246+0000","last_unstale":"2023-11-25T04:09:35.504864+0000","last_undegraded":"2023-11-25T04:09:35.504864+0000","last_fullsized":"2023-11-25T04:09:35.504864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:38:02.849226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.297528+0000","last_change":"2023-11-25T04:09:34.205922+0000","last_active":"2023-11-25T04:09:35.297528+0000","last_peered":"2023-11-25T04:09:35.297528+0000","last_clean":"2023-11-25T04:09:35.297528+0000","last_became_active":"2023-11-25T04:09:34.205614+0000","last_became_peered":"2023-11-25T04:09:34.205614+0000","last_unstale":"2023-11-25T04:09:35.297528+0000","last_undegraded":"2023-11-25T04:09:35.297528+0000","last_fullsized":"2023-11-25T04:09:35.297528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:10:01.792336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504402+0000","last_change":"2023-11-25T04:09:34.202553+0000","last_active":"2023-11-25T04:09:35.504402+0000","last_peered":"2023-11-25T04:09:35.504402+0000","last_clean":"2023-11-25T04:09:35.504402+0000","last_became_active":"2023-11-25T04:09:34.202030+0000","last_became_peered":"2023-11-25T04:09:34.202030+0000","last_unstale":"2023-11-25T04:09:35.504402+0000","last_undegraded":"2023-11-25T04:09:35.504402+0000","last_fullsized":"2023-11-25T04:09:35.504402+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:11:00.888285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504188+0000","last_change":"2023-11-25T04:09:34.205007+0000","last_active":"2023-11-25T04:09:35.504188+0000","last_peered":"2023-11-25T04:09:35.504188+0000","last_clean":"2023-11-25T04:09:35.504188+0000","last_became_active":"2023-11-25T04:09:34.204717+0000","last_became_peered":"2023-11-25T04:09:34.204717+0000","last_unstale":"2023-11-25T04:09:35.504188+0000","last_undegraded":"2023-11-25T04:09:35.504188+0000","last_fullsized":"2023-11-25T04:09:35.504188+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:56:51.194117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.221247+0000","last_change":"2023-11-25T04:09:33.185681+0000","last_active":"2023-11-25T04:09:34.221247+0000","last_peered":"2023-11-25T04:09:34.221247+0000","last_clean":"2023-11-25T04:09:34.221247+0000","last_became_active":"2023-11-25T04:09:33.185317+0000","last_became_peered":"2023-11-25T04:09:33.185317+0000","last_unstale":"2023-11-25T04:09:34.221247+0000","last_undegraded":"2023-11-25T04:09:34.221247+0000","last_fullsized":"2023-11-25T04:09:34.221247+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:36:55.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.297743+0000","last_change":"2023-11-25T04:09:34.208889+0000","last_active":"2023-11-25T04:09:35.297743+0000","last_peered":"2023-11-25T04:09:35.297743+0000","last_clean":"2023-11-25T04:09:35.297743+0000","last_became_active":"2023-11-25T04:09:34.208631+0000","last_became_peered":"2023-11-25T04:09:34.208631+0000","last_unstale":"2023-11-25T04:09:35.297743+0000","last_undegraded":"2023-11-25T04:09:35.297743+0000","last_fullsized":"2023-11-25T04:09:35.297743+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:23:56.678041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.204434+0000","last_change":"2023-11-25T04:09:33.187466+0000","last_active":"2023-11-25T04:09:34.204434+0000","last_peered":"2023-11-25T04:09:34.204434+0000","last_clean":"2023-11-25T04:09:34.204434+0000","last_became_active":"2023-11-25T04:09:33.187178+0000","last_became_peered":"2023-11-25T04:09:33.187178+0000","last_unstale":"2023-11-25T04:09:34.204434+0000","last_undegraded":"2023-11-25T04:09:34.204434+0000","last_fullsized":"2023-11-25T04:09:34.204434+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:29:22.362599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205301+0000","last_change":"2023-11-25T04:09:34.200336+0000","last_active":"2023-11-25T04:09:35.205301+0000","last_peered":"2023-11-25T04:09:35.205301+0000","last_clean":"2023-11-25T04:09:35.205301+0000","last_became_active":"2023-11-25T04:09:34.200038+0000","last_became_peered":"2023-11-25T04:09:34.200038+0000","last_unstale":"2023-11-25T04:09:35.205301+0000","last_undegraded":"2023-11-25T04:09:35.205301+0000","last_fullsized":"2023-11-25T04:09:35.205301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:08:02.534961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.220259+0000","last_change":"2023-11-25T04:09:33.191841+0000","last_active":"2023-11-25T04:09:34.220259+0000","last_peered":"2023-11-25T04:09:34.220259+0000","last_clean":"2023-11-25T04:09:34.220259+0000","last_became_active":"2023-11-25T04:09:33.191544+0000","last_became_peered":"2023-11-25T04:09:33.191544+0000","last_unstale":"2023-11-25T04:09:34.220259+0000","last_undegraded":"2023-11-25T04:09:34.220259+0000","last_fullsized":"2023-11-25T04:09:34.220259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:10:59.884406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205869+0000","last_change":"2023-11-25T04:09:34.212561+0000","last_active":"2023-11-25T04:09:35.205869+0000","last_peered":"2023-11-25T04:09:35.205869+0000","last_clean":"2023-11-25T04:09:35.205869+0000","last_became_active":"2023-11-25T04:09:34.212268+0000","last_became_peered":"2023-11-25T04:09:34.212268+0000","last_unstale":"2023-11-25T04:09:35.205869+0000","last_undegraded":"2023-11-25T04:09:35.205869+0000","last_fullsized":"2023-11-25T04:09:35.205869+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:14:04.217902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.217006+0000","last_change":"2023-11-25T04:09:33.191447+0000","last_active":"2023-11-25T04:09:34.217006+0000","last_peered":"2023-11-25T04:09:34.217006+0000","last_clean":"2023-11-25T04:09:34.217006+0000","last_became_active":"2023-11-25T04:09:33.191163+0000","last_became_peered":"2023-11-25T04:09:33.191163+0000","last_unstale":"2023-11-25T04:09:34.217006+0000","last_undegraded":"2023-11-25T04:09:34.217006+0000","last_fullsized":"2023-11-25T04:09:34.217006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:31:52.066315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.505031+0000","last_change":"2023-11-25T04:09:34.209079+0000","last_active":"2023-11-25T04:09:35.505031+0000","last_peered":"2023-11-25T04:09:35.505031+0000","last_clean":"2023-11-25T04:09:35.505031+0000","last_became_active":"2023-11-25T04:09:34.208788+0000","last_became_peered":"2023-11-25T04:09:34.208788+0000","last_unstale":"2023-11-25T04:09:35.505031+0000","last_undegraded":"2023-11-25T04:09:35.505031+0000","last_fullsized":"2023-11-25T04:09:35.505031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:45:34.059283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.217196+0000","last_change":"2023-11-25T04:09:33.183684+0000","last_active":"2023-11-25T04:09:34.217196+0000","last_peered":"2023-11-25T04:09:34.217196+0000","last_clean":"2023-11-25T04:09:34.217196+0000","last_became_active":"2023-11-25T04:09:33.183348+0000","last_became_peered":"2023-11-25T04:09:33.183348+0000","last_unstale":"2023-11-25T04:09:34.217196+0000","last_undegraded":"2023-11-25T04:09:34.217196+0000","last_fullsized":"2023-11-25T04:09:34.217196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:07:34.435540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504733+0000","last_change":"2023-11-25T04:09:34.196939+0000","last_active":"2023-11-25T04:09:35.504733+0000","last_peered":"2023-11-25T04:09:35.504733+0000","last_clean":"2023-11-25T04:09:35.504733+0000","last_became_active":"2023-11-25T04:09:34.196667+0000","last_became_peered":"2023-11-25T04:09:34.196667+0000","last_unstale":"2023-11-25T04:09:35.504733+0000","last_undegraded":"2023-11-25T04:09:35.504733+0000","last_fullsized":"2023-11-25T04:09:35.504733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:38:02.849226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.217196+0000","last_change":"2023-11-25T04:09:33.181815+0000","last_active":"2023-11-25T04:09:34.217196+0000","last_peered":"2023-11-25T04:09:34.217196+0000","last_clean":"2023-11-25T04:09:34.217196+0000","last_became_active":"2023-11-25T04:09:33.181303+0000","last_became_peered":"2023-11-25T04:09:33.181303+0000","last_unstale":"2023-11-25T04:09:34.217196+0000","last_undegraded":"2023-11-25T04:09:34.217196+0000","last_fullsized":"2023-11-25T04:09:34.217196+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:27:54.348405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205426+0000","last_change":"2023-11-25T04:09:34.202899+0000","last_active":"2023-11-25T04:09:35.205426+0000","last_peered":"2023-11-25T04:09:35.205426+0000","last_clean":"2023-11-25T04:09:35.205426+0000","last_became_active":"2023-11-25T04:09:34.202620+0000","last_became_peered":"2023-11-25T04:09:34.202620+0000","last_unstale":"2023-11-25T04:09:35.205426+0000","last_undegraded":"2023-11-25T04:09:35.205426+0000","last_fullsized":"2023-11-25T04:09:35.205426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:40.197980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.192887+0000","last_change":"2023-11-25T04:09:33.190331+0000","last_active":"2023-11-25T04:09:34.192887+0000","last_peered":"2023-11-25T04:09:34.192887+0000","last_clean":"2023-11-25T04:09:34.192887+0000","last_became_active":"2023-11-25T04:09:33.190071+0000","last_became_peered":"2023-11-25T04:09:33.190071+0000","last_unstale":"2023-11-25T04:09:34.192887+0000","last_undegraded":"2023-11-25T04:09:34.192887+0000","last_fullsized":"2023-11-25T04:09:34.192887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:59:09.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205070+0000","last_change":"2023-11-25T04:09:34.215348+0000","last_active":"2023-11-25T04:09:35.205070+0000","last_peered":"2023-11-25T04:09:35.205070+0000","last_clean":"2023-11-25T04:09:35.205070+0000","last_became_active":"2023-11-25T04:09:34.215040+0000","last_became_peered":"2023-11-25T04:09:34.215040+0000","last_unstale":"2023-11-25T04:09:35.205070+0000","last_undegraded":"2023-11-25T04:09:35.205070+0000","last_fullsized":"2023-11-25T04:09:35.205070+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:50:32.006214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.196082+0000","last_change":"2023-11-25T04:09:33.184812+0000","last_active":"2023-11-25T04:09:34.196082+0000","last_peered":"2023-11-25T04:09:34.196082+0000","last_clean":"2023-11-25T04:09:34.196082+0000","last_became_active":"2023-11-25T04:09:33.184488+0000","last_became_peered":"2023-11-25T04:09:33.184488+0000","last_unstale":"2023-11-25T04:09:34.196082+0000","last_undegraded":"2023-11-25T04:09:34.196082+0000","last_fullsized":"2023-11-25T04:09:34.196082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:36:55.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.505329+0000","last_change":"2023-11-25T04:09:34.200441+0000","last_active":"2023-11-25T04:09:35.505329+0000","last_peered":"2023-11-25T04:09:35.505329+0000","last_clean":"2023-11-25T04:09:35.505329+0000","last_became_active":"2023-11-25T04:09:34.200182+0000","last_became_peered":"2023-11-25T04:09:34.200182+0000","last_unstale":"2023-11-25T04:09:35.505329+0000","last_undegraded":"2023-11-25T04:09:35.505329+0000","last_fullsized":"2023-11-25T04:09:35.505329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:01:34.344617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.193658+0000","last_change":"2023-11-25T04:09:33.191752+0000","last_active":"2023-11-25T04:09:34.193658+0000","last_peered":"2023-11-25T04:09:34.193658+0000","last_clean":"2023-11-25T04:09:34.193658+0000","last_became_active":"2023-11-25T04:09:33.191509+0000","last_became_peered":"2023-11-25T04:09:33.191509+0000","last_unstale":"2023-11-25T04:09:34.193658+0000","last_undegraded":"2023-11-25T04:09:34.193658+0000","last_fullsized":"2023-11-25T04:09:34.193658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:04:25.283589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204561+0000","last_change":"2023-11-25T04:09:34.219137+0000","last_active":"2023-11-25T04:09:35.204561+0000","last_peered":"2023-11-25T04:09:35.204561+0000","last_clean":"2023-11-25T04:09:35.204561+0000","last_became_active":"2023-11-25T04:09:34.218864+0000","last_became_peered":"2023-11-25T04:09:34.218864+0000","last_unstale":"2023-11-25T04:09:35.204561+0000","last_undegraded":"2023-11-25T04:09:35.204561+0000","last_fullsized":"2023-11-25T04:09:35.204561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:38:02.849226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.193015+0000","last_change":"2023-11-25T04:09:33.184586+0000","last_active":"2023-11-25T04:09:34.193015+0000","last_peered":"2023-11-25T04:09:34.193015+0000","last_clean":"2023-11-25T04:09:34.193015+0000","last_became_active":"2023-11-25T04:09:33.184230+0000","last_became_peered":"2023-11-25T04:09:33.184230+0000","last_unstale":"2023-11-25T04:09:34.193015+0000","last_undegraded":"2023-11-25T04:09:34.193015+0000","last_fullsized":"2023-11-25T04:09:34.193015+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:20:36.457703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204599+0000","last_change":"2023-11-25T04:09:34.208689+0000","last_active":"2023-11-25T04:09:35.204599+0000","last_peered":"2023-11-25T04:09:35.204599+0000","last_clean":"2023-11-25T04:09:35.204599+0000","last_became_active":"2023-11-25T04:09:34.208366+0000","last_became_peered":"2023-11-25T04:09:34.208366+0000","last_unstale":"2023-11-25T04:09:35.204599+0000","last_undegraded":"2023-11-25T04:09:35.204599+0000","last_fullsized":"2023-11-25T04:09:35.204599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:03:56.796427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.213000+0000","last_change":"2023-11-25T04:09:33.188417+0000","last_active":"2023-11-25T04:09:34.213000+0000","last_peered":"2023-11-25T04:09:34.213000+0000","last_clean":"2023-11-25T04:09:34.213000+0000","last_became_active":"2023-11-25T04:09:33.188137+0000","last_became_peered":"2023-11-25T04:09:33.188137+0000","last_unstale":"2023-11-25T04:09:34.213000+0000","last_undegraded":"2023-11-25T04:09:34.213000+0000","last_fullsized":"2023-11-25T04:09:34.213000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:14:03.214022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504724+0000","last_change":"2023-11-25T04:09:34.216079+0000","last_active":"2023-11-25T04:09:35.504724+0000","last_peered":"2023-11-25T04:09:35.504724+0000","last_clean":"2023-11-25T04:09:35.504724+0000","last_became_active":"2023-11-25T04:09:34.215895+0000","last_became_peered":"2023-11-25T04:09:34.215895+0000","last_unstale":"2023-11-25T04:09:35.504724+0000","last_undegraded":"2023-11-25T04:09:35.504724+0000","last_fullsized":"2023-11-25T04:09:35.504724+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:37:26.347890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.223118+0000","last_change":"2023-11-25T04:09:33.192482+0000","last_active":"2023-11-25T04:09:34.223118+0000","last_peered":"2023-11-25T04:09:34.223118+0000","last_clean":"2023-11-25T04:09:34.223118+0000","last_became_active":"2023-11-25T04:09:33.192219+0000","last_became_peered":"2023-11-25T04:09:33.192219+0000","last_unstale":"2023-11-25T04:09:34.223118+0000","last_undegraded":"2023-11-25T04:09:34.223118+0000","last_fullsized":"2023-11-25T04:09:34.223118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:50:31.002334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205080+0000","last_change":"2023-11-25T04:09:34.212959+0000","last_active":"2023-11-25T04:09:35.205080+0000","last_peered":"2023-11-25T04:09:35.205080+0000","last_clean":"2023-11-25T04:09:35.205080+0000","last_became_active":"2023-11-25T04:09:34.212700+0000","last_became_peered":"2023-11-25T04:09:34.212700+0000","last_unstale":"2023-11-25T04:09:35.205080+0000","last_undegraded":"2023-11-25T04:09:35.205080+0000","last_fullsized":"2023-11-25T04:09:35.205080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:59:10.847293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.221125+0000","last_change":"2023-11-25T04:09:33.185580+0000","last_active":"2023-11-25T04:09:34.221125+0000","last_peered":"2023-11-25T04:09:34.221125+0000","last_clean":"2023-11-25T04:09:34.221125+0000","last_became_active":"2023-11-25T04:09:33.185299+0000","last_became_peered":"2023-11-25T04:09:33.185299+0000","last_unstale":"2023-11-25T04:09:34.221125+0000","last_undegraded":"2023-11-25T04:09:34.221125+0000","last_fullsized":"2023-11-25T04:09:34.221125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:23:55.674161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204634+0000","last_change":"2023-11-25T04:09:34.199497+0000","last_active":"2023-11-25T04:09:35.204634+0000","last_peered":"2023-11-25T04:09:35.204634+0000","last_clean":"2023-11-25T04:09:35.204634+0000","last_became_active":"2023-11-25T04:09:34.199210+0000","last_became_peered":"2023-11-25T04:09:34.199210+0000","last_unstale":"2023-11-25T04:09:35.204634+0000","last_undegraded":"2023-11-25T04:09:35.204634+0000","last_fullsized":"2023-11-25T04:09:35.204634+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:45:34.059283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.201083+0000","last_change":"2023-11-25T04:09:33.190602+0000","last_active":"2023-11-25T04:09:34.201083+0000","last_peered":"2023-11-25T04:09:34.201083+0000","last_clean":"2023-11-25T04:09:34.201083+0000","last_became_active":"2023-11-25T04:09:33.190271+0000","last_became_peered":"2023-11-25T04:09:33.190271+0000","last_unstale":"2023-11-25T04:09:34.201083+0000","last_undegraded":"2023-11-25T04:09:34.201083+0000","last_fullsized":"2023-11-25T04:09:34.201083+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:56:50.190238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504840+0000","last_change":"2023-11-25T04:09:34.205162+0000","last_active":"2023-11-25T04:09:35.504840+0000","last_peered":"2023-11-25T04:09:35.504840+0000","last_clean":"2023-11-25T04:09:35.504840+0000","last_became_active":"2023-11-25T04:09:34.204859+0000","last_became_peered":"2023-11-25T04:09:34.204859+0000","last_unstale":"2023-11-25T04:09:35.504840+0000","last_undegraded":"2023-11-25T04:09:35.504840+0000","last_fullsized":"2023-11-25T04:09:35.504840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:37:26.347890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.192585+0000","last_change":"2023-11-25T04:09:33.187351+0000","last_active":"2023-11-25T04:09:34.192585+0000","last_peered":"2023-11-25T04:09:34.192585+0000","last_clean":"2023-11-25T04:09:34.192585+0000","last_became_active":"2023-11-25T04:09:33.187049+0000","last_became_peered":"2023-11-25T04:09:33.187049+0000","last_unstale":"2023-11-25T04:09:34.192585+0000","last_undegraded":"2023-11-25T04:09:34.192585+0000","last_fullsized":"2023-11-25T04:09:34.192585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:02:50.779843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.297587+0000","last_change":"2023-11-25T04:09:34.209525+0000","last_active":"2023-11-25T04:09:35.297587+0000","last_peered":"2023-11-25T04:09:35.297587+0000","last_clean":"2023-11-25T04:09:35.297587+0000","last_became_active":"2023-11-25T04:09:34.209254+0000","last_became_peered":"2023-11-25T04:09:34.209254+0000","last_unstale":"2023-11-25T04:09:35.297587+0000","last_undegraded":"2023-11-25T04:09:35.297587+0000","last_fullsized":"2023-11-25T04:09:35.297587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:20:37.461583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.221689+0000","last_change":"2023-11-25T04:09:33.183301+0000","last_active":"2023-11-25T04:09:34.221689+0000","last_peered":"2023-11-25T04:09:34.221689+0000","last_clean":"2023-11-25T04:09:34.221689+0000","last_became_active":"2023-11-25T04:09:33.182971+0000","last_became_peered":"2023-11-25T04:09:33.182971+0000","last_unstale":"2023-11-25T04:09:34.221689+0000","last_undegraded":"2023-11-25T04:09:34.221689+0000","last_fullsized":"2023-11-25T04:09:34.221689+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:19:48.334351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205679+0000","last_change":"2023-11-25T04:09:34.207583+0000","last_active":"2023-11-25T04:09:35.205679+0000","last_peered":"2023-11-25T04:09:35.205679+0000","last_clean":"2023-11-25T04:09:35.205679+0000","last_became_active":"2023-11-25T04:09:34.207162+0000","last_became_peered":"2023-11-25T04:09:34.207162+0000","last_unstale":"2023-11-25T04:09:35.205679+0000","last_undegraded":"2023-11-25T04:09:35.205679+0000","last_fullsized":"2023-11-25T04:09:35.205679+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T15:02:51.783723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.221662+0000","last_change":"2023-11-25T04:09:33.185480+0000","last_active":"2023-11-25T04:09:34.221662+0000","last_peered":"2023-11-25T04:09:34.221662+0000","last_clean":"2023-11-25T04:09:34.221662+0000","last_became_active":"2023-11-25T04:09:33.184129+0000","last_became_peered":"2023-11-25T04:09:33.184129+0000","last_unstale":"2023-11-25T04:09:34.221662+0000","last_undegraded":"2023-11-25T04:09:34.221662+0000","last_fullsized":"2023-11-25T04:09:34.221662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:39.194101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504908+0000","last_change":"2023-11-25T04:09:34.198947+0000","last_active":"2023-11-25T04:09:35.504908+0000","last_peered":"2023-11-25T04:09:35.504908+0000","last_clean":"2023-11-25T04:09:35.504908+0000","last_became_active":"2023-11-25T04:09:34.198626+0000","last_became_peered":"2023-11-25T04:09:34.198626+0000","last_unstale":"2023-11-25T04:09:35.504908+0000","last_undegraded":"2023-11-25T04:09:35.504908+0000","last_fullsized":"2023-11-25T04:09:35.504908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:45:34.059283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.220932+0000","last_change":"2023-11-25T04:09:33.186565+0000","last_active":"2023-11-25T04:09:34.220932+0000","last_peered":"2023-11-25T04:09:34.220932+0000","last_clean":"2023-11-25T04:09:34.220932+0000","last_became_active":"2023-11-25T04:09:33.186107+0000","last_became_peered":"2023-11-25T04:09:33.186107+0000","last_unstale":"2023-11-25T04:09:34.220932+0000","last_undegraded":"2023-11-25T04:09:34.220932+0000","last_fullsized":"2023-11-25T04:09:34.220932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:10:00.788456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205640+0000","last_change":"2023-11-25T04:09:34.210274+0000","last_active":"2023-11-25T04:09:35.205640+0000","last_peered":"2023-11-25T04:09:35.205640+0000","last_clean":"2023-11-25T04:09:35.205640+0000","last_became_active":"2023-11-25T04:09:34.209983+0000","last_became_peered":"2023-11-25T04:09:34.209983+0000","last_unstale":"2023-11-25T04:09:35.205640+0000","last_undegraded":"2023-11-25T04:09:35.205640+0000","last_fullsized":"2023-11-25T04:09:35.205640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:37:15.475434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.218620+0000","last_change":"2023-11-25T04:09:33.189774+0000","last_active":"2023-11-25T04:09:34.218620+0000","last_peered":"2023-11-25T04:09:34.218620+0000","last_clean":"2023-11-25T04:09:34.218620+0000","last_became_active":"2023-11-25T04:09:33.189488+0000","last_became_peered":"2023-11-25T04:09:33.189488+0000","last_unstale":"2023-11-25T04:09:34.218620+0000","last_undegraded":"2023-11-25T04:09:34.218620+0000","last_fullsized":"2023-11-25T04:09:34.218620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:18:05.676381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.487160+0000","last_change":"2023-11-25T04:09:34.216589+0000","last_active":"2023-11-25T04:09:35.487160+0000","last_peered":"2023-11-25T04:09:35.487160+0000","last_clean":"2023-11-25T04:09:35.487160+0000","last_became_active":"2023-11-25T04:09:34.215967+0000","last_became_peered":"2023-11-25T04:09:34.215967+0000","last_unstale":"2023-11-25T04:09:35.487160+0000","last_undegraded":"2023-11-25T04:09:35.487160+0000","last_fullsized":"2023-11-25T04:09:35.487160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:27:55.352285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.196258+0000","last_change":"2023-11-25T04:09:33.182572+0000","last_active":"2023-11-25T04:09:34.196258+0000","last_peered":"2023-11-25T04:09:34.196258+0000","last_clean":"2023-11-25T04:09:34.196258+0000","last_became_active":"2023-11-25T04:09:33.182288+0000","last_became_peered":"2023-11-25T04:09:33.182288+0000","last_unstale":"2023-11-25T04:09:34.196258+0000","last_undegraded":"2023-11-25T04:09:34.196258+0000","last_fullsized":"2023-11-25T04:09:34.196258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:24:30.148126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.487138+0000","last_change":"2023-11-25T04:09:34.208847+0000","last_active":"2023-11-25T04:09:35.487138+0000","last_peered":"2023-11-25T04:09:35.487138+0000","last_clean":"2023-11-25T04:09:35.487138+0000","last_became_active":"2023-11-25T04:09:34.208513+0000","last_became_peered":"2023-11-25T04:09:34.208513+0000","last_unstale":"2023-11-25T04:09:35.487138+0000","last_undegraded":"2023-11-25T04:09:35.487138+0000","last_fullsized":"2023-11-25T04:09:35.487138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T06:17:40.879831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.217028+0000","last_change":"2023-11-25T04:09:33.189102+0000","last_active":"2023-11-25T04:09:34.217028+0000","last_peered":"2023-11-25T04:09:34.217028+0000","last_clean":"2023-11-25T04:09:34.217028+0000","last_became_active":"2023-11-25T04:09:33.188807+0000","last_became_peered":"2023-11-25T04:09:33.188807+0000","last_unstale":"2023-11-25T04:09:34.217028+0000","last_undegraded":"2023-11-25T04:09:34.217028+0000","last_fullsized":"2023-11-25T04:09:34.217028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:10:00.788456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.487305+0000","last_change":"2023-11-25T04:09:34.208091+0000","last_active":"2023-11-25T04:09:35.487305+0000","last_peered":"2023-11-25T04:09:35.487305+0000","last_clean":"2023-11-25T04:09:35.487305+0000","last_became_active":"2023-11-25T04:09:34.207807+0000","last_became_peered":"2023-11-25T04:09:34.207807+0000","last_unstale":"2023-11-25T04:09:35.487305+0000","last_undegraded":"2023-11-25T04:09:35.487305+0000","last_fullsized":"2023-11-25T04:09:35.487305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:20:37.461583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.199741+0000","last_change":"2023-11-25T04:09:33.191572+0000","last_active":"2023-11-25T04:09:34.199741+0000","last_peered":"2023-11-25T04:09:34.199741+0000","last_clean":"2023-11-25T04:09:34.199741+0000","last_became_active":"2023-11-25T04:09:33.191179+0000","last_became_peered":"2023-11-25T04:09:33.191179+0000","last_unstale":"2023-11-25T04:09:34.199741+0000","last_undegraded":"2023-11-25T04:09:34.199741+0000","last_fullsized":"2023-11-25T04:09:34.199741+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T14:18:05.676381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.487123+0000","last_change":"2023-11-25T04:09:34.206972+0000","last_active":"2023-11-25T04:09:35.487123+0000","last_peered":"2023-11-25T04:09:35.487123+0000","last_clean":"2023-11-25T04:09:35.487123+0000","last_became_active":"2023-11-25T04:09:34.206698+0000","last_became_peered":"2023-11-25T04:09:34.206698+0000","last_unstale":"2023-11-25T04:09:35.487123+0000","last_undegraded":"2023-11-25T04:09:35.487123+0000","last_fullsized":"2023-11-25T04:09:35.487123+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T05:24:31.684917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.196881+0000","last_change":"2023-11-25T04:09:33.181632+0000","last_active":"2023-11-25T04:09:34.196881+0000","last_peered":"2023-11-25T04:09:34.196881+0000","last_clean":"2023-11-25T04:09:34.196881+0000","last_became_active":"2023-11-25T04:09:33.181116+0000","last_became_peered":"2023-11-25T04:09:33.181116+0000","last_unstale":"2023-11-25T04:09:34.196881+0000","last_undegraded":"2023-11-25T04:09:34.196881+0000","last_fullsized":"2023-11-25T04:09:34.196881+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T12:20:36.457703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504640+0000","last_change":"2023-11-25T04:09:34.208396+0000","last_active":"2023-11-25T04:09:35.504640+0000","last_peered":"2023-11-25T04:09:35.504640+0000","last_clean":"2023-11-25T04:09:35.504640+0000","last_became_active":"2023-11-25T04:09:34.208073+0000","last_became_peered":"2023-11-25T04:09:34.208073+0000","last_unstale":"2023-11-25T04:09:35.504640+0000","last_undegraded":"2023-11-25T04:09:35.504640+0000","last_fullsized":"2023-11-25T04:09:35.504640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:15:06.446153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.189348+0000","last_change":"2023-11-25T04:09:33.190702+0000","last_active":"2023-11-25T04:09:34.189348+0000","last_peered":"2023-11-25T04:09:34.189348+0000","last_clean":"2023-11-25T04:09:34.189348+0000","last_became_active":"2023-11-25T04:09:33.190367+0000","last_became_peered":"2023-11-25T04:09:33.190367+0000","last_unstale":"2023-11-25T04:09:34.189348+0000","last_undegraded":"2023-11-25T04:09:34.189348+0000","last_fullsized":"2023-11-25T04:09:34.189348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:57:39.194101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.487276+0000","last_change":"2023-11-25T04:09:34.211173+0000","last_active":"2023-11-25T04:09:35.487276+0000","last_peered":"2023-11-25T04:09:35.487276+0000","last_clean":"2023-11-25T04:09:35.487276+0000","last_became_active":"2023-11-25T04:09:34.210785+0000","last_became_peered":"2023-11-25T04:09:34.210785+0000","last_unstale":"2023-11-25T04:09:35.487276+0000","last_undegraded":"2023-11-25T04:09:35.487276+0000","last_fullsized":"2023-11-25T04:09:35.487276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:10:01.792336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.221167+0000","last_change":"2023-11-25T04:09:33.181359+0000","last_active":"2023-11-25T04:09:34.221167+0000","last_peered":"2023-11-25T04:09:34.221167+0000","last_clean":"2023-11-25T04:09:34.221167+0000","last_became_active":"2023-11-25T04:09:33.180469+0000","last_became_peered":"2023-11-25T04:09:33.180469+0000","last_unstale":"2023-11-25T04:09:34.221167+0000","last_undegraded":"2023-11-25T04:09:34.221167+0000","last_fullsized":"2023-11-25T04:09:34.221167+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:36.913213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.505057+0000","last_change":"2023-11-25T04:09:34.216411+0000","last_active":"2023-11-25T04:09:35.505057+0000","last_peered":"2023-11-25T04:09:35.505057+0000","last_clean":"2023-11-25T04:09:35.505057+0000","last_became_active":"2023-11-25T04:09:34.216166+0000","last_became_peered":"2023-11-25T04:09:34.216166+0000","last_unstale":"2023-11-25T04:09:35.505057+0000","last_undegraded":"2023-11-25T04:09:35.505057+0000","last_fullsized":"2023-11-25T04:09:35.505057+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:46:36.361049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"33'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504288+0000","last_change":"2023-11-25T04:09:33.186169+0000","last_active":"2023-11-25T04:09:35.504288+0000","last_peered":"2023-11-25T04:09:35.504288+0000","last_clean":"2023-11-25T04:09:35.504288+0000","last_became_active":"2023-11-25T04:09:33.185499+0000","last_became_peered":"2023-11-25T04:09:33.185499+0000","last_unstale":"2023-11-25T04:09:35.504288+0000","last_undegraded":"2023-11-25T04:09:35.504288+0000","last_fullsized":"2023-11-25T04:09:35.504288+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T07:24:30.148126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504084+0000","last_change":"2023-11-25T04:09:34.214227+0000","last_active":"2023-11-25T04:09:35.504084+0000","last_peered":"2023-11-25T04:09:35.504084+0000","last_clean":"2023-11-25T04:09:35.504084+0000","last_became_active":"2023-11-25T04:09:34.213943+0000","last_became_peered":"2023-11-25T04:09:34.213943+0000","last_unstale":"2023-11-25T04:09:35.504084+0000","last_undegraded":"2023-11-25T04:09:35.504084+0000","last_fullsized":"2023-11-25T04:09:35.504084+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:19:49.338230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.198728+0000","last_change":"2023-11-25T04:09:33.189359+0000","last_active":"2023-11-25T04:09:34.198728+0000","last_peered":"2023-11-25T04:09:34.198728+0000","last_clean":"2023-11-25T04:09:34.198728+0000","last_became_active":"2023-11-25T04:09:33.189104+0000","last_became_peered":"2023-11-25T04:09:33.189104+0000","last_unstale":"2023-11-25T04:09:34.198728+0000","last_undegraded":"2023-11-25T04:09:34.198728+0000","last_fullsized":"2023-11-25T04:09:34.198728+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:07:34.435540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.297666+0000","last_change":"2023-11-25T04:09:34.211897+0000","last_active":"2023-11-25T04:09:35.297666+0000","last_peered":"2023-11-25T04:09:35.297666+0000","last_clean":"2023-11-25T04:09:35.297666+0000","last_became_active":"2023-11-25T04:09:34.211266+0000","last_became_peered":"2023-11-25T04:09:34.211266+0000","last_unstale":"2023-11-25T04:09:35.297666+0000","last_undegraded":"2023-11-25T04:09:35.297666+0000","last_fullsized":"2023-11-25T04:09:35.297666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:29:23.366479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.193118+0000","last_change":"2023-11-25T04:09:33.187067+0000","last_active":"2023-11-25T04:09:34.193118+0000","last_peered":"2023-11-25T04:09:34.193118+0000","last_clean":"2023-11-25T04:09:34.193118+0000","last_became_active":"2023-11-25T04:09:33.186690+0000","last_became_peered":"2023-11-25T04:09:33.186690+0000","last_unstale":"2023-11-25T04:09:34.193118+0000","last_undegraded":"2023-11-25T04:09:34.193118+0000","last_fullsized":"2023-11-25T04:09:34.193118+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T13:07:34.435540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.504187+0000","last_change":"2023-11-25T04:09:34.205586+0000","last_active":"2023-11-25T04:09:35.504187+0000","last_peered":"2023-11-25T04:09:35.504187+0000","last_clean":"2023-11-25T04:09:35.504187+0000","last_became_active":"2023-11-25T04:09:34.205315+0000","last_became_peered":"2023-11-25T04:09:34.205315+0000","last_unstale":"2023-11-25T04:09:35.504187+0000","last_undegraded":"2023-11-25T04:09:35.504187+0000","last_fullsized":"2023-11-25T04:09:35.504187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:50:14.918194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.201285+0000","last_change":"2023-11-25T04:09:33.184030+0000","last_active":"2023-11-25T04:09:34.201285+0000","last_peered":"2023-11-25T04:09:34.201285+0000","last_clean":"2023-11-25T04:09:34.201285+0000","last_became_active":"2023-11-25T04:09:33.183738+0000","last_became_peered":"2023-11-25T04:09:33.183738+0000","last_unstale":"2023-11-25T04:09:34.201285+0000","last_undegraded":"2023-11-25T04:09:34.201285+0000","last_fullsized":"2023-11-25T04:09:34.201285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:50:13.914314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.204126+0000","last_change":"2023-11-25T04:09:34.211715+0000","last_active":"2023-11-25T04:09:35.204126+0000","last_peered":"2023-11-25T04:09:35.204126+0000","last_clean":"2023-11-25T04:09:35.204126+0000","last_became_active":"2023-11-25T04:09:34.211464+0000","last_became_peered":"2023-11-25T04:09:34.211464+0000","last_unstale":"2023-11-25T04:09:35.204126+0000","last_undegraded":"2023-11-25T04:09:35.204126+0000","last_fullsized":"2023-11-25T04:09:35.204126+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:15:06.446153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.197031+0000","last_change":"2023-11-25T04:09:33.185584+0000","last_active":"2023-11-25T04:09:34.197031+0000","last_peered":"2023-11-25T04:09:34.197031+0000","last_clean":"2023-11-25T04:09:34.197031+0000","last_became_active":"2023-11-25T04:09:33.185207+0000","last_became_peered":"2023-11-25T04:09:33.185207+0000","last_unstale":"2023-11-25T04:09:34.197031+0000","last_undegraded":"2023-11-25T04:09:34.197031+0000","last_fullsized":"2023-11-25T04:09:34.197031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:29:22.362599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.205648+0000","last_change":"2023-11-25T04:09:34.201280+0000","last_active":"2023-11-25T04:09:35.205648+0000","last_peered":"2023-11-25T04:09:35.205648+0000","last_clean":"2023-11-25T04:09:35.205648+0000","last_became_active":"2023-11-25T04:09:34.200995+0000","last_became_peered":"2023-11-25T04:09:34.200995+0000","last_unstale":"2023-11-25T04:09:35.205648+0000","last_undegraded":"2023-11-25T04:09:35.205648+0000","last_fullsized":"2023-11-25T04:09:35.205648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T10:52:37.917093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.191907+0000","last_change":"2023-11-25T04:09:33.192382+0000","last_active":"2023-11-25T04:09:34.191907+0000","last_peered":"2023-11-25T04:09:34.191907+0000","last_clean":"2023-11-25T04:09:34.191907+0000","last_became_active":"2023-11-25T04:09:33.192098+0000","last_became_peered":"2023-11-25T04:09:33.192098+0000","last_unstale":"2023-11-25T04:09:34.191907+0000","last_undegraded":"2023-11-25T04:09:34.191907+0000","last_fullsized":"2023-11-25T04:09:34.191907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T08:50:13.914314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-25T04:09:35.505128+0000","last_change":"2023-11-25T04:09:34.204038+0000","last_active":"2023-11-25T04:09:35.505128+0000","last_peered":"2023-11-25T04:09:35.505128+0000","last_clean":"2023-11-25T04:09:35.505128+0000","last_became_active":"2023-11-25T04:09:34.203784+0000","last_became_peered":"2023-11-25T04:09:34.203784+0000","last_unstale":"2023-11-25T04:09:35.505128+0000","last_undegraded":"2023-11-25T04:09:35.505128+0000","last_fullsized":"2023-11-25T04:09:35.505128+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:33.168438+0000","last_clean_scrub_stamp":"2023-11-25T04:09:33.168438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T09:46:36.361049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.196216+0000","last_change":"2023-11-25T04:09:33.189052+0000","last_active":"2023-11-25T04:09:34.196216+0000","last_peered":"2023-11-25T04:09:34.196216+0000","last_clean":"2023-11-25T04:09:34.196216+0000","last_became_active":"2023-11-25T04:09:33.188766+0000","last_became_peered":"2023-11-25T04:09:33.188766+0000","last_unstale":"2023-11-25T04:09:34.196216+0000","last_undegraded":"2023-11-25T04:09:34.196216+0000","last_fullsized":"2023-11-25T04:09:34.196216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:09:32.164558+0000","last_clean_scrub_stamp":"2023-11-25T04:09:32.164558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:26.226605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-25T04:09:34.196218+0000","last_change":"2023-11-25T04:08:24.570240+0000","last_active":"2023-11-25T04:09:34.196218+0000","last_peered":"2023-11-25T04:09:34.196218+0000","last_clean":"2023-11-25T04:09:34.196218+0000","last_became_active":"2023-11-25T04:08:24.569371+0000","last_became_peered":"2023-11-25T04:08:24.569371+0000","last_unstale":"2023-11-25T04:09:34.196218+0000","last_undegraded":"2023-11-25T04:09:34.196218+0000","last_fullsized":"2023-11-25T04:09:34.196218+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-25T04:08:23.534401+0000","last_clean_scrub_stamp":"2023-11-25T04:08:23.534401+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-26T11:44:28.293127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":737212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59199999999999997}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53500000000000003}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51200000000000001}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.439}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.376},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.47799999999999998}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.77400000000000002}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.68500000000000005}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.80200000000000005}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.872}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.65700000000000003}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.751}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":147426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.439},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.46600000000000003}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.59099999999999997}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.49299999999999999}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64400000000000002}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54600000000000004}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.63300000000000001}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":380928,"data_stored":146858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.38600000000000001}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.435},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.46700000000000003}]},{"osd":2,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.53200000000000003}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.496},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.66900000000000004}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.58299999999999996}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.63100000000000001}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.748}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":389120,"data_stored":148388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.28100000000000003}]},{"osd":1,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.5509999999999999,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.317}]},{"osd":2,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.35499999999999998}]},{"osd":4,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54100000000000004}]},{"osd":5,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.627}]},{"osd":7,"last update":"Sat Nov 25 04:09:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":146824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.376}]},{"osd":1,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.48099999999999998}]},{"osd":3,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.504},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.78900000000000003}]},{"osd":5,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.745},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.82899999999999996}]},{"osd":6,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Sat Nov 25 04:09:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.72699999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31568,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340272,"statfs":{"total":96636764160,"available":96604438528,"internally_reserved":0,"allocated":389120,"data_stored":148388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.35999999999999999}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.377,"5min":0.377,"15min":0.377},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.39700000000000002}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.379,"5min":0.379,"15min":0.379},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.43099999999999999}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.46300000000000002}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.45000000000000001}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.496}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.52500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":966656,"data_stored":737122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.31900000000000001}]},{"osd":2,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.437,"5min":0.437,"15min":0.437},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.38500000000000001}]},{"osd":4,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52200000000000002}]},{"osd":5,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.48499999999999999}]},{"osd":6,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.47099999999999997}]},{"osd":7,"last update":"Sat Nov 25 04:09:24 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.50900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-25T04:09:42.037 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-25T04:09:42.038 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-25T04:09:42.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9569da0640 1 Processor -- start 2023-11-25T04:09:42.186 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9569da0640 1 -- start start 2023-11-25T04:09:42.187 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9569da0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 0x7f95640cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9569da0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f95640b6670 0x7f95640b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9569da0640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95640d1920 con 0x7f9564160810 2023-11-25T04:09:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9569da0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95640d1c00 con 0x7f95640b6670 2023-11-25T04:09:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9569da0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95640d1ee0 con 0x7f95640ced10 2023-11-25T04:09:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9563fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 0x7f95640cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f956959f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f95640b6670 0x7f95640b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9568d9e640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9564160810 0x7f95640cf8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.2:51210/0 (socket says 172.21.15.2:51210) 2023-11-25T04:09:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9568d9e640 1 -- 172.21.15.2:0/1701410572 learned_addr learned my addr 172.21.15.2:0/1701410572 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:42.188 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9563fff640 1 -- 172.21.15.2:0/1701410572 >> v2:172.21.15.66:3300/0 conn(0x7f95640b6670 msgr2=0x7f95640b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9563fff640 1 --2- 172.21.15.2:0/1701410572 >> v2:172.21.15.66:3300/0 conn(0x7f95640b6670 0x7f95640b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9563fff640 1 -- 172.21.15.2:0/1701410572 >> v1:172.21.15.66:6789/0 conn(0x7f9564160810 legacy=0x7f95640cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f9563fff640 1 -- 172.21.15.2:0/1701410572 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95640b5e70 con 0x7f95640ced10 2023-11-25T04:09:42.189 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.185+0000 7f956959f640 1 --2- 172.21.15.2:0/1701410572 >> v2:172.21.15.66:3300/0 conn(0x7f95640b6670 0x7f95640b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:09:42.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.186+0000 7f9563fff640 1 --2- 172.21.15.2:0/1701410572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 0x7f95640cffd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f95500097a0 tx=0x7f955002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e52541ee4fec46 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:42.190 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.186+0000 7f95637fe640 1 -- 172.21.15.2:0/1701410572 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550030610 con 0x7f95640ced10 2023-11-25T04:09:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.186+0000 7f95637fe640 1 -- 172.21.15.2:0/1701410572 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9550030770 con 0x7f95640ced10 2023-11-25T04:09:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.186+0000 7f95637fe640 1 -- 172.21.15.2:0/1701410572 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550030b00 con 0x7f95640ced10 2023-11-25T04:09:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.187+0000 7f9569da0640 1 -- 172.21.15.2:0/1701410572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 msgr2=0x7f95640cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.187+0000 7f9569da0640 1 --2- 172.21.15.2:0/1701410572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 0x7f95640cffd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f95500097a0 tx=0x7f955002b960 comp rx=0 tx=0).stop 2023-11-25T04:09:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.187+0000 7f9569da0640 1 -- 172.21.15.2:0/1701410572 shutdown_connections 2023-11-25T04:09:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.187+0000 7f9569da0640 1 --2- 172.21.15.2:0/1701410572 >> v2:172.21.15.66:3300/0 conn(0x7f95640b6670 0x7f95640b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.187+0000 7f9569da0640 1 --2- 172.21.15.2:0/1701410572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 0x7f95640cffd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.187+0000 7f9569da0640 1 -- 172.21.15.2:0/1701410572 >> 172.21.15.2:0/1701410572 conn(0x7f95640d2f80 msgr2=0x7f95640d3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:42.191 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.187+0000 7f9569da0640 1 -- 172.21.15.2:0/1701410572 shutdown_connections 2023-11-25T04:09:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.187+0000 7f9569da0640 1 -- 172.21.15.2:0/1701410572 wait complete. 2023-11-25T04:09:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.188+0000 7f9569da0640 1 Processor -- start 2023-11-25T04:09:42.192 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.188+0000 7f9569da0640 1 -- start start 2023-11-25T04:09:42.193 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.189+0000 7f9569da0640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95640b6670 0x7f95640ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.189+0000 7f9569da0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 0x7f95640caa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.189+0000 7f9569da0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9564160810 0x7f956414d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.189+0000 7f9569da0640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95640caf70 con 0x7f95640b6670 2023-11-25T04:09:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.189+0000 7f9569da0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95640c7b70 con 0x7f9564160810 2023-11-25T04:09:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.189+0000 7f9569da0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95640cb200 con 0x7f95640ced10 2023-11-25T04:09:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.189+0000 7f9568d9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95640b6670 0x7f95640ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.189+0000 7f9568d9e640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95640b6670 0x7f95640ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54972/0 (socket says 172.21.15.2:54972) 2023-11-25T04:09:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.189+0000 7f9568d9e640 1 -- 172.21.15.2:0/231962479 learned_addr learned my addr 172.21.15.2:0/231962479 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:42.194 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f956959f640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9564160810 0x7f956414d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f9563fff640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 0x7f95640caa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f9568d9e640 1 -- 172.21.15.2:0/231962479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 msgr2=0x7f95640caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f9568d9e640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 0x7f95640caa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f9568d9e640 1 -- 172.21.15.2:0/231962479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9564160810 msgr2=0x7f956414d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f9568d9e640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9564160810 0x7f956414d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f9568d9e640 1 -- 172.21.15.2:0/231962479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c009a70 con 0x7f95640b6670 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f9568d9e640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95640b6670 0x7f95640ccb00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f955800c400 tx=0x7f955800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f95617fa640 1 -- 172.21.15.2:0/231962479 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558005ce0 con 0x7f95640b6670 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f95617fa640 1 -- 172.21.15.2:0/231962479 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9558005e40 con 0x7f95640b6670 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9550009400 con 0x7f95640b6670 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f95617fa640 1 -- 172.21.15.2:0/231962479 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95580072d0 con 0x7f95640b6670 2023-11-25T04:09:42.195 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.190+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95640c7e30 con 0x7f95640b6670 2023-11-25T04:09:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.191+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956404e840 con 0x7f95640b6670 2023-11-25T04:09:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.192+0000 7f95617fa640 1 -- 172.21.15.2:0/231962479 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95580074f0 con 0x7f95640b6670 2023-11-25T04:09:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.194+0000 7f95617fa640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f954806ae40 0x7f954806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.196 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.194+0000 7f95617fa640 1 -- 172.21.15.2:0/231962479 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95580890c0 con 0x7f95640b6670 2023-11-25T04:09:42.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.194+0000 7f9563fff640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f954806ae40 0x7f954806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.197 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.194+0000 7f9563fff640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f954806ae40 0x7f954806d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9550036000 tx=0x7f955003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:42.198 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.196+0000 7f95617fa640 1 -- 172.21.15.2:0/231962479 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9558054170 con 0x7f95640b6670 2023-11-25T04:09:42.447 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.446+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f956415e060 con 0x7f95640b6670 2023-11-25T04:09:42.448 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.448+0000 7f95617fa640 1 -- 172.21.15.2:0/231962479 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f95580170e0 con 0x7f95640b6670 2023-11-25T04:09:42.449 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2023-11-25T04:09:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQALc2FlqNP5GhAAv0HvFTFKxDiE/tkoFN1FKA== 2023-11-25T04:09:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow" 2023-11-25T04:09:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow r" 2023-11-25T04:09:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-25T04:09:42.449 INFO:teuthology.orchestra.run.smithi002.stderr:updated caps for client.0 2023-11-25T04:09:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f954806ae40 msgr2=0x7f954806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f954806ae40 0x7f954806d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9550036000 tx=0x7f955003b040 comp rx=0 tx=0).stop 2023-11-25T04:09:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95640b6670 msgr2=0x7f95640ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95640b6670 0x7f95640ccb00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f955800c400 tx=0x7f955800c8c0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 shutdown_connections 2023-11-25T04:09:42.451 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f954806ae40 0x7f954806d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9564160810 0x7f956414d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95640ced10 0x7f95640caa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 --2- 172.21.15.2:0/231962479 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f95640b6670 0x7f95640ccb00 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 >> 172.21.15.2:0/231962479 conn(0x7f95640d2f80 msgr2=0x7f95640b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 shutdown_connections 2023-11-25T04:09:42.452 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.450+0000 7f9569da0640 1 -- 172.21.15.2:0/231962479 wait complete. 2023-11-25T04:09:42.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-25T04:09:42.568 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.568+0000 7f03f4f3c640 1 Processor -- start 2023-11-25T04:09:42.569 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.568+0000 7f03f4f3c640 1 -- start start 2023-11-25T04:09:42.572 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.568+0000 7f03f4f3c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f03f00b2690 0x7f03f015d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.568+0000 7f03f4f3c640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f006e9e0 con 0x7f03f006cc50 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.568+0000 7f03f4f3c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f006de60 con 0x7f03f006a8b0 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.568+0000 7f03f4f3c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f006d0d0 con 0x7f03f00b2690 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03e7fff640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7f03f006cc50 0x7f03f00b2a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35440/0 (socket says 172.21.15.2:35440) 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03e7fff640 1 -- 172.21.15.2:0/1175228720 learned_addr learned my addr 172.21.15.2:0/1175228720 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03ee59c640 1 --2- 172.21.15.2:0/1175228720 >> v2:172.21.15.66:3300/0 conn(0x7f03f00b2690 0x7f03f015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479867218 0 0) 0x7f03f006e9e0 con 0x7f03f006cc50 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc003520 con 0x7f03f006cc50 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 548852924 0 0) 0x7f03dc003520 con 0x7f03f006cc50 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 >> v2:172.21.15.66:3300/0 conn(0x7f03f00b2690 msgr2=0x7f03f015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 --2- 172.21.15.2:0/1175228720 >> v2:172.21.15.66:3300/0 conn(0x7f03f00b2690 0x7f03f015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.573 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 >> v1:172.21.15.66:6789/0 conn(0x7f03f006a8b0 legacy=0x7f03f006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f006d2e0 con 0x7f03f006cc50 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7f03d8001670 con 0x7f03f006cc50 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 >> v1:172.21.15.2:6789/0 conn(0x7f03f006cc50 legacy=0x7f03f00b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03dc003970 0x7f03dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 0x7f03dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03dc005180 0x7f03dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f006d0d0 con 0x7f03dc005180 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc00c120 con 0x7f03dc0047c0 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc00c2e0 con 0x7f03dc003970 2023-11-25T04:09:42.574 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03eed9d640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03dc005180 0x7f03dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03e7fff640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 0x7f03dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.569+0000 7f03ee59c640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03dc003970 0x7f03dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.570+0000 7f03e7fff640 1 -- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03dc003970 msgr2=0x7f03dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.570+0000 7f03e7fff640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03dc003970 0x7f03dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.570+0000 7f03e7fff640 1 -- 172.21.15.2:0/1175228720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03dc005180 msgr2=0x7f03dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.570+0000 7f03e7fff640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03dc005180 0x7f03dc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.570+0000 7f03e7fff640 1 -- 172.21.15.2:0/1175228720 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc003520 con 0x7f03dc0047c0 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.570+0000 7f03eed9d640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03dc005180 0x7f03dc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.570+0000 7f03eed9d640 1 -- 172.21.15.2:0/1175228720 reap_dead start 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03e7fff640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 0x7f03dc004c40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03d800c240 tx=0x7f03dc0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=587d7dad4b977e05 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8005ad0 con 0x7f03dc0047c0 2023-11-25T04:09:42.575 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d8005c30 con 0x7f03dc0047c0 2023-11-25T04:09:42.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03edd9b640 1 -- 172.21.15.2:0/1175228720 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d802caf0 con 0x7f03dc0047c0 2023-11-25T04:09:42.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03f4f3c640 1 -- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 msgr2=0x7f03dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03f4f3c640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 0x7f03dc004c40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f03d800c240 tx=0x7f03dc0057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03f4f3c640 1 -- 172.21.15.2:0/1175228720 shutdown_connections 2023-11-25T04:09:42.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03f4f3c640 1 --2- 172.21.15.2:0/1175228720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 0x7f03dc004c40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03f4f3c640 1 -- 172.21.15.2:0/1175228720 >> 172.21.15.2:0/1175228720 conn(0x7f03f00cf6a0 msgr2=0x7f03f00cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:42.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03f4f3c640 1 -- 172.21.15.2:0/1175228720 shutdown_connections 2023-11-25T04:09:42.576 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.571+0000 7f03f4f3c640 1 -- 172.21.15.2:0/1175228720 wait complete. 2023-11-25T04:09:42.578 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.573+0000 7f03f4f3c640 1 Processor -- start 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.573+0000 7f03f4f3c640 1 -- start start 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.573+0000 7f03f4f3c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 0x7f03f01f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.573+0000 7f03f4f3c640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f014d050 0x7f03f00ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.573+0000 7f03f4f3c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03f014d4d0 0x7f03f00ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.573+0000 7f03f4f3c640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c4780 con 0x7f03f014d050 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.573+0000 7f03f4f3c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c4a40 con 0x7f03dc0047c0 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.573+0000 7f03f4f3c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c4d20 con 0x7f03f014d4d0 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.573+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f014d050 0x7f03f00ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e7fff640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f014d050 0x7f03f00ad280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:54994/0 (socket says 172.21.15.2:54994) 2023-11-25T04:09:42.579 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e7fff640 1 -- 172.21.15.2:0/2302968491 learned_addr learned my addr 172.21.15.2:0/2302968491 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:42.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03ee59c640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 0x7f03f01f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03eed9d640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03f014d4d0 0x7f03f00ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e7fff640 1 -- 172.21.15.2:0/2302968491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03f014d4d0 msgr2=0x7f03f00ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e7fff640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03f014d4d0 0x7f03f00ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.580 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e7fff640 1 -- 172.21.15.2:0/2302968491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 msgr2=0x7f03f01f2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e7fff640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 0x7f03f01f2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e7fff640 1 -- 172.21.15.2:0/2302968491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f00c5000 con 0x7f03f014d050 2023-11-25T04:09:42.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03eed9d640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03f014d4d0 0x7f03f00ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:42.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e7fff640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f014d050 0x7f03f00ad280 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f03d8001930 tx=0x7f03d802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:42.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e6ffd640 1 -- 172.21.15.2:0/2302968491 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d803c040 con 0x7f03f014d050 2023-11-25T04:09:42.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e6ffd640 1 -- 172.21.15.2:0/2302968491 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d802ccc0 con 0x7f03f014d050 2023-11-25T04:09:42.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f00c52e0 con 0x7f03f014d050 2023-11-25T04:09:42.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03e6ffd640 1 -- 172.21.15.2:0/2302968491 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d8007270 con 0x7f03f014d050 2023-11-25T04:09:42.581 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.574+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f0158bd0 con 0x7f03f014d050 2023-11-25T04:09:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.575+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00c4e60 con 0x7f03f014d050 2023-11-25T04:09:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.576+0000 7f03e6ffd640 1 -- 172.21.15.2:0/2302968491 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03d8032070 con 0x7f03f014d050 2023-11-25T04:09:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.576+0000 7f03e6ffd640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f03d006ae40 0x7f03d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.576+0000 7f03e6ffd640 1 -- 172.21.15.2:0/2302968491 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03d80aaa20 con 0x7f03f014d050 2023-11-25T04:09:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.576+0000 7f03ee59c640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f03d006ae40 0x7f03d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.577+0000 7f03ee59c640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f03d006ae40 0x7f03d006d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009b80 tx=0x7f03e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:42.582 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.580+0000 7f03e6ffd640 1 -- 172.21.15.2:0/2302968491 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03f00c4e60 con 0x7f03f014d050 2023-11-25T04:09:42.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.793+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03f00c4e60 con 0x7f03f014d050 2023-11-25T04:09:42.795 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.794+0000 7f03e6ffd640 1 -- 172.21.15.2:0/2302968491 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+4907 (secure 0 0 0) 0x7f03f00c4e60 con 0x7f03f014d050 2023-11-25T04:09:42.796 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:42.796 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":15,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4853,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/3409201819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":3409201819},{"type":"v1","addr":"172.21.15.66:6835","nonce":3409201819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5077,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/1057929535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1057929535},{"type":"v1","addr":"172.21.15.66:6834","nonce":1057929535}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5086,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.2:6837/2836978310","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6835","nonce":2836978310},{"type":"v1","addr":"172.21.15.2:6837","nonce":2836978310}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-25T04:09:33.548399+0000","modified":"2023-11-25T04:09:35.547521+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.2:6836/1180484123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6834","nonce":1180484123},{"type":"v1","addr":"172.21.15.2:6836","nonce":1180484123}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-25T04:09:42.797 INFO:teuthology.orchestra.run.smithi002.stderr:dumped fsmap epoch 15 2023-11-25T04:09:42.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f03d006ae40 msgr2=0x7f03d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f03d006ae40 0x7f03d006d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009b80 tx=0x7f03e0008040 comp rx=0 tx=0).stop 2023-11-25T04:09:42.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f014d050 msgr2=0x7f03f00ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:42.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f014d050 0x7f03f00ad280 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f03d8001930 tx=0x7f03d802e070 comp rx=0 tx=0).stop 2023-11-25T04:09:42.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 shutdown_connections 2023-11-25T04:09:42.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f03f014d4d0 0x7f03f00ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.797 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f03f014d050 0x7f03f00ad280 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f03d006ae40 0x7f03d006d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 --2- 172.21.15.2:0/2302968491 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03dc0047c0 0x7f03f01f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.795+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 >> 172.21.15.2:0/2302968491 conn(0x7f03f00cf6a0 msgr2=0x7f03f00ac7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.796+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 shutdown_connections 2023-11-25T04:09:42.798 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:42.796+0000 7f03f4f3c640 1 -- 172.21.15.2:0/2302968491 wait complete. 2023-11-25T04:09:43.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 15, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-25T04:09:33.548399+0000', 'modified': '2023-11-25T04:09:35.547521+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5199}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5199': {'gid': 5199, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.2:6836/1180484123', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.2:6834', 'nonce': 1180484123}, {'type': 'v1', 'addr': '172.21.15.2:6836', 'nonce': 1180484123}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-25T04:09:43.209 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-25T04:09:43.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-11-25T04:09:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.322+0000 7ff569883640 1 Processor -- start 2023-11-25T04:09:43.323 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.322+0000 7ff569883640 1 -- start start 2023-11-25T04:09:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.323+0000 7ff569883640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5640b2110 0x7ff5640cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.323+0000 7ff569883640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff5640d0070 0x7ff5640ce230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.323+0000 7ff569883640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5640b4b30 con 0x7ff564160ad0 2023-11-25T04:09:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.323+0000 7ff569883640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5640d0520 con 0x7ff5640d0070 2023-11-25T04:09:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.323+0000 7ff569883640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640d16a0 con 0x7ff5640b2110 2023-11-25T04:09:43.326 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.323+0000 7ff562ffd640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7ff564160ad0 0x7ff5640b4420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35446/0 (socket says 172.21.15.2:35446) 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.323+0000 7ff562ffd640 1 -- 172.21.15.2:0/2974631412 learned_addr learned my addr 172.21.15.2:0/2974631412 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.323+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531874498 0 0) 0x7ff5640b4b30 con 0x7ff564160ad0 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.323+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff54c003520 con 0x7ff564160ad0 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5637fe640 1 --2- 172.21.15.2:0/2974631412 >> v2:172.21.15.66:3300/0 conn(0x7ff5640d0070 0x7ff5640ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5627fc640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5640b2110 0x7ff5640cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 <== mon.0 v1:172.21.15.2:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1661017176 0 0) 0x7ff54c003520 con 0x7ff564160ad0 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5640b2110 msgr2=0x7ff5640cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5640b2110 0x7ff5640cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 >> v2:172.21.15.66:3300/0 conn(0x7ff5640d0070 msgr2=0x7ff5640ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 --2- 172.21.15.2:0/2974631412 >> v2:172.21.15.66:3300/0 conn(0x7ff5640d0070 0x7ff5640ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 --> v1:172.21.15.2:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5640d1980 con 0x7ff564160ad0 2023-11-25T04:09:43.327 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 <== mon.0 v1:172.21.15.2:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2999501569 0 0) 0x7ff5540019f0 con 0x7ff564160ad0 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5627fc640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5640b2110 0x7ff5640cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 >> v1:172.21.15.2:6789/0 conn(0x7ff564160ad0 legacy=0x7ff5640b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c003970 0x7ff54c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5640b2110 0x7ff54c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff54c004d00 0x7ff54c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640d0520 con 0x7ff54c004d00 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640d16a0 con 0x7ff54c003970 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54c00b9d0 con 0x7ff5640b2110 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5637fe640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff54c004d00 0x7ff54c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff562ffd640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c003970 0x7ff54c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5627fc640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5640b2110 0x7ff54c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5637fe640 1 -- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5640b2110 msgr2=0x7ff54c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.328 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5637fe640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5640b2110 0x7ff54c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5637fe640 1 -- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c003970 msgr2=0x7ff54c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5637fe640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff54c003970 0x7ff54c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.324+0000 7ff5637fe640 1 -- 172.21.15.2:0/2974631412 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54c003520 con 0x7ff54c004d00 2023-11-25T04:09:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.325+0000 7ff5637fe640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff54c004d00 0x7ff54c005180 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009ac0 tx=0x7ff54c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2514c0bbd6a05208 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.325+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c02c710 con 0x7ff54c004d00 2023-11-25T04:09:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.325+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c02c870 con 0x7ff54c004d00 2023-11-25T04:09:43.329 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.325+0000 7ff561ffb640 1 -- 172.21.15.2:0/2974631412 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c02cc00 con 0x7ff54c004d00 2023-11-25T04:09:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.326+0000 7ff569883640 1 -- 172.21.15.2:0/2974631412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff54c004d00 msgr2=0x7ff54c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.326+0000 7ff569883640 1 --2- 172.21.15.2:0/2974631412 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff54c004d00 0x7ff54c005180 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009ac0 tx=0x7ff54c0057f0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.326+0000 7ff5637fe640 1 -- 172.21.15.2:0/2974631412 reap_dead start 2023-11-25T04:09:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.326+0000 7ff569883640 1 -- 172.21.15.2:0/2974631412 shutdown_connections 2023-11-25T04:09:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.326+0000 7ff569883640 1 -- 172.21.15.2:0/2974631412 >> 172.21.15.2:0/2974631412 conn(0x7ff56409c500 msgr2=0x7ff5640d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.326+0000 7ff569883640 1 -- 172.21.15.2:0/2974631412 shutdown_connections 2023-11-25T04:09:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.326+0000 7ff569883640 1 -- 172.21.15.2:0/2974631412 wait complete. 2023-11-25T04:09:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.327+0000 7ff569883640 1 Processor -- start 2023-11-25T04:09:43.332 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.327+0000 7ff569883640 1 -- start start 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff569883640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5641f6220 0x7ff5640cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff569883640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5640cbf50 0x7ff5640b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff569883640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5640b2fb0 0x7ff5640ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff569883640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640b4fa0 con 0x7ff5640cbf50 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff569883640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640cc3d0 con 0x7ff5640b2fb0 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff569883640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5640b3430 con 0x7ff5641f6220 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5640cbf50 0x7ff5640b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5640cbf50 0x7ff5640b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55010/0 (socket says 172.21.15.2:55010) 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5627fc640 1 -- 172.21.15.2:0/2499817176 learned_addr learned my addr 172.21.15.2:0/2499817176 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5637fe640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5640b2fb0 0x7ff5640ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff562ffd640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5641f6220 0x7ff5640cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5627fc640 1 -- 172.21.15.2:0/2499817176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5641f6220 msgr2=0x7ff5640cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.333 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5627fc640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5641f6220 0x7ff5640cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5627fc640 1 -- 172.21.15.2:0/2499817176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5640b2fb0 msgr2=0x7ff5640ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5627fc640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5640b2fb0 0x7ff5640ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5627fc640 1 -- 172.21.15.2:0/2499817176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5640b3680 con 0x7ff5640cbf50 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.328+0000 7ff5637fe640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5640b2fb0 0x7ff5640ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.329+0000 7ff5627fc640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5640cbf50 0x7ff5640b2a70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff5580115b0 tx=0x7ff558011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.329+0000 7ff54bfff640 1 -- 172.21.15.2:0/2499817176 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55800c070 con 0x7ff5640cbf50 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.329+0000 7ff54bfff640 1 -- 172.21.15.2:0/2499817176 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558004230 con 0x7ff5640cbf50 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.329+0000 7ff569883640 1 -- 172.21.15.2:0/2499817176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5640b3960 con 0x7ff5640cbf50 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.329+0000 7ff54bfff640 1 -- 172.21.15.2:0/2499817176 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558015670 con 0x7ff5640cbf50 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.329+0000 7ff569883640 1 -- 172.21.15.2:0/2499817176 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5640b3f20 con 0x7ff5640cbf50 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.330+0000 7ff54bfff640 1 -- 172.21.15.2:0/2499817176 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5580157d0 con 0x7ff5640cbf50 2023-11-25T04:09:43.334 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.331+0000 7ff54bfff640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff55006ae40 0x7ff55006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.331+0000 7ff54bfff640 1 -- 172.21.15.2:0/2499817176 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5580898d0 con 0x7ff5640cbf50 2023-11-25T04:09:43.335 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.331+0000 7ff562ffd640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff55006ae40 0x7ff55006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.340 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.332+0000 7ff562ffd640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff55006ae40 0x7ff55006d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff554004bc0 tx=0x7ff554006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.332+0000 7ff56c41b740 1 Processor -- start 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.332+0000 7ff56c41b740 1 -- start start 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a52c50 0x557419a25bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a559e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a26130 0x557419a55f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff56c41b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574199e6980 con 0x557419a53030 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff56c41b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x557419998b90 con 0x557419a26130 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff56c41b740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x557419996280 con 0x557419a52c50 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55012/0 (socket says 172.21.15.2:55012) 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5627fc640 1 -- 172.21.15.2:0/1200430792 learned_addr learned my addr 172.21.15.2:0/1200430792 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:43.341 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5637fe640 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a26130 0x557419a55f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff562ffd640 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a52c50 0x557419a25bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5627fc640 1 -- 172.21.15.2:0/1200430792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a52c50 msgr2=0x557419a25bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5627fc640 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a52c50 0x557419a25bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5627fc640 1 -- 172.21.15.2:0/1200430792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a26130 msgr2=0x557419a55f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5627fc640 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a26130 0x557419a55f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5627fc640 1 -- 172.21.15.2:0/1200430792 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557419957500 con 0x557419a53030 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5637fe640 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a26130 0x557419a55f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5627fc640 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a559e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff558058460 tx=0x7ff558058c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f4a8eec92c31df server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.333+0000 7ff5497fa640 1 -- 172.21.15.2:0/1200430792 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558060860 con 0x557419a53030 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff5497fa640 1 -- 172.21.15.2:0/1200430792 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558056870 con 0x557419a53030 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff5497fa640 1 -- 172.21.15.2:0/1200430792 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580603d0 con 0x557419a53030 2023-11-25T04:09:43.342 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff56c41b740 1 -- 172.21.15.2:0/1200430792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 msgr2=0x557419a559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a559e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff558058460 tx=0x7ff558058c90 comp rx=0 tx=0).stop 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff56c41b740 1 -- 172.21.15.2:0/1200430792 shutdown_connections 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a26130 0x557419a55f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a559e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1200430792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a52c50 0x557419a25bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff56c41b740 1 -- 172.21.15.2:0/1200430792 >> 172.21.15.2:0/1200430792 conn(0x557419a27e60 msgr2=0x557419a709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff56c41b740 1 -- 172.21.15.2:0/1200430792 shutdown_connections 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.334+0000 7ff56c41b740 1 -- 172.21.15.2:0/1200430792 wait complete. 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.335+0000 7ff56c41b740 1 -- start start 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.335+0000 7ff56c41b740 1 Processor -- start 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a52c50 0x557419a43070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a81e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.343 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a54fd0 0x557419a81470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff56c41b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557419991b70 con 0x557419a53030 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff56c41b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x55741994be00 con 0x557419a52c50 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff56c41b740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x55741994baa0 con 0x557419a54fd0 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff56c41b740 10 client.0 _ll_register_callbacks cb 0x5574196a3ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a81e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5627fc640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a81e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55018/0 (socket says 172.21.15.2:55018) 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5627fc640 1 -- 172.21.15.2:0/3974537549 learned_addr learned my addr 172.21.15.2:0/3974537549 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff562ffd640 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a52c50 0x557419a43070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5637fe640 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a54fd0 0x557419a81470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5627fc640 1 -- 172.21.15.2:0/3974537549 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a54fd0 msgr2=0x557419a81470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5627fc640 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a54fd0 0x557419a81470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.344 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5627fc640 1 -- 172.21.15.2:0/3974537549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a52c50 msgr2=0x557419a43070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5627fc640 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a52c50 0x557419a43070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5627fc640 1 -- 172.21.15.2:0/3974537549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5640b3f20 con 0x557419a53030 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5627fc640 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a81e90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff558020040 tx=0x7ff55801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9d36004415519a server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5427fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5427fc640 1 -- 172.21.15.2:0/3974537549 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5580542c0 con 0x557419a53030 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff5427fc640 1 -- 172.21.15.2:0/3974537549 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff558054420 con 0x557419a53030 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.336+0000 7ff56c41b740 1 -- 172.21.15.2:0/3974537549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55741998ab50 con 0x557419a53030 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff5427fc640 1 -- 172.21.15.2:0/3974537549 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5580545e0 con 0x557419a53030 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff56c41b740 10 client.5400 fetch_fsmap learned FSMap version 15 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff56c41b740 1 -- 172.21.15.2:0/3974537549 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5574199901f0 con 0x557419a53030 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff5427fc640 1 -- 172.21.15.2:0/3974537549 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558064080 con 0x557419a53030 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff5427fc640 1 -- 172.21.15.2:0/3974537549 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff55806d070 con 0x557419a53030 2023-11-25T04:09:43.345 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff56c41b740 10 client.5400 fetch_fsmap finished waiting for FSMap version 15 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff56c41b740 10 client.5400 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff56c41b740 20 client.5400 populate_metadata read hostname 'smithi002' 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff56c41b740 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] conn(0x557419a67f60 0x557419a70c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff56c41b740 4 client.5400 mds_command: new command op to 5199 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff56c41b740 1 -- 172.21.15.2:0/3974537549 --> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55741998a870 con 0x557419a67f60 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff562ffd640 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] conn(0x557419a67f60 0x557419a70c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff562ffd640 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] conn(0x557419a67f60 0x557419a70c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46afa8d6d22de09b server_cookie=91162391c49c5e92 in_seq=0 out_seq=0 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.337+0000 7ff5427fc640 10 client.5400 ms_handle_connect on v2:172.21.15.2:6834/1180484123 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff5427fc640 1 -- 172.21.15.2:0/3974537549 <== mds.0 v2:172.21.15.2:6834/1180484123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55741998a870 con 0x557419a67f60 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff5427fc640 10 client.5400 handle_command_reply: tid=0 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 client.5400 shutdown 2023-11-25T04:09:43.346 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 -- 172.21.15.2:0/3974537549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 msgr2=0x557419a81e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a81e90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7ff558020040 tx=0x7ff55801e000 comp rx=0 tx=0).stop 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 -- 172.21.15.2:0/3974537549 shutdown_connections 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] conn(0x557419a67f60 0x557419a70c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a54fd0 0x557419a81470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a53030 0x557419a81e90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff5427fc640 0 client.5400 ms_handle_reset on v2:172.21.15.2:6834/1180484123 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 --2- 172.21.15.2:0/3974537549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a52c50 0x557419a43070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 -- 172.21.15.2:0/3974537549 >> 172.21.15.2:0/3974537549 conn(0x557419a26130 msgr2=0x557419a73ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 -- 172.21.15.2:0/3974537549 shutdown_connections 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 1 -- 172.21.15.2:0/3974537549 wait complete. 2023-11-25T04:09:43.347 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.338+0000 7ff56c41b740 20 client.5400 trim_cache size 0 max 16384 2023-11-25T04:09:43.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.354+0000 7ff56c41b740 1 Processor -- start 2023-11-25T04:09:43.355 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.354+0000 7ff56c41b740 1 -- start start 2023-11-25T04:09:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.355+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419a55e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.355+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a53030 0x557419a70e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.355+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a54fd0 0x557419a71370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.355+0000 7ff56c41b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557419a29b60 con 0x557419a52c50 2023-11-25T04:09:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.355+0000 7ff56c41b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x557419911270 con 0x557419a54fd0 2023-11-25T04:09:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.355+0000 7ff56c41b740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x557419a67950 con 0x557419a53030 2023-11-25T04:09:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.355+0000 7ff562ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419a55e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.357 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.355+0000 7ff562ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419a55e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55032/0 (socket says 172.21.15.2:55032) 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.355+0000 7ff562ffd640 1 -- 172.21.15.2:0/46357090 learned_addr learned my addr 172.21.15.2:0/46357090 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff562ffd640 1 -- 172.21.15.2:0/46357090 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a53030 msgr2=0x557419a70e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff562ffd640 1 --2- 172.21.15.2:0/46357090 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a53030 0x557419a70e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff562ffd640 1 -- 172.21.15.2:0/46357090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a54fd0 msgr2=0x557419a71370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff562ffd640 1 --2- 172.21.15.2:0/46357090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a54fd0 0x557419a71370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff562ffd640 1 -- 172.21.15.2:0/46357090 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55741992dd00 con 0x557419a52c50 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff562ffd640 1 --2- 172.21.15.2:0/46357090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419a55e30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff554002040 tx=0x7ff55400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1917c1ae692c633 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff549ffb640 1 -- 172.21.15.2:0/46357090 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554029070 con 0x557419a52c50 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff549ffb640 1 -- 172.21.15.2:0/46357090 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff554015800 con 0x557419a52c50 2023-11-25T04:09:43.358 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff549ffb640 1 -- 172.21.15.2:0/46357090 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554015990 con 0x557419a52c50 2023-11-25T04:09:43.362 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff56c41b740 1 -- 172.21.15.2:0/46357090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 msgr2=0x557419a55e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.356+0000 7ff56c41b740 1 --2- 172.21.15.2:0/46357090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419a55e30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7ff554002040 tx=0x7ff55400c000 comp rx=0 tx=0).stop 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.357+0000 7ff56c41b740 1 -- 172.21.15.2:0/46357090 shutdown_connections 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.357+0000 7ff56c41b740 1 --2- 172.21.15.2:0/46357090 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a54fd0 0x557419a71370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.357+0000 7ff56c41b740 1 --2- 172.21.15.2:0/46357090 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a53030 0x557419a70e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.357+0000 7ff56c41b740 1 --2- 172.21.15.2:0/46357090 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419a55e30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.357+0000 7ff56c41b740 1 -- 172.21.15.2:0/46357090 >> 172.21.15.2:0/46357090 conn(0x557419a26130 msgr2=0x557419a42e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.357+0000 7ff56c41b740 1 -- 172.21.15.2:0/46357090 shutdown_connections 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.357+0000 7ff56c41b740 1 -- 172.21.15.2:0/46357090 wait complete. 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.357+0000 7ff56c41b740 1 -- start start 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.357+0000 7ff56c41b740 1 Processor -- start 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419adaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.363 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a53030 0x557419adbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff56c41b740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a54fd0 0x557419a50d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff56c41b740 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x557419a53590 con 0x557419a52c50 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff56c41b740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x557419a51340 con 0x557419a54fd0 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff56c41b740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x557419a42780 con 0x557419a53030 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff56c41b740 10 client.0 _ll_register_callbacks cb 0x7ff558054890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff562ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419adaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff562ffd640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419adaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55038/0 (socket says 172.21.15.2:55038) 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff562ffd640 1 -- 172.21.15.2:0/1924768940 learned_addr learned my addr 172.21.15.2:0/1924768940 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff5637fe640 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a54fd0 0x557419a50d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff5627fc640 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a53030 0x557419adbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff562ffd640 1 -- 172.21.15.2:0/1924768940 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a53030 msgr2=0x557419adbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff562ffd640 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a53030 0x557419adbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.364 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff562ffd640 1 -- 172.21.15.2:0/1924768940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a54fd0 msgr2=0x557419a50d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff562ffd640 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a54fd0 0x557419a50d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.358+0000 7ff562ffd640 1 -- 172.21.15.2:0/1924768940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5640d1980 con 0x557419a52c50 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff562ffd640 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419adaed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff554009010 tx=0x7ff554001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627afc6c66b9e87a server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff5427fc640 10 client.0 ms_handle_connect on v2:172.21.15.2:3300/0 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff5427fc640 1 -- 172.21.15.2:0/1924768940 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554029070 con 0x557419a52c50 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff56c41b740 1 -- 172.21.15.2:0/1924768940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff558056870 con 0x557419a52c50 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff5427fc640 1 -- 172.21.15.2:0/1924768940 <== mon.0 v2:172.21.15.2:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff55401a040 con 0x557419a52c50 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff5427fc640 1 -- 172.21.15.2:0/1924768940 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff554016ea0 con 0x557419a52c50 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff56c41b740 10 client.5406 fetch_fsmap learned FSMap version 15 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff56c41b740 1 -- 172.21.15.2:0/1924768940 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,fsmap=15,monmap=2+}) v3 -- 0x5574199534f0 con 0x557419a52c50 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff5427fc640 1 -- 172.21.15.2:0/1924768940 <== mon.0 v2:172.21.15.2:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff558056870 con 0x557419a52c50 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff5427fc640 1 -- 172.21.15.2:0/1924768940 <== mon.0 v2:172.21.15.2:3300/0 5 ==== fsmap(e 15) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff554037430 con 0x557419a52c50 2023-11-25T04:09:43.365 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff56c41b740 10 client.5406 fetch_fsmap finished waiting for FSMap version 15 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff56c41b740 10 client.5406 resolve_mds: resolved name 'c' to daemon mds.c 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff56c41b740 20 client.5406 populate_metadata read hostname 'smithi002' 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] conn(0x557419a70fb0 0x557419a71390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff56c41b740 4 client.5406 mds_command: new command op to 5199 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff56c41b740 1 -- 172.21.15.2:0/1924768940 --> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5574196926c0 con 0x557419a70fb0 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.359+0000 7ff5627fc640 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] conn(0x557419a70fb0 0x557419a71390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff5427fc640 10 client.5406 ms_handle_connect on v2:172.21.15.2:6834/1180484123 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff5627fc640 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] conn(0x557419a70fb0 0x557419a71390 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e7e92d8d5bc4121 server_cookie=92be7fc9e678f8c in_seq=0 out_seq=0 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff5427fc640 1 -- 172.21.15.2:0/1924768940 <== mds.0 v2:172.21.15.2:6834/1180484123 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5574196926c0 con 0x557419a70fb0 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff5427fc640 10 client.5406 handle_command_reply: tid=0 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 client.5406 shutdown 2023-11-25T04:09:43.366 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 -- 172.21.15.2:0/1924768940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 msgr2=0x557419adaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419adaed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff554009010 tx=0x7ff554001d80 comp rx=0 tx=0).stop 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 -- 172.21.15.2:0/1924768940 shutdown_connections 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.2:6834/1180484123,v1:172.21.15.2:6836/1180484123] conn(0x557419a70fb0 0x557419a71390 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x557419a54fd0 0x557419a50d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x557419a53030 0x557419adbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff5427fc640 0 client.5406 ms_handle_reset on v2:172.21.15.2:6834/1180484123 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 --2- 172.21.15.2:0/1924768940 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x557419a52c50 0x557419adaed0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 -- 172.21.15.2:0/1924768940 >> 172.21.15.2:0/1924768940 conn(0x557419a26130 msgr2=0x557419a68560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 -- 172.21.15.2:0/1924768940 shutdown_connections 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 1 -- 172.21.15.2:0/1924768940 wait complete. 2023-11-25T04:09:43.367 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.360+0000 7ff56c41b740 20 client.5406 trim_cache size 0 max 16384 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "cluster_fsid": "490edb11-4d53-4272-8bbb-d46dd29c1240", 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "whoami": 0, 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5199, 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "want_state": "up:active", 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "state": "up:active", 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs", 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "rank_uptime": 9.1745035730000009, 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "mdsmap_epoch": 15, 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch": 33, 2023-11-25T04:09:43.368 INFO:teuthology.orchestra.run.smithi002.stdout: "osdmap_epoch_barrier": 33, 2023-11-25T04:09:43.369 INFO:teuthology.orchestra.run.smithi002.stdout: "uptime": 16.046283032000002 2023-11-25T04:09:43.369 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-25T04:09:43.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 -- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff55006ae40 msgr2=0x7ff55006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.369 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff55006ae40 0x7ff55006d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff554004bc0 tx=0x7ff554006040 comp rx=0 tx=0).stop 2023-11-25T04:09:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 -- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5640cbf50 msgr2=0x7ff5640b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5640cbf50 0x7ff5640b2a70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff5580115b0 tx=0x7ff558011a70 comp rx=0 tx=0).stop 2023-11-25T04:09:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 -- 172.21.15.2:0/2499817176 shutdown_connections 2023-11-25T04:09:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7ff55006ae40 0x7ff55006d300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5640b2fb0 0x7ff5640ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7ff5640cbf50 0x7ff5640b2a70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 --2- 172.21.15.2:0/2499817176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5641f6220 0x7ff5640cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 -- 172.21.15.2:0/2499817176 >> 172.21.15.2:0/2499817176 conn(0x7ff56409c500 msgr2=0x7ff5640d3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:43.370 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 -- 172.21.15.2:0/2499817176 shutdown_connections 2023-11-25T04:09:43.371 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.361+0000 7ff569883640 1 -- 172.21.15.2:0/2499817176 wait complete. 2023-11-25T04:09:43.373 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-25T04:09:43.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.478+0000 7fbfce3ea640 1 Processor -- start 2023-11-25T04:09:43.479 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.478+0000 7fbfce3ea640 1 -- start start 2023-11-25T04:09:43.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfce3ea640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfc815bf60 0x7fbfc8166040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfce3ea640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc806de80 con 0x7fbfc80b4810 2023-11-25T04:09:43.480 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfce3ea640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc815c360 con 0x7fbfc813e2d0 2023-11-25T04:09:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfce3ea640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc815fc60 con 0x7fbfc815bf60 2023-11-25T04:09:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfcc987640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7fbfc815bf60 0x7fbfc8166040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfc77fe640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fbfc80b4810 0x7fbfc815b850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:35450/0 (socket says 172.21.15.2:35450) 2023-11-25T04:09:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfc77fe640 1 -- 172.21.15.2:0/1186670990 learned_addr learned my addr 172.21.15.2:0/1186670990 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:09:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfcc987640 1 -- 172.21.15.2:0/1186670990 >> v1:172.21.15.66:6789/0 conn(0x7fbfc813e2d0 legacy=0x7fbfc80b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:09:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfcc987640 1 -- 172.21.15.2:0/1186670990 >> v1:172.21.15.2:6789/0 conn(0x7fbfc80b4810 legacy=0x7fbfc815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfc6ffd640 1 -- 172.21.15.2:0/1186670990 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471908613 0 0) 0x7fbfc806de80 con 0x7fbfc80b4810 2023-11-25T04:09:43.481 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.479+0000 7fbfcc987640 1 -- 172.21.15.2:0/1186670990 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc806d5c0 con 0x7fbfc815bf60 2023-11-25T04:09:43.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.480+0000 7fbfcc987640 1 --2- 172.21.15.2:0/1186670990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc815bf60 0x7fbfc8166040 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009d90 tx=0x7fbfc002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d214a16d4c6c8c server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.480+0000 7fbfc6ffd640 1 -- 172.21.15.2:0/1186670990 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc002cc60 con 0x7fbfc815bf60 2023-11-25T04:09:43.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.480+0000 7fbfc6ffd640 1 -- 172.21.15.2:0/1186670990 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc002cdc0 con 0x7fbfc815bf60 2023-11-25T04:09:43.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.480+0000 7fbfc6ffd640 1 -- 172.21.15.2:0/1186670990 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc0034660 con 0x7fbfc815bf60 2023-11-25T04:09:43.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.481+0000 7fbfce3ea640 1 -- 172.21.15.2:0/1186670990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc815bf60 msgr2=0x7fbfc8166040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.481+0000 7fbfce3ea640 1 --2- 172.21.15.2:0/1186670990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc815bf60 0x7fbfc8166040 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009d90 tx=0x7fbfc002beb0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.481+0000 7fbfce3ea640 1 -- 172.21.15.2:0/1186670990 shutdown_connections 2023-11-25T04:09:43.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.481+0000 7fbfce3ea640 1 --2- 172.21.15.2:0/1186670990 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc815bf60 0x7fbfc8166040 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.483 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.481+0000 7fbfce3ea640 1 -- 172.21.15.2:0/1186670990 >> 172.21.15.2:0/1186670990 conn(0x7fbfc80b0af0 msgr2=0x7fbfc80b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:43.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.481+0000 7fbfce3ea640 1 -- 172.21.15.2:0/1186670990 shutdown_connections 2023-11-25T04:09:43.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.481+0000 7fbfce3ea640 1 -- 172.21.15.2:0/1186670990 wait complete. 2023-11-25T04:09:43.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.482+0000 7fbfce3ea640 1 Processor -- start 2023-11-25T04:09:43.484 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.482+0000 7fbfce3ea640 1 -- start start 2023-11-25T04:09:43.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfce3ea640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfc80b4810 0x7fbfc81f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.487 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfce3ea640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc813e2d0 0x7fbfc80aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfce3ea640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbfc815bf60 0x7fbfc80af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfce3ea640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc812c420 con 0x7fbfc813e2d0 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfce3ea640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc812c700 con 0x7fbfc80b4810 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfce3ea640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc812c9e0 con 0x7fbfc815bf60 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc813e2d0 0x7fbfc80aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc77fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc813e2d0 0x7fbfc80aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:55044/0 (socket says 172.21.15.2:55044) 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc77fe640 1 -- 172.21.15.2:0/3112158639 learned_addr learned my addr 172.21.15.2:0/3112158639 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc7fff640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfc80b4810 0x7fbfc81f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfcc987640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbfc815bf60 0x7fbfc80af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc77fe640 1 -- 172.21.15.2:0/3112158639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbfc815bf60 msgr2=0x7fbfc80af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc77fe640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbfc815bf60 0x7fbfc80af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.488 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc77fe640 1 -- 172.21.15.2:0/3112158639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfc80b4810 msgr2=0x7fbfc81f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc77fe640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfc80b4810 0x7fbfc81f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc77fe640 1 -- 172.21.15.2:0/3112158639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc0009a70 con 0x7fbfc813e2d0 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.483+0000 7fbfc7fff640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfc80b4810 0x7fbfc81f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.484+0000 7fbfc77fe640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc813e2d0 0x7fbfc80aefc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800c430 tx=0x7fbfb800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.484+0000 7fbfc4ff9640 1 -- 172.21.15.2:0/3112158639 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb80074e0 con 0x7fbfc813e2d0 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.484+0000 7fbfc4ff9640 1 -- 172.21.15.2:0/3112158639 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb8007660 con 0x7fbfc813e2d0 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.484+0000 7fbfc4ff9640 1 -- 172.21.15.2:0/3112158639 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb8004a20 con 0x7fbfc813e2d0 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.484+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc812ccc0 con 0x7fbfc813e2d0 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.484+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc8158270 con 0x7fbfc813e2d0 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.485+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc812d1e0 con 0x7fbfc813e2d0 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.485+0000 7fbfc4ff9640 1 -- 172.21.15.2:0/3112158639 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfb8004b80 con 0x7fbfc813e2d0 2023-11-25T04:09:43.489 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.485+0000 7fbfc4ff9640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbfa806ae40 0x7fbfa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:09:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.486+0000 7fbfc4ff9640 1 -- 172.21.15.2:0/3112158639 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfb8089360 con 0x7fbfc813e2d0 2023-11-25T04:09:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.486+0000 7fbfc7fff640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbfa806ae40 0x7fbfa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:09:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.486+0000 7fbfc7fff640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbfa806ae40 0x7fbfa806d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0004320 tx=0x7fbfb0007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:09:43.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.490+0000 7fbfc4ff9640 1 -- 172.21.15.2:0/3112158639 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbfc812d1e0 con 0x7fbfc813e2d0 2023-11-25T04:09:43.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.703+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbfc812d1e0 con 0x7fbfc813e2d0 2023-11-25T04:09:43.704 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.703+0000 7fbfc4ff9640 1 -- 172.21.15.2:0/3112158639 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v15) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbfc812d1e0 con 0x7fbfc813e2d0 2023-11-25T04:09:43.704 INFO:teuthology.orchestra.run.smithi002.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbfa806ae40 msgr2=0x7fbfa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbfa806ae40 0x7fbfa806d300 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0004320 tx=0x7fbfb0007e30 comp rx=0 tx=0).stop 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc813e2d0 msgr2=0x7fbfc80aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc813e2d0 0x7fbfc80aefc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbfb800c430 tx=0x7fbfb800c8f0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 shutdown_connections 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbfc815bf60 0x7fbfc80af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fbfc813e2d0 0x7fbfc80aefc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fbfa806ae40 0x7fbfa806d300 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 --2- 172.21.15.2:0/3112158639 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbfc80b4810 0x7fbfc81f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 >> 172.21.15.2:0/3112158639 conn(0x7fbfc80b0af0 msgr2=0x7fbfc80afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:09:43.707 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 shutdown_connections 2023-11-25T04:09:43.708 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:43.705+0000 7fbfce3ea640 1 -- 172.21.15.2:0/3112158639 wait complete. 2023-11-25T04:09:43.719 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-25T04:09:43.719 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-25T04:09:43.720 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi002.front.sepia.ceph.com 2023-11-25T04:09:43.721 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-25T04:09:43.722 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-25T04:09:43.722 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-25T04:09:43.723 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-25T04:09:43.723 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-25T04:09:43.724 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-25T04:09:43.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:43.725 DEBUG:teuthology.orchestra.run.smithi002:> ip addr 2023-11-25T04:09:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-25T04:09:43.746 INFO:teuthology.orchestra.run.smithi002.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-25T04:09:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: inet 127.0.0.1/8 scope host lo 2023-11-25T04:09:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:09:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 ::1/128 scope host 2023-11-25T04:09:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:09:43.747 INFO:teuthology.orchestra.run.smithi002.stdout:2: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-25T04:09:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:20 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:09:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f0 2023-11-25T04:09:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: inet 172.21.15.2/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-11-25T04:09:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft 42569sec preferred_lft 42569sec 2023-11-25T04:09:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::ec4:7aff:febd:1920/64 scope link noprefixroute 2023-11-25T04:09:43.748 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:09:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:3: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:09:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:02 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:09:43.749 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f0 2023-11-25T04:09:43.749 INFO:teuthology.orchestra.run.smithi002.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:09:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:6b:fe:03 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:09:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp7s0f1 2023-11-25T04:09:43.750 INFO:teuthology.orchestra.run.smithi002.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-25T04:09:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 0c:c4:7a:bd:19:21 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:09:43.750 INFO:teuthology.orchestra.run.smithi002.stdout: altname enp1s0f1 2023-11-25T04:09:43.751 INFO:teuthology.orchestra.run.smithi002.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-25T04:09:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 22:a6:ce:25:8c:05 brd ff:ff:ff:ff:ff:ff 2023-11-25T04:09:43.751 INFO:teuthology.orchestra.run.smithi002.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-25T04:09:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:09:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::4c59:a5ff:fe3e:2425/64 scope link 2023-11-25T04:09:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:09:43.752 INFO:teuthology.orchestra.run.smithi002.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-25T04:09:43.752 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether e2:74:e3:b4:5a:1a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:09:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::e074:e3ff:feb4:5a1a/64 scope link 2023-11-25T04:09:43.753 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:09:43.754 INFO:teuthology.orchestra.run.smithi002.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-25T04:09:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: link/ether 22:a6:ce:25:8c:05 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:09:43.754 INFO:teuthology.orchestra.run.smithi002.stdout: inet6 fe80::20a6:ceff:fe25:8c05/64 scope link 2023-11-25T04:09:43.755 INFO:teuthology.orchestra.run.smithi002.stdout: valid_lft forever preferred_lft forever 2023-11-25T04:09:43.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:43.755 DEBUG:teuthology.orchestra.run.smithi002:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-25T04:09:43.815 INFO:teuthology.orchestra.run.smithi002.stdout:1 2023-11-25T04:09:43.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:43.817 DEBUG:teuthology.orchestra.run.smithi002:> route 2023-11-25T04:09:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:Kernel IP routing table 2023-11-25T04:09:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-25T04:09:43.875 INFO:teuthology.orchestra.run.smithi002.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-11-25T04:09:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-11-25T04:09:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-25T04:09:43.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:43.876 DEBUG:teuthology.orchestra.run.smithi002:> (cd / && exec bash -c ' 2023-11-25T04:09:43.876 DEBUG:teuthology.orchestra.run.smithi002:> set -e 2023-11-25T04:09:43.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-25T04:09:43.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-25T04:09:43.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-25T04:09:43.876 DEBUG:teuthology.orchestra.run.smithi002:> ') 2023-11-25T04:09:43.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:43.982 DEBUG:teuthology.orchestra.run.smithi002:> ip netns list 2023-11-25T04:09:43.998 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-25T04:09:43.999 INFO:teuthology.orchestra.run.smithi002.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-25T04:09:43.999 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-25T04:09:43.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:43.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo ip link set brx.0 up 2023-11-25T04:09:44.070 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-11-25T04:09:44.070 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:09:44.070 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-25T04:09:44.125 INFO:teuthology.orchestra.run.smithi002.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-25T04:09:44.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-25T04:09:44.125 DEBUG:teuthology.orchestra.run.smithi002:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-25T04:09:44.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2023-11-25T04:09:44.251 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-25T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-25T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-25T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-25T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-25T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-25T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-25T04:09:44.308 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:09:44.309 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:09:44.310 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:09:44.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:44.311 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-25T04:09:44.363 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-11-25T04:09:44.363 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-11-25T04:09:44.405 DEBUG:teuthology.orchestra.run.smithi002:> sudo modprobe fuse 2023-11-25T04:09:44.438 DEBUG:teuthology.orchestra.run.smithi002:> cat /proc/self/mounts | awk '{print $2}' 2023-11-25T04:09:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:/proc 2023-11-25T04:09:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:/sys 2023-11-25T04:09:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:/dev 2023-11-25T04:09:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/security 2023-11-25T04:09:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/shm 2023-11-25T04:09:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/pts 2023-11-25T04:09:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:/run 2023-11-25T04:09:44.495 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/cgroup 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/pstore 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/bpf 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/ 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/selinux 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/proc/sys/fs/binfmt_misc 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/hugepages 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/dev/mqueue 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/debug 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/tracing 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/fs/fuse/connections 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/sys/kernel/config 2023-11-25T04:09:44.496 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-sysctl.service 2023-11-25T04:09:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-11-25T04:09:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-11-25T04:09:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/nfs/rpc_pipefs 2023-11-25T04:09:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:/run/user/1000 2023-11-25T04:09:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph 2023-11-25T04:09:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-0 2023-11-25T04:09:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-1 2023-11-25T04:09:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-2 2023-11-25T04:09:44.497 INFO:teuthology.orchestra.run.smithi002.stdout:/var/lib/ceph/osd/ceph-3 2023-11-25T04:09:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns 2023-11-25T04:09:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:09:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-25T04:09:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:09:44.498 INFO:teuthology.orchestra.run.smithi002.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-25T04:09:44.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:44.498 DEBUG:teuthology.orchestra.run.smithi002:> ls /sys/fs/fuse/connections 2023-11-25T04:09:44.499 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:2023-11-25T04:09:44.498+0000 7fa716dd9480 -1 init, newargv = 0x55dd8925e480 newargc=15 2023-11-25T04:09:44.499 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[103094]: starting ceph client 2023-11-25T04:09:44.503 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[103094]: starting fuse 2023-11-25T04:09:44.515 INFO:teuthology.orchestra.run.smithi002.stdout:43 2023-11-25T04:09:44.516 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo stdin-killer -- python3 -c ' 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> import glob 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> import re 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> import os 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> import subprocess 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> def _find_admin_socket(client_name): 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> files = glob.glob(asok_path) 2023-11-25T04:09:44.516 DEBUG:teuthology.orchestra.run.smithi002:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> # Given a non-glob path, it better be there 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> if "*" not in asok_path: 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> assert(len(files) == 1) 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> return files[0] 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> for f in files: 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> if os.path.exists("/proc/{0}".format(pid)): 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> contents = proc_f.read() 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> if mountpoint in contents: 2023-11-25T04:09:44.517 DEBUG:teuthology.orchestra.run.smithi002:> return f 2023-11-25T04:09:44.518 DEBUG:teuthology.orchestra.run.smithi002:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-11-25T04:09:44.518 DEBUG:teuthology.orchestra.run.smithi002:> 2023-11-25T04:09:44.520 DEBUG:teuthology.orchestra.run.smithi002:> print(_find_admin_socket("client.0")) 2023-11-25T04:09:44.520 DEBUG:teuthology.orchestra.run.smithi002:> ' 2023-11-25T04:09:44.641 INFO:teuthology.orchestra.run.smithi002.stdout:/var/run/ceph/ceph-client.0.103094.asok 2023-11-25T04:09:44.646 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:09:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-11-25T04:09:44.651 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.103094.asok 2023-11-25T04:09:44.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:44.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.103094.asok status 2023-11-25T04:09:44.794 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2023-11-25T04:09:44.794 INFO:teuthology.orchestra.run.smithi002.stdout: "metadata": { 2023-11-25T04:09:44.794 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_sha1": "ec928368edcc5fc71884a56fd9fd821b148f4e30", 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "ceph_version": "ceph version 18.0.0-7506-gec928368 (ec928368edcc5fc71884a56fd9fd821b148f4e30) reef (dev)", 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "entity_id": "0", 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "hostname": "smithi002", 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "pid": "103094", 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "root": "/" 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_count": 0, 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "dentry_pinned_count": 0, 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "id": 5421, 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "inst": { 2023-11-25T04:09:44.795 INFO:teuthology.orchestra.run.smithi002.stdout: "name": { 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "client", 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: "num": 5421 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3666556 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: } 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": { 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "v1", 2023-11-25T04:09:44.796 INFO:teuthology.orchestra.run.smithi002.stdout: "addr": "192.168.0.1:0", 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: "nonce": 3666556 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: "inst_str": "client.5421 192.168.0.1:0/3666556", 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: "addr_str": "192.168.0.1:0/3666556", 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: "inode_count": 1, 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: "mds_epoch": 15, 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch": 33, 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: "osd_epoch_barrier": 0, 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: "blocklisted": false, 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout: "fs_name": "cephfs" 2023-11-25T04:09:44.797 INFO:teuthology.orchestra.run.smithi002.stdout:} 2023-11-25T04:09:44.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:44.803 DEBUG:teuthology.orchestra.run.smithi002:> stat --file-system '--printf=%T 2023-11-25T04:09:44.803 DEBUG:teuthology.orchestra.run.smithi002:> ' -- /home/ubuntu/cephtest/mnt.0 2023-11-25T04:09:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:fuseblk 2023-11-25T04:09:44.819 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-11-25T04:09:44.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:44.819 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-25T04:09:44.890 DEBUG:teuthology.orchestra.run.smithi002:> mktemp -d --suffix=xfstests-dev 2023-11-25T04:09:44.946 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.qL1lhbO0Esxfstests-dev 2023-11-25T04:09:44.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:44.947 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.qL1lhbO0Esxfstests-dev) 2023-11-25T04:09:45.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:45.020 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.qL1lhbO0Esxfstests-dev) 2023-11-25T04:09:45.080 INFO:teuthology.orchestra.run.smithi002.stderr:Cloning into '/tmp/tmp.qL1lhbO0Esxfstests-dev'... 2023-11-25T04:09:45.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:45.866 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-25T04:09:45.928 DEBUG:teuthology.orchestra.run.smithi002:> mktemp -d --suffix=test 2023-11-25T04:09:45.983 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.VDcWebYyYttest 2023-11-25T04:09:45.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:09:45.984 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-25T04:09:46.042 DEBUG:teuthology.orchestra.run.smithi002:> mktemp -d --suffix=scratch 2023-11-25T04:09:46.097 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.N6UMeiekqcscratch 2023-11-25T04:09:46.097 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-11-25T04:09:46.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2023-11-25T04:09:46.748 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:03:30 ago on Sat 25 Nov 2023 04:06:16 AM UTC. 2023-11-25T04:09:46.848 INFO:teuthology.orchestra.run.smithi002.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-11-25T04:09:46.849 INFO:teuthology.orchestra.run.smithi002.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-11-25T04:09:46.850 INFO:teuthology.orchestra.run.smithi002.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-11-25T04:09:46.851 INFO:teuthology.orchestra.run.smithi002.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-11-25T04:09:46.852 INFO:teuthology.orchestra.run.smithi002.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-11-25T04:09:46.853 INFO:teuthology.orchestra.run.smithi002.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-11-25T04:09:46.855 INFO:teuthology.orchestra.run.smithi002.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-11-25T04:09:46.856 INFO:teuthology.orchestra.run.smithi002.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-11-25T04:09:46.858 INFO:teuthology.orchestra.run.smithi002.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2023-11-25T04:09:46.860 INFO:teuthology.orchestra.run.smithi002.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-11-25T04:09:46.861 INFO:teuthology.orchestra.run.smithi002.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-11-25T04:09:46.863 INFO:teuthology.orchestra.run.smithi002.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-11-25T04:09:46.863 INFO:teuthology.orchestra.run.smithi002.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-11-25T04:09:46.864 INFO:teuthology.orchestra.run.smithi002.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-11-25T04:09:46.865 INFO:teuthology.orchestra.run.smithi002.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-11-25T04:09:46.866 INFO:teuthology.orchestra.run.smithi002.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-11-25T04:09:46.867 INFO:teuthology.orchestra.run.smithi002.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-11-25T04:09:46.868 INFO:teuthology.orchestra.run.smithi002.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-11-25T04:09:46.869 INFO:teuthology.orchestra.run.smithi002.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-11-25T04:09:46.872 INFO:teuthology.orchestra.run.smithi002.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-11-25T04:09:46.933 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2023-11-25T04:09:46.936 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-11-25T04:09:46.936 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2023-11-25T04:09:46.936 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-11-25T04:09:46.937 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2023-11-25T04:09:46.937 INFO:teuthology.orchestra.run.smithi002.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-11-25T04:09:46.937 INFO:teuthology.orchestra.run.smithi002.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-11-25T04:09:46.937 INFO:teuthology.orchestra.run.smithi002.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2023-11-25T04:09:46.937 INFO:teuthology.orchestra.run.smithi002.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-11-25T04:09:46.938 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-devel x86_64 5.14.0-386.el9 appstream 21 M 2023-11-25T04:09:46.938 INFO:teuthology.orchestra.run.smithi002.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2023-11-25T04:09:46.938 INFO:teuthology.orchestra.run.smithi002.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-11-25T04:09:46.938 INFO:teuthology.orchestra.run.smithi002.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2023-11-25T04:09:46.938 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2023-11-25T04:09:46.939 INFO:teuthology.orchestra.run.smithi002.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-11-25T04:09:46.939 INFO:teuthology.orchestra.run.smithi002.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-11-25T04:09:46.939 INFO:teuthology.orchestra.run.smithi002.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-11-25T04:09:46.939 INFO:teuthology.orchestra.run.smithi002.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-11-25T04:09:46.940 INFO:teuthology.orchestra.run.smithi002.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-11-25T04:09:46.940 INFO:teuthology.orchestra.run.smithi002.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-11-25T04:09:46.940 INFO:teuthology.orchestra.run.smithi002.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-11-25T04:09:46.940 INFO:teuthology.orchestra.run.smithi002.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-11-25T04:09:46.940 INFO:teuthology.orchestra.run.smithi002.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-11-25T04:09:46.940 INFO:teuthology.orchestra.run.smithi002.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-11-25T04:09:46.941 INFO:teuthology.orchestra.run.smithi002.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-11-25T04:09:46.941 INFO:teuthology.orchestra.run.smithi002.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-11-25T04:09:46.941 INFO:teuthology.orchestra.run.smithi002.stdout: python-unversioned-command noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-11-25T04:09:46.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-11-25T04:09:46.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-11-25T04:09:46.941 INFO:teuthology.orchestra.run.smithi002.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-11-25T04:09:46.942 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2023-11-25T04:09:46.942 INFO:teuthology.orchestra.run.smithi002.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2023-11-25T04:09:46.942 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd x86_64 1.18.1-2.el9 CentOS-AppStream 164 k 2023-11-25T04:09:46.942 INFO:teuthology.orchestra.run.smithi002.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-11-25T04:09:46.942 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2023-11-25T04:09:46.942 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-11-25T04:09:46.942 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-11-25T04:09:46.943 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-11-25T04:09:46.943 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-11-25T04:09:46.943 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-11-25T04:09:46.943 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-11-25T04:09:46.943 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:46.943 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2023-11-25T04:09:46.943 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2023-11-25T04:09:46.943 INFO:teuthology.orchestra.run.smithi002.stdout:Install 17 Packages 2023-11-25T04:09:46.943 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 16 Packages 2023-11-25T04:09:46.944 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:09:46.944 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 96 M 2023-11-25T04:09:46.944 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2023-11-25T04:09:47.450 INFO:teuthology.orchestra.run.smithi002.stdout:(1/33): fio-engine-libaio-3.35-1.el9.x86_64.rpm 108 kB/s | 14 kB 00:00 2023-11-25T04:09:47.475 INFO:teuthology.orchestra.run.smithi002.stdout:(2/33): fio-engine-http-3.35-1.el9.x86_64.rpm 107 kB/s | 17 kB 00:00 2023-11-25T04:09:47.551 INFO:teuthology.orchestra.run.smithi002.stdout:(3/33): fio-engine-nbd-3.35-1.el9.x86_64.rpm 135 kB/s | 13 kB 00:00 2023-11-25T04:09:47.576 INFO:teuthology.orchestra.run.smithi002.stdout:(4/33): fio-engine-rados-3.35-1.el9.x86_64.rpm 146 kB/s | 15 kB 00:00 2023-11-25T04:09:47.609 INFO:teuthology.orchestra.run.smithi002.stdout:(5/33): fio-engine-rbd-3.35-1.el9.x86_64.rpm 259 kB/s | 15 kB 00:00 2023-11-25T04:09:47.693 INFO:teuthology.orchestra.run.smithi002.stdout:(6/33): fio-3.35-1.el9.x86_64.rpm 17 MB/s | 6.2 MB 00:00 2023-11-25T04:09:47.710 INFO:teuthology.orchestra.run.smithi002.stdout:(7/33): fio-engine-rdma-3.35-1.el9.x86_64.rpm 148 kB/s | 20 kB 00:00 2023-11-25T04:09:47.727 INFO:teuthology.orchestra.run.smithi002.stdout:(8/33): libcap-devel-2.48-9.el9.x86_64.rpm 285 kB/s | 33 kB 00:00 2023-11-25T04:09:47.752 INFO:teuthology.orchestra.run.smithi002.stdout:(9/33): libnbd-1.18.1-2.el9.x86_64.rpm 3.9 MB/s | 164 kB 00:00 2023-11-25T04:09:47.785 INFO:teuthology.orchestra.run.smithi002.stdout:(10/33): sqlite-3.34.1-6.el9.x86_64.rpm 9.7 MB/s | 747 kB 00:00 2023-11-25T04:09:47.811 INFO:teuthology.orchestra.run.smithi002.stdout:(11/33): udftools-2.2-5.el9.x86_64.rpm 1.7 MB/s | 144 kB 00:00 2023-11-25T04:09:47.836 INFO:teuthology.orchestra.run.smithi002.stdout:(12/33): rmt-1.6-6.el9.x86_64.rpm 545 kB/s | 45 kB 00:00 2023-11-25T04:09:47.953 INFO:teuthology.orchestra.run.smithi002.stdout:(13/33): gdbm-devel-1.19-4.el9.x86_64.rpm 502 kB/s | 59 kB 00:00 2023-11-25T04:09:48.011 INFO:teuthology.orchestra.run.smithi002.stdout:(14/33): gdbm-1.19-4.el9.x86_64.rpm 755 kB/s | 132 kB 00:00 2023-11-25T04:09:48.303 INFO:teuthology.orchestra.run.smithi002.stdout:(15/33): dump-0.4-0.51.b47.el9.x86_64.rpm 251 kB/s | 88 kB 00:00 2023-11-25T04:09:48.404 INFO:teuthology.orchestra.run.smithi002.stdout:(16/33): indent-2.2.13-4.el9.x86_64.rpm 489 kB/s | 179 kB 00:00 2023-11-25T04:09:48.579 INFO:teuthology.orchestra.run.smithi002.stdout:(17/33): cpp-11.4.1-2.3.el9.x86_64.rpm 39 MB/s | 11 MB 00:00 2023-11-25T04:09:49.263 INFO:teuthology.orchestra.run.smithi002.stdout:(18/33): gcc-11.4.1-2.3.el9.x86_64.rpm 38 MB/s | 32 MB 00:00 2023-11-25T04:09:49.455 INFO:teuthology.orchestra.run.smithi002.stdout:(19/33): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 15 MB/s | 13 MB 00:00 2023-11-25T04:09:49.480 INFO:teuthology.orchestra.run.smithi002.stdout:(20/33): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 218 kB/s | 47 kB 00:00 2023-11-25T04:09:49.539 INFO:teuthology.orchestra.run.smithi002.stdout:(21/33): libstdc++-devel-11.4.1-2.3.el9.x86_64. 27 MB/s | 2.2 MB 00:00 2023-11-25T04:09:49.564 INFO:teuthology.orchestra.run.smithi002.stdout:(22/33): python-unversioned-command-3.9.18-1.el 108 kB/s | 8.8 kB 00:00 2023-11-25T04:09:49.589 INFO:teuthology.orchestra.run.smithi002.stdout:(23/33): python3-devel-3.9.18-1.el9.x86_64.rpm 4.0 MB/s | 204 kB 00:00 2023-11-25T04:09:49.631 INFO:teuthology.orchestra.run.smithi002.stdout:(24/33): e2fsprogs-1.46.5-4.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2023-11-25T04:09:49.656 INFO:teuthology.orchestra.run.smithi002.stdout:(25/33): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2023-11-25T04:09:49.682 INFO:teuthology.orchestra.run.smithi002.stdout:(26/33): libcom_err-1.46.5-4.el9.x86_64.rpm 505 kB/s | 25 kB 00:00 2023-11-25T04:09:49.707 INFO:teuthology.orchestra.run.smithi002.stdout:(27/33): libgcc-11.4.1-2.3.el9.x86_64.rpm 1.8 MB/s | 92 kB 00:00 2023-11-25T04:09:49.732 INFO:teuthology.orchestra.run.smithi002.stdout:(28/33): libgomp-11.4.1-2.3.el9.x86_64.rpm 5.2 MB/s | 268 kB 00:00 2023-11-25T04:09:49.758 INFO:teuthology.orchestra.run.smithi002.stdout:(29/33): libss-1.46.5-4.el9.x86_64.rpm 616 kB/s | 31 kB 00:00 2023-11-25T04:09:49.783 INFO:teuthology.orchestra.run.smithi002.stdout:(30/33): libstdc++-11.4.1-2.3.el9.x86_64.rpm 14 MB/s | 735 kB 00:00 2023-11-25T04:09:49.808 INFO:teuthology.orchestra.run.smithi002.stdout:(31/33): python3-3.9.18-1.el9.x86_64.rpm 522 kB/s | 26 kB 00:00 2023-11-25T04:09:49.975 INFO:teuthology.orchestra.run.smithi002.stdout:(32/33): python3-libs-3.9.18-1.el9.x86_64.rpm 38 MB/s | 7.3 MB 00:00 2023-11-25T04:09:50.277 INFO:teuthology.orchestra.run.smithi002.stdout:(33/33): kernel-devel-5.14.0-386.el9.x86_64.rpm 8.4 MB/s | 21 MB 00:02 2023-11-25T04:09:50.279 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2023-11-25T04:09:50.279 INFO:teuthology.orchestra.run.smithi002.stdout:Total 29 MB/s | 96 MB 00:03 2023-11-25T04:09:50.498 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2023-11-25T04:09:50.778 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2023-11-25T04:09:50.778 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2023-11-25T04:09:51.943 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2023-11-25T04:09:51.943 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2023-11-25T04:09:54.102 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2023-11-25T04:09:54.180 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/49 2023-11-25T04:09:54.218 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-11-25T04:09:54.308 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-11-25T04:09:54.359 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/49 2023-11-25T04:09:54.927 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/49 2023-11-25T04:09:55.015 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/49 2023-11-25T04:09:56.324 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/49 2023-11-25T04:09:56.421 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/49 2023-11-25T04:09:56.459 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/49 2023-11-25T04:09:56.490 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/49 2023-11-25T04:09:56.876 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/49 2023-11-25T04:09:57.816 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/49 2023-11-25T04:09:58.083 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/49 2023-11-25T04:09:58.125 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/49 2023-11-25T04:09:58.162 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 13/49 2023-11-25T04:09:58.199 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rmt-2:1.6-6.el9.x86_64 14/49 2023-11-25T04:09:58.226 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libnbd-1.18.1-2.el9.x86_64 15/49 2023-11-25T04:09:58.252 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 16/49 2023-11-25T04:09:58.286 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 17/49 2023-11-25T04:09:58.319 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 18/49 2023-11-25T04:09:58.344 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 19/49 2023-11-25T04:09:58.370 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 20/49 2023-11-25T04:09:58.531 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 21/49 2023-11-25T04:09:58.569 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fio-3.35-1.el9.x86_64 22/49 2023-11-25T04:09:58.599 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 23/49 2023-11-25T04:10:06.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:10:06.600 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:10:08.437 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 24/49 2023-11-25T04:10:08.638 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-devel-5.14.0-386.el9.x86_64 25/49 2023-11-25T04:10:19.527 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-devel-5.14.0-386.el9.x86_64 25/49 2023-11-25T04:10:19.581 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 26/49 2023-11-25T04:10:19.613 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-11-25T04:10:19.723 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-11-25T04:10:19.842 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 28/49 2023-11-25T04:10:19.972 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 29/49 2023-11-25T04:10:20.022 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : indent-2.2.13-4.el9.x86_64 30/49 2023-11-25T04:10:20.071 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : udftools-2.2-5.el9.x86_64 31/49 2023-11-25T04:10:20.113 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 32/49 2023-11-25T04:10:20.141 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 33/49 2023-11-25T04:10:20.174 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 34/49 2023-11-25T04:10:20.201 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 35/49 2023-11-25T04:10:20.232 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 36/49 2023-11-25T04:10:20.257 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 37/49 2023-11-25T04:10:20.283 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 38/49 2023-11-25T04:10:20.283 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-11-25T04:10:20.330 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-11-25T04:10:20.359 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 40/49 2023-11-25T04:10:20.384 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 41/49 2023-11-25T04:10:20.422 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 42/49 2023-11-25T04:10:20.460 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 43/49 2023-11-25T04:10:20.485 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 44/49 2023-11-25T04:10:20.485 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-11-25T04:10:20.570 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-11-25T04:10:20.595 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 46/49 2023-11-25T04:10:20.620 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 47/49 2023-11-25T04:10:20.702 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 48/49 2023-11-25T04:10:20.801 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-11-25T04:10:23.226 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 49/49 2023-11-25T04:10:23.226 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-3.35-1.el9.x86_64 1/49 2023-11-25T04:10:23.226 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libnbd-1.18.1-2.el9.x86_64 9/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 10/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : udftools-2.2-5.el9.x86_64 11/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 12/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-devel-5.14.0-386.el9.x86_64 13/49 2023-11-25T04:10:23.227 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/49 2023-11-25T04:10:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/49 2023-11-25T04:10:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/49 2023-11-25T04:10:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : indent-2.2.13-4.el9.x86_64 17/49 2023-11-25T04:10:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 18/49 2023-11-25T04:10:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 19/49 2023-11-25T04:10:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 20/49 2023-11-25T04:10:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 21/49 2023-11-25T04:10:23.228 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 22/49 2023-11-25T04:10:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 23/49 2023-11-25T04:10:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 24/49 2023-11-25T04:10:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 25/49 2023-11-25T04:10:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 26/49 2023-11-25T04:10:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 27/49 2023-11-25T04:10:23.229 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 28/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 29/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 30/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 31/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 32/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 33/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 34/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 35/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 36/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 37/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 38/49 2023-11-25T04:10:23.230 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 39/49 2023-11-25T04:10:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 40/49 2023-11-25T04:10:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 41/49 2023-11-25T04:10:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libss-1.46.5-4.el9.x86_64 42/49 2023-11-25T04:10:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libss-1.46.5-3.el9.x86_64 43/49 2023-11-25T04:10:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 44/49 2023-11-25T04:10:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 45/49 2023-11-25T04:10:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-3.9.18-1.el9.x86_64 46/49 2023-11-25T04:10:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-3.9.17-2.el9.x86_64 47/49 2023-11-25T04:10:23.231 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 48/49 2023-11-25T04:10:24.251 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-11-25T04:10:24.252 INFO:teuthology.orchestra.run.smithi002.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: libss-1.46.5-4.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: python3-3.9.18-1.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-11-25T04:10:24.253 INFO:teuthology.orchestra.run.smithi002.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-11-25T04:10:24.254 INFO:teuthology.orchestra.run.smithi002.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2023-11-25T04:10:24.254 INFO:teuthology.orchestra.run.smithi002.stdout: indent-2.2.13-4.el9.x86_64 kernel-devel-5.14.0-386.el9.x86_64 2023-11-25T04:10:24.254 INFO:teuthology.orchestra.run.smithi002.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-2.el9.x86_64 2023-11-25T04:10:24.254 INFO:teuthology.orchestra.run.smithi002.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-11-25T04:10:24.254 INFO:teuthology.orchestra.run.smithi002.stdout: udftools-2.2-5.el9.x86_64 2023-11-25T04:10:24.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:10:24.254 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2023-11-25T04:10:24.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo useradd -m fsgqa 2023-11-25T04:10:24.944 INFO:teuthology.orchestra.run.smithi002.stderr:useradd: user 'fsgqa' already exists 2023-11-25T04:10:24.946 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-25T04:10:24.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo groupadd fsgqa 2023-11-25T04:10:25.017 INFO:teuthology.orchestra.run.smithi002.stderr:groupadd: group 'fsgqa' already exists 2023-11-25T04:10:25.018 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-25T04:10:25.019 DEBUG:teuthology.orchestra.run.smithi002:> sudo useradd fsgqa2 2023-11-25T04:10:25.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo useradd 123456-fsgqa 2023-11-25T04:10:26.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-25T04:10:26.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.229+0000 7f653da09640 1 Processor -- start 2023-11-25T04:10:26.230 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.229+0000 7f653da09640 1 -- start start 2023-11-25T04:10:26.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f653da09640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65380b4810 0x7f653815b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f653da09640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f653815bd90 0x7f65380cd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.231 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f653da09640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653806de80 con 0x7f653813e2d0 2023-11-25T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f653da09640 1 -- --> v2:172.21.15.2:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653815fc60 con 0x7f653815bd90 2023-11-25T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f653da09640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653806d5c0 con 0x7f65380b4810 2023-11-25T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f65377fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f653815bd90 0x7f65380cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f65377fe640 1 --2- >> v2:172.21.15.2:3300/0 conn(0x7f653815bd90 0x7f65380cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51470/0 (socket says 172.21.15.2:51470) 2023-11-25T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f65377fe640 1 -- 172.21.15.2:0/209532709 learned_addr learned my addr 172.21.15.2:0/209532709 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f65377fe640 1 -- 172.21.15.2:0/209532709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65380b4810 msgr2=0x7f653815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f65377fe640 1 --2- 172.21.15.2:0/209532709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65380b4810 0x7f653815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f65377fe640 1 -- 172.21.15.2:0/209532709 >> v1:172.21.15.66:6789/0 conn(0x7f653813e2d0 legacy=0x7f65380b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:10:26.232 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.230+0000 7f65377fe640 1 -- 172.21.15.2:0/209532709 --> v2:172.21.15.2:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653806d830 con 0x7f653815bd90 2023-11-25T04:10:26.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.231+0000 7f65377fe640 1 --2- 172.21.15.2:0/209532709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 0x7f65380cd810 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6530009e50 tx=0x7f653002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19138f3cc1f3fa02 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:10:26.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.231+0000 7f65367fc640 1 -- 172.21.15.2:0/209532709 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653002ca70 con 0x7f653815bd90 2023-11-25T04:10:26.233 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.231+0000 7f65367fc640 1 -- 172.21.15.2:0/209532709 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653002cbd0 con 0x7f653815bd90 2023-11-25T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.231+0000 7f65367fc640 1 -- 172.21.15.2:0/209532709 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65300343f0 con 0x7f653815bd90 2023-11-25T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.232+0000 7f653da09640 1 -- 172.21.15.2:0/209532709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 msgr2=0x7f65380cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.232+0000 7f653da09640 1 --2- 172.21.15.2:0/209532709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 0x7f65380cd810 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6530009e50 tx=0x7f653002bed0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.232+0000 7f653da09640 1 -- 172.21.15.2:0/209532709 shutdown_connections 2023-11-25T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.232+0000 7f653da09640 1 --2- 172.21.15.2:0/209532709 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 0x7f65380cd810 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.232+0000 7f653da09640 1 --2- 172.21.15.2:0/209532709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65380b4810 0x7f653815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.232+0000 7f653da09640 1 -- 172.21.15.2:0/209532709 >> 172.21.15.2:0/209532709 conn(0x7f65380b0af0 msgr2=0x7f65380b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.232+0000 7f653da09640 1 -- 172.21.15.2:0/209532709 shutdown_connections 2023-11-25T04:10:26.234 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.232+0000 7f653da09640 1 -- 172.21.15.2:0/209532709 wait complete. 2023-11-25T04:10:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.233+0000 7f653da09640 1 Processor -- start 2023-11-25T04:10:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.233+0000 7f653da09640 1 -- start start 2023-11-25T04:10:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f653da09640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65380b4810 0x7f653813d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f653da09640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f653813e2d0 0x7f65380b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.239 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f653da09640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 0x7f65380ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f653da09640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653813dca0 con 0x7f653815bd90 2023-11-25T04:10:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f653da09640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6538155ec0 con 0x7f653813e2d0 2023-11-25T04:10:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f653da09640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65380b2860 con 0x7f65380b4810 2023-11-25T04:10:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f65377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 0x7f65380ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.240 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f65377fe640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 0x7f65380ad830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51478/0 (socket says 172.21.15.2:51478) 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f65377fe640 1 -- 172.21.15.2:0/2778618868 learned_addr learned my addr 172.21.15.2:0/2778618868 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f652ffff640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f653813e2d0 0x7f65380b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f6536ffd640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65380b4810 0x7f653813d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f65377fe640 1 -- 172.21.15.2:0/2778618868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65380b4810 msgr2=0x7f653813d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f65377fe640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65380b4810 0x7f653813d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f65377fe640 1 -- 172.21.15.2:0/2778618868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f653813e2d0 msgr2=0x7f65380b1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f65377fe640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f653813e2d0 0x7f65380b1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.234+0000 7f65377fe640 1 -- 172.21.15.2:0/2778618868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6530009b30 con 0x7f653815bd90 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.235+0000 7f65377fe640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 0x7f65380ad830 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6530036040 tx=0x7f6530004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.235+0000 7f6534ff9640 1 -- 172.21.15.2:0/2778618868 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653003e450 con 0x7f653815bd90 2023-11-25T04:10:26.241 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.235+0000 7f6534ff9640 1 -- 172.21.15.2:0/2778618868 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653003e5d0 con 0x7f653815bd90 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.235+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653806e490 con 0x7f653815bd90 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.235+0000 7f6534ff9640 1 -- 172.21.15.2:0/2778618868 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653003e980 con 0x7f653815bd90 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.235+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65380b2e20 con 0x7f653815bd90 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.236+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653806e2f0 con 0x7f653815bd90 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.236+0000 7f6534ff9640 1 -- 172.21.15.2:0/2778618868 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f653003eae0 con 0x7f653815bd90 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.237+0000 7f6534ff9640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f651806ae40 0x7f651806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.237+0000 7f6534ff9640 1 -- 172.21.15.2:0/2778618868 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65300ac410 con 0x7f653815bd90 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.237+0000 7f6536ffd640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f651806ae40 0x7f651806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.237+0000 7f6536ffd640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f651806ae40 0x7f651806d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6528004ea0 tx=0x7f6528009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:10:26.242 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.241+0000 7f6534ff9640 1 -- 172.21.15.2:0/2778618868 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f653806e2f0 con 0x7f653815bd90 2023-11-25T04:10:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.489+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6538156090 con 0x7f653815bd90 2023-11-25T04:10:26.490 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.490+0000 7f6534ff9640 1 -- 172.21.15.2:0/2778618868 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1264 (secure 0 0 0) 0x7f6538156090 con 0x7f653815bd90 2023-11-25T04:10:26.491 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:10:26.491 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":1,"fsid":"490edb11-4d53-4272-8bbb-d46dd29c1240","modified":"2023-11-25T04:07:38.262996Z","created":"2023-11-25T04:07:38.262996Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:3300","nonce":0},{"type":"v1","addr":"172.21.15.2:6789","nonce":0}]},"addr":"172.21.15.2:6789/0","public_addr":"172.21.15.2:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3301","nonce":0},{"type":"v1","addr":"172.21.15.66:6790","nonce":0}]},"addr":"172.21.15.66:6790/0","public_addr":"172.21.15.66:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-25T04:10:26.491 INFO:teuthology.orchestra.run.smithi002.stderr:dumped monmap epoch 1 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f651806ae40 msgr2=0x7f651806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f651806ae40 0x7f651806d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6528004ea0 tx=0x7f6528009040 comp rx=0 tx=0).stop 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 msgr2=0x7f65380ad830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 0x7f65380ad830 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6530036040 tx=0x7f6530004a40 comp rx=0 tx=0).stop 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 shutdown_connections 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7f653815bd90 0x7f65380ad830 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7f651806ae40 0x7f651806d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f653813e2d0 0x7f65380b1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 --2- 172.21.15.2:0/2778618868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65380b4810 0x7f653813d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.493 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.491+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 >> 172.21.15.2:0/2778618868 conn(0x7f65380b0af0 msgr2=0x7f65380cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:10:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.492+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 shutdown_connections 2023-11-25T04:10:26.494 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.492+0000 7f653da09640 1 -- 172.21.15.2:0/2778618868 wait complete. 2023-11-25T04:10:26.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-11-25T04:10:26.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.612+0000 7fb39ebe3640 1 Processor -- start 2023-11-25T04:10:26.616 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.612+0000 7fb39ebe3640 1 -- start start 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb39ebe3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 0x7fb398144950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb39ebe3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb3980ce7e0 0x7fb3980b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb39ebe3640 1 -- --> v1:172.21.15.2:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3981446f0 con 0x7fb39806c890 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb39ebe3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3980b3980 con 0x7fb3980ce7e0 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb39ebe3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980cec60 con 0x7fb398144310 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb39d180640 1 --1- >> v1:172.21.15.2:6789/0 conn(0x7fb39806c890 0x7fb39815ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.2:6789/0 says I am v1:172.21.15.2:48714/0 (socket says 172.21.15.2:48714) 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb39d180640 1 -- 172.21.15.2:0/2300261034 learned_addr learned my addr 172.21.15.2:0/2300261034 (peer_addr_for_me v1:172.21.15.2:0/0) 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb38ffff640 1 --2- 172.21.15.2:0/2300261034 >> v2:172.21.15.66:3300/0 conn(0x7fb3980ce7e0 0x7fb3980b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb39c97f640 1 --2- 172.21.15.2:0/2300261034 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 0x7fb398144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb38f7fe640 1 -- 172.21.15.2:0/2300261034 <== mon.0 v1:172.21.15.2:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82254164 0 0) 0x7fb3981446f0 con 0x7fb39806c890 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb38f7fe640 1 -- 172.21.15.2:0/2300261034 --> v1:172.21.15.2:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb380003520 con 0x7fb39806c890 2023-11-25T04:10:26.617 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb38ffff640 1 -- 172.21.15.2:0/2300261034 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 msgr2=0x7fb398144950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb38ffff640 1 --2- 172.21.15.2:0/2300261034 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 0x7fb398144950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb38ffff640 1 -- 172.21.15.2:0/2300261034 >> v1:172.21.15.2:6789/0 conn(0x7fb39806c890 legacy=0x7fb39815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.613+0000 7fb38ffff640 1 -- 172.21.15.2:0/2300261034 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb39815ba80 con 0x7fb3980ce7e0 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.614+0000 7fb38ffff640 1 --2- 172.21.15.2:0/2300261034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3980ce7e0 0x7fb3980b3440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb3880097a0 tx=0x7fb38802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c622e01f1ec801b0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.614+0000 7fb38f7fe640 1 -- 172.21.15.2:0/2300261034 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388031830 con 0x7fb3980ce7e0 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb38f7fe640 1 -- 172.21.15.2:0/2300261034 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb388031990 con 0x7fb3980ce7e0 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb38f7fe640 1 -- 172.21.15.2:0/2300261034 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb388031d20 con 0x7fb3980ce7e0 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2300261034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3980ce7e0 msgr2=0x7fb3980b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb39ebe3640 1 --2- 172.21.15.2:0/2300261034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3980ce7e0 0x7fb3980b3440 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb3880097a0 tx=0x7fb38802b8d0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2300261034 shutdown_connections 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb39ebe3640 1 --2- 172.21.15.2:0/2300261034 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3980ce7e0 0x7fb3980b3440 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.618 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb39ebe3640 1 --2- 172.21.15.2:0/2300261034 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 0x7fb398144950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2300261034 >> 172.21.15.2:0/2300261034 conn(0x7fb39806a8f0 msgr2=0x7fb39806ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:10:26.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2300261034 shutdown_connections 2023-11-25T04:10:26.619 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.615+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2300261034 wait complete. 2023-11-25T04:10:26.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.616+0000 7fb39ebe3640 1 Processor -- start 2023-11-25T04:10:26.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.616+0000 7fb39ebe3640 1 -- start start 2023-11-25T04:10:26.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39ebe3640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb39806c890 0x7fb3981f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39ebe3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3980ce7e0 0x7fb3980ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39ebe3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 0x7fb39815a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39ebe3640 1 -- --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3981416c0 con 0x7fb39806c890 2023-11-25T04:10:26.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39ebe3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980acee0 con 0x7fb3980ce7e0 2023-11-25T04:10:26.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39ebe3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3980ad1c0 con 0x7fb398144310 2023-11-25T04:10:26.622 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39c97f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb39806c890 0x7fb3981f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39c97f640 1 --2- >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb39806c890 0x7fb3981f3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.2:3300/0 says I am v2:172.21.15.2:51488/0 (socket says 172.21.15.2:51488) 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39c97f640 1 -- 172.21.15.2:0/2517274018 learned_addr learned my addr 172.21.15.2:0/2517274018 (peer_addr_for_me v2:172.21.15.2:0/0) 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb38ffff640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3980ce7e0 0x7fb3980ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39d180640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 0x7fb39815a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39c97f640 1 -- 172.21.15.2:0/2517274018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 msgr2=0x7fb39815a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.617+0000 7fb39c97f640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 0x7fb39815a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.618+0000 7fb39c97f640 1 -- 172.21.15.2:0/2517274018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3980ce7e0 msgr2=0x7fb3980ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.618+0000 7fb39c97f640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3980ce7e0 0x7fb3980ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.618+0000 7fb39c97f640 1 -- 172.21.15.2:0/2517274018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388009400 con 0x7fb39806c890 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.618+0000 7fb39c97f640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb39806c890 0x7fb3981f3070 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb39400e870 tx=0x7fb39400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.618+0000 7fb38d7fa640 1 -- 172.21.15.2:0/2517274018 <== mon.0 v2:172.21.15.2:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3940094f0 con 0x7fb39806c890 2023-11-25T04:10:26.623 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.618+0000 7fb38d7fa640 1 -- 172.21.15.2:0/2517274018 <== mon.0 v2:172.21.15.2:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39400c940 con 0x7fb39806c890 2023-11-25T04:10:26.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.618+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3980ad4a0 con 0x7fb39806c890 2023-11-25T04:10:26.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.618+0000 7fb38d7fa640 1 -- 172.21.15.2:0/2517274018 <== mon.0 v2:172.21.15.2:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39400ccf0 con 0x7fb39806c890 2023-11-25T04:10:26.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.618+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3980ada60 con 0x7fb39806c890 2023-11-25T04:10:26.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.619+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb398072ae0 con 0x7fb39806c890 2023-11-25T04:10:26.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.619+0000 7fb38d7fa640 1 -- 172.21.15.2:0/2517274018 <== mon.0 v2:172.21.15.2:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb394013470 con 0x7fb39806c890 2023-11-25T04:10:26.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.620+0000 7fb38d7fa640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb38406ae40 0x7fb38406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-25T04:10:26.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.620+0000 7fb38d7fa640 1 -- 172.21.15.2:0/2517274018 <== mon.0 v2:172.21.15.2:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3940896a0 con 0x7fb39806c890 2023-11-25T04:10:26.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.620+0000 7fb38ffff640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb38406ae40 0x7fb38406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-25T04:10:26.624 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.620+0000 7fb38ffff640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb38406ae40 0x7fb38406d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb388036000 tx=0x7fb38803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-25T04:10:26.625 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.624+0000 7fb38d7fa640 1 -- 172.21.15.2:0/2517274018 <== mon.0 v2:172.21.15.2:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb3940547e0 con 0x7fb39806c890 2023-11-25T04:10:26.866 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.865+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 --> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7fb39804e920 con 0x7fb39806c890 2023-11-25T04:10:26.867 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.866+0000 7fb38d7fa640 1 -- 172.21.15.2:0/2517274018 <== mon.0 v2:172.21.15.2:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7fb3940210b0 con 0x7fb39806c890 2023-11-25T04:10:26.867 INFO:teuthology.orchestra.run.smithi002.stdout:[client.admin] 2023-11-25T04:10:26.867 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQAKc2FlIkK4GxAA/rMcF9sRc98QtUqoNm7W1g== 2023-11-25T04:10:26.867 INFO:teuthology.orchestra.run.smithi002.stdout: caps mds = "allow *" 2023-11-25T04:10:26.868 INFO:teuthology.orchestra.run.smithi002.stdout: caps mgr = "allow *" 2023-11-25T04:10:26.868 INFO:teuthology.orchestra.run.smithi002.stdout: caps mon = "allow *" 2023-11-25T04:10:26.868 INFO:teuthology.orchestra.run.smithi002.stdout: caps osd = "allow *" 2023-11-25T04:10:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb38406ae40 msgr2=0x7fb38406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb38406ae40 0x7fb38406d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb388036000 tx=0x7fb38803c040 comp rx=0 tx=0).stop 2023-11-25T04:10:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb39806c890 msgr2=0x7fb3981f3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-25T04:10:26.869 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb39806c890 0x7fb3981f3070 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fb39400e870 tx=0x7fb39400ed30 comp rx=0 tx=0).stop 2023-11-25T04:10:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 shutdown_connections 2023-11-25T04:10:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb398144310 0x7fb39815a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:6832/523998843,v1:172.21.15.2:6833/523998843] conn(0x7fb38406ae40 0x7fb38406d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3980ce7e0 0x7fb3980ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 --2- 172.21.15.2:0/2517274018 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x7fb39806c890 0x7fb3981f3070 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-25T04:10:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 >> 172.21.15.2:0/2517274018 conn(0x7fb39806a8f0 msgr2=0x7fb39806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-25T04:10:26.870 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 shutdown_connections 2023-11-25T04:10:26.871 INFO:teuthology.orchestra.run.smithi002.stderr:2023-11-25T04:10:26.868+0000 7fb39ebe3640 1 -- 172.21.15.2:0/2517274018 wait complete. 2023-11-25T04:10:26.880 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2023-11-25T04:10:26.896 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.tZgKypIdmu 2023-11-25T04:10:26.896 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:10:26.897 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/tmp/tmp.tZgKypIdmu 2023-11-25T04:10:26.952 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:10:26.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/tmp/tmp.qL1lhbO0Esxfstests-dev/local.config 2023-11-25T04:10:27.022 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.VDcWebYyYttest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.N6UMeiekqcscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.2:6789 -k /tmp/tmp.tZgKypIdmu --client_mountpoint /test" 2023-11-25T04:10:27.022 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T04:10:27.022 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/tmp/tmp.qL1lhbO0Esxfstests-dev/ceph.exclude 2023-11-25T04:10:27.093 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo make) 2023-11-25T04:10:27.186 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize -cfi 2023-11-25T04:10:27.604 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-25T04:10:27.604 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file './config.guess' 2023-11-25T04:10:27.608 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file './config.sub' 2023-11-25T04:10:27.612 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file './install-sh' 2023-11-25T04:10:27.616 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file './ltmain.sh' 2023-11-25T04:10:27.638 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-25T04:10:27.638 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-25T04:10:27.643 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-25T04:10:27.647 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-25T04:10:27.652 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-25T04:10:27.656 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-25T04:10:27.663 INFO:teuthology.orchestra.run.smithi002.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-25T04:10:27.664 INFO:teuthology.orchestra.run.smithi002.stdout:cp include/install-sh . 2023-11-25T04:10:27.665 INFO:teuthology.orchestra.run.smithi002.stdout:aclocal -I m4 2023-11-25T04:10:28.711 INFO:teuthology.orchestra.run.smithi002.stdout:autoheader 2023-11-25T04:10:29.010 INFO:teuthology.orchestra.run.smithi002.stdout:autoconf 2023-11-25T04:10:29.184 INFO:teuthology.orchestra.run.smithi002.stdout:./configure \ 2023-11-25T04:10:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: --libexecdir=/usr/lib \ 2023-11-25T04:10:29.184 INFO:teuthology.orchestra.run.smithi002.stdout: --exec_prefix=/var/lib 2023-11-25T04:10:29.385 INFO:teuthology.orchestra.run.smithi002.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-25T04:10:29.385 INFO:teuthology.orchestra.run.smithi002.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-25T04:10:29.386 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to print strings... printf 2023-11-25T04:10:29.386 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc... gcc 2023-11-25T04:10:29.443 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether the C compiler works... yes 2023-11-25T04:10:29.443 INFO:teuthology.orchestra.run.smithi002.stdout:checking for C compiler default output file name... a.out 2023-11-25T04:10:29.471 INFO:teuthology.orchestra.run.smithi002.stdout:checking for suffix of executables... 2023-11-25T04:10:29.518 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether we are cross compiling... no 2023-11-25T04:10:29.535 INFO:teuthology.orchestra.run.smithi002.stdout:checking for suffix of object files... o 2023-11-25T04:10:29.550 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether we are using the GNU C compiler... yes 2023-11-25T04:10:29.566 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether gcc accepts -g... yes 2023-11-25T04:10:29.593 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc option to accept ISO C89... none needed 2023-11-25T04:10:29.595 INFO:teuthology.orchestra.run.smithi002.stdout:checking for a sed that does not truncate output... /bin/sed 2023-11-25T04:10:29.597 INFO:teuthology.orchestra.run.smithi002.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-11-25T04:10:29.598 INFO:teuthology.orchestra.run.smithi002.stdout:checking for egrep... /bin/grep -E 2023-11-25T04:10:29.599 INFO:teuthology.orchestra.run.smithi002.stdout:checking for fgrep... /bin/grep -F 2023-11-25T04:10:29.603 INFO:teuthology.orchestra.run.smithi002.stdout:checking for ld used by gcc... /bin/ld 2023-11-25T04:10:29.604 INFO:teuthology.orchestra.run.smithi002.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-11-25T04:10:29.609 INFO:teuthology.orchestra.run.smithi002.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-11-25T04:10:30.577 INFO:teuthology.orchestra.run.smithi002.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-11-25T04:10:30.577 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether ln -s works... yes 2023-11-25T04:10:30.596 INFO:teuthology.orchestra.run.smithi002.stdout:checking the maximum length of command line arguments... 1572864 2023-11-25T04:10:30.600 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-25T04:10:30.600 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-25T04:10:30.600 INFO:teuthology.orchestra.run.smithi002.stdout:checking for /bin/ld option to reload object files... -r 2023-11-25T04:10:30.600 INFO:teuthology.orchestra.run.smithi002.stdout:checking for objdump... objdump 2023-11-25T04:10:30.600 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to recognize dependent libraries... pass_all 2023-11-25T04:10:30.601 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dlltool... no 2023-11-25T04:10:30.601 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-25T04:10:30.601 INFO:teuthology.orchestra.run.smithi002.stdout:checking for ar... ar 2023-11-25T04:10:30.656 INFO:teuthology.orchestra.run.smithi002.stdout:checking for archiver @FILE support... @ 2023-11-25T04:10:30.657 INFO:teuthology.orchestra.run.smithi002.stdout:checking for strip... strip 2023-11-25T04:10:30.657 INFO:teuthology.orchestra.run.smithi002.stdout:checking for ranlib... ranlib 2023-11-25T04:10:30.657 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gawk... gawk 2023-11-25T04:10:30.724 INFO:teuthology.orchestra.run.smithi002.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-11-25T04:10:30.725 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sysroot... no 2023-11-25T04:10:30.728 INFO:teuthology.orchestra.run.smithi002.stdout:checking for a working dd... /bin/dd 2023-11-25T04:10:30.731 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-11-25T04:10:30.744 INFO:teuthology.orchestra.run.smithi002.stdout:checking for mt... no 2023-11-25T04:10:30.746 INFO:teuthology.orchestra.run.smithi002.stdout:checking if : is a manifest tool... no 2023-11-25T04:10:30.793 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to run the C preprocessor... gcc -E 2023-11-25T04:10:30.965 INFO:teuthology.orchestra.run.smithi002.stdout:checking for ANSI C header files... yes 2023-11-25T04:10:30.983 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/types.h... yes 2023-11-25T04:10:31.014 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/stat.h... yes 2023-11-25T04:10:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:checking for stdlib.h... yes 2023-11-25T04:10:31.063 INFO:teuthology.orchestra.run.smithi002.stdout:checking for string.h... yes 2023-11-25T04:10:31.097 INFO:teuthology.orchestra.run.smithi002.stdout:checking for memory.h... yes 2023-11-25T04:10:31.122 INFO:teuthology.orchestra.run.smithi002.stdout:checking for strings.h... yes 2023-11-25T04:10:31.163 INFO:teuthology.orchestra.run.smithi002.stdout:checking for inttypes.h... yes 2023-11-25T04:10:31.190 INFO:teuthology.orchestra.run.smithi002.stdout:checking for stdint.h... yes 2023-11-25T04:10:31.225 INFO:teuthology.orchestra.run.smithi002.stdout:checking for unistd.h... yes 2023-11-25T04:10:31.257 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dlfcn.h... yes 2023-11-25T04:10:31.260 INFO:teuthology.orchestra.run.smithi002.stdout:checking for objdir... .libs 2023-11-25T04:10:31.323 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-25T04:10:31.323 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-25T04:10:31.339 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-25T04:10:31.356 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc static flag -static works... no 2023-11-25T04:10:31.378 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc supports -c -o file.o... yes 2023-11-25T04:10:31.379 INFO:teuthology.orchestra.run.smithi002.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-25T04:10:31.384 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-25T04:10:31.409 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether -lc should be explicitly linked in... no 2023-11-25T04:10:31.463 INFO:teuthology.orchestra.run.smithi002.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-25T04:10:31.463 INFO:teuthology.orchestra.run.smithi002.stdout:checking how to hardcode library paths into programs... immediate 2023-11-25T04:10:31.465 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether stripping libraries is possible... yes 2023-11-25T04:10:31.465 INFO:teuthology.orchestra.run.smithi002.stdout:checking if libtool supports shared libraries... yes 2023-11-25T04:10:31.465 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether to build shared libraries... yes 2023-11-25T04:10:31.465 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether to build static libraries... yes 2023-11-25T04:10:31.470 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc... (cached) gcc 2023-11-25T04:10:31.486 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-11-25T04:10:31.487 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-25T04:10:31.487 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-11-25T04:10:31.487 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gmake... /usr/bin/gmake 2023-11-25T04:10:31.488 INFO:teuthology.orchestra.run.smithi002.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2023-11-25T04:10:31.489 INFO:teuthology.orchestra.run.smithi002.stdout:checking for tar... /bin/tar 2023-11-25T04:10:31.489 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gzip... /bin/gzip 2023-11-25T04:10:31.496 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether gcc -MM is supported... yes 2023-11-25T04:10:31.496 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sort... /bin/sort 2023-11-25T04:10:31.496 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether ln -s works... yes 2023-11-25T04:10:31.496 INFO:teuthology.orchestra.run.smithi002.stdout:checking for rpm... /bin/rpm 2023-11-25T04:10:31.499 INFO:teuthology.orchestra.run.smithi002.stdout:checking for rpmbuild... no 2023-11-25T04:10:31.525 INFO:teuthology.orchestra.run.smithi002.stdout:checking assert.h usability... yes 2023-11-25T04:10:31.533 INFO:teuthology.orchestra.run.smithi002.stdout:checking assert.h presence... yes 2023-11-25T04:10:31.533 INFO:teuthology.orchestra.run.smithi002.stdout:checking for assert.h... yes 2023-11-25T04:10:31.560 INFO:teuthology.orchestra.run.smithi002.stdout:checking bstring.h usability... no 2023-11-25T04:10:31.570 INFO:teuthology.orchestra.run.smithi002.stdout:checking bstring.h presence... no 2023-11-25T04:10:31.570 INFO:teuthology.orchestra.run.smithi002.stdout:checking for bstring.h... no 2023-11-25T04:10:31.597 INFO:teuthology.orchestra.run.smithi002.stdout:checking libgen.h usability... yes 2023-11-25T04:10:31.605 INFO:teuthology.orchestra.run.smithi002.stdout:checking libgen.h presence... yes 2023-11-25T04:10:31.605 INFO:teuthology.orchestra.run.smithi002.stdout:checking for libgen.h... yes 2023-11-25T04:10:31.638 INFO:teuthology.orchestra.run.smithi002.stdout:checking dirent.h usability... yes 2023-11-25T04:10:31.650 INFO:teuthology.orchestra.run.smithi002.stdout:checking dirent.h presence... yes 2023-11-25T04:10:31.650 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dirent.h... yes 2023-11-25T04:10:31.691 INFO:teuthology.orchestra.run.smithi002.stdout:checking errno.h usability... yes 2023-11-25T04:10:31.700 INFO:teuthology.orchestra.run.smithi002.stdout:checking errno.h presence... yes 2023-11-25T04:10:31.700 INFO:teuthology.orchestra.run.smithi002.stdout:checking for errno.h... yes 2023-11-25T04:10:31.734 INFO:teuthology.orchestra.run.smithi002.stdout:checking malloc.h usability... yes 2023-11-25T04:10:31.745 INFO:teuthology.orchestra.run.smithi002.stdout:checking malloc.h presence... yes 2023-11-25T04:10:31.745 INFO:teuthology.orchestra.run.smithi002.stdout:checking for malloc.h... yes 2023-11-25T04:10:31.771 INFO:teuthology.orchestra.run.smithi002.stdout:checking uuid.h usability... no 2023-11-25T04:10:31.783 INFO:teuthology.orchestra.run.smithi002.stdout:checking uuid.h presence... no 2023-11-25T04:10:31.783 INFO:teuthology.orchestra.run.smithi002.stdout:checking for uuid.h... no 2023-11-25T04:10:31.823 INFO:teuthology.orchestra.run.smithi002.stdout:checking uuid/uuid.h usability... yes 2023-11-25T04:10:31.833 INFO:teuthology.orchestra.run.smithi002.stdout:checking uuid/uuid.h presence... yes 2023-11-25T04:10:31.834 INFO:teuthology.orchestra.run.smithi002.stdout:checking for uuid/uuid.h... yes 2023-11-25T04:10:31.860 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/uuid.h usability... no 2023-11-25T04:10:31.871 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/uuid.h presence... no 2023-11-25T04:10:31.872 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/uuid.h... no 2023-11-25T04:10:31.898 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/file.h usability... yes 2023-11-25T04:10:31.907 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/file.h presence... yes 2023-11-25T04:10:31.907 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/file.h... yes 2023-11-25T04:10:31.939 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fcntl.h usability... yes 2023-11-25T04:10:31.949 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fcntl.h presence... yes 2023-11-25T04:10:31.949 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/fcntl.h... yes 2023-11-25T04:10:31.976 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/syssgi.h usability... no 2023-11-25T04:10:31.987 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/syssgi.h presence... no 2023-11-25T04:10:31.987 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/syssgi.h... no 2023-11-25T04:10:32.028 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/param.h usability... yes 2023-11-25T04:10:32.040 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/param.h presence... yes 2023-11-25T04:10:32.040 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/param.h... yes 2023-11-25T04:10:32.044 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/stat.h... (cached) yes 2023-11-25T04:10:32.095 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/statvfs.h usability... yes 2023-11-25T04:10:32.103 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/statvfs.h presence... yes 2023-11-25T04:10:32.103 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/statvfs.h... yes 2023-11-25T04:10:32.131 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/time.h usability... yes 2023-11-25T04:10:32.140 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/time.h presence... yes 2023-11-25T04:10:32.140 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/time.h... yes 2023-11-25T04:10:32.177 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/ioctl.h usability... yes 2023-11-25T04:10:32.186 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/ioctl.h presence... yes 2023-11-25T04:10:32.186 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/ioctl.h... yes 2023-11-25T04:10:32.222 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/wait.h usability... yes 2023-11-25T04:10:32.232 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/wait.h presence... yes 2023-11-25T04:10:32.233 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/wait.h... yes 2023-11-25T04:10:32.237 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/types.h... (cached) yes 2023-11-25T04:10:32.242 INFO:teuthology.orchestra.run.smithi002.stdout:checking for strings.h... (cached) yes 2023-11-25T04:10:32.270 INFO:teuthology.orchestra.run.smithi002.stdout:checking err.h usability... yes 2023-11-25T04:10:32.278 INFO:teuthology.orchestra.run.smithi002.stdout:checking err.h presence... yes 2023-11-25T04:10:32.278 INFO:teuthology.orchestra.run.smithi002.stdout:checking for err.h... yes 2023-11-25T04:10:32.307 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/falloc.h usability... yes 2023-11-25T04:10:32.314 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/falloc.h presence... yes 2023-11-25T04:10:32.314 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/falloc.h... yes 2023-11-25T04:10:32.341 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-11-25T04:10:32.352 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-11-25T04:10:32.352 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-25T04:10:32.376 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fs/xfs_itable.h usability... no 2023-11-25T04:10:32.386 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/fs/xfs_itable.h presence... no 2023-11-25T04:10:32.387 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-25T04:10:32.412 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfs/platform_defs.h usability... no 2023-11-25T04:10:32.423 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfs/platform_defs.h presence... no 2023-11-25T04:10:32.423 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/platform_defs.h... no 2023-11-25T04:10:32.447 INFO:teuthology.orchestra.run.smithi002.stdout:checking btrfs/ioctl.h usability... no 2023-11-25T04:10:32.458 INFO:teuthology.orchestra.run.smithi002.stdout:checking btrfs/ioctl.h presence... no 2023-11-25T04:10:32.458 INFO:teuthology.orchestra.run.smithi002.stdout:checking for btrfs/ioctl.h... no 2023-11-25T04:10:32.482 INFO:teuthology.orchestra.run.smithi002.stdout:checking cifs/ioctl.h usability... no 2023-11-25T04:10:32.493 INFO:teuthology.orchestra.run.smithi002.stdout:checking cifs/ioctl.h presence... no 2023-11-25T04:10:32.493 INFO:teuthology.orchestra.run.smithi002.stdout:checking for cifs/ioctl.h... no 2023-11-25T04:10:32.521 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/mman.h usability... yes 2023-11-25T04:10:32.529 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/mman.h presence... yes 2023-11-25T04:10:32.530 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/mman.h... yes 2023-11-25T04:10:32.544 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/xfs_log_format.h... no 2023-11-25T04:10:32.579 INFO:teuthology.orchestra.run.smithi002.stdout:checking for uuid_compare... no 2023-11-25T04:10:32.611 INFO:teuthology.orchestra.run.smithi002.stdout:checking for uuid_compare in -luuid... yes 2023-11-25T04:10:32.677 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/xfs.h... yes 2023-11-25T04:10:32.690 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/libxfs.h... no 2023-11-25T04:10:32.706 INFO:teuthology.orchestra.run.smithi002.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-25T04:10:32.736 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/xqm.h... yes 2023-11-25T04:10:32.785 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-25T04:10:32.809 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfs/handle.h usability... yes 2023-11-25T04:10:32.816 INFO:teuthology.orchestra.run.smithi002.stdout:checking xfs/handle.h presence... yes 2023-11-25T04:10:32.816 INFO:teuthology.orchestra.run.smithi002.stdout:checking for xfs/handle.h... yes 2023-11-25T04:10:32.857 INFO:teuthology.orchestra.run.smithi002.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-25T04:10:32.881 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/acl.h usability... yes 2023-11-25T04:10:32.891 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/acl.h presence... yes 2023-11-25T04:10:32.891 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/acl.h... yes 2023-11-25T04:10:32.915 INFO:teuthology.orchestra.run.smithi002.stdout:checking acl/libacl.h usability... yes 2023-11-25T04:10:32.925 INFO:teuthology.orchestra.run.smithi002.stdout:checking acl/libacl.h presence... yes 2023-11-25T04:10:32.925 INFO:teuthology.orchestra.run.smithi002.stdout:checking for acl/libacl.h... yes 2023-11-25T04:10:32.958 INFO:teuthology.orchestra.run.smithi002.stdout:checking for acl_init in -lacl... yes 2023-11-25T04:10:32.982 INFO:teuthology.orchestra.run.smithi002.stdout:checking gdbm-ndbm.h usability... no 2023-11-25T04:10:32.993 INFO:teuthology.orchestra.run.smithi002.stdout:checking gdbm-ndbm.h presence... no 2023-11-25T04:10:32.993 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gdbm-ndbm.h... no 2023-11-25T04:10:33.016 INFO:teuthology.orchestra.run.smithi002.stdout:checking gdbm/ndbm.h usability... yes 2023-11-25T04:10:33.026 INFO:teuthology.orchestra.run.smithi002.stdout:checking gdbm/ndbm.h presence... yes 2023-11-25T04:10:33.026 INFO:teuthology.orchestra.run.smithi002.stdout:checking for gdbm/ndbm.h... yes 2023-11-25T04:10:33.061 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_open in -lgdbm... no 2023-11-25T04:10:33.096 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_fetch in -lgdbm... no 2023-11-25T04:10:33.131 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_store in -lgdbm... no 2023-11-25T04:10:33.165 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_close in -lgdbm... no 2023-11-25T04:10:33.207 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_open in -lgdbm_compat... yes 2023-11-25T04:10:33.239 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2023-11-25T04:10:33.272 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_store in -lgdbm_compat... yes 2023-11-25T04:10:33.306 INFO:teuthology.orchestra.run.smithi002.stdout:checking for dbm_close in -lgdbm_compat... yes 2023-11-25T04:10:33.330 INFO:teuthology.orchestra.run.smithi002.stdout:checking libaio.h usability... yes 2023-11-25T04:10:33.341 INFO:teuthology.orchestra.run.smithi002.stdout:checking libaio.h presence... yes 2023-11-25T04:10:33.341 INFO:teuthology.orchestra.run.smithi002.stdout:checking for libaio.h... yes 2023-11-25T04:10:33.364 INFO:teuthology.orchestra.run.smithi002.stdout:checking liburing.h usability... no 2023-11-25T04:10:33.374 INFO:teuthology.orchestra.run.smithi002.stdout:checking liburing.h presence... no 2023-11-25T04:10:33.374 INFO:teuthology.orchestra.run.smithi002.stdout:checking for liburing.h... no 2023-11-25T04:10:33.401 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/capability.h usability... yes 2023-11-25T04:10:33.413 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/capability.h presence... yes 2023-11-25T04:10:33.414 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/capability.h... yes 2023-11-25T04:10:33.436 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/fiemap.h usability... yes 2023-11-25T04:10:33.444 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/fiemap.h presence... yes 2023-11-25T04:10:33.444 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/fiemap.h... yes 2023-11-25T04:10:33.479 INFO:teuthology.orchestra.run.smithi002.stdout:checking for fallocate... yes 2023-11-25T04:10:33.514 INFO:teuthology.orchestra.run.smithi002.stdout:checking for open_by_handle_at... yes 2023-11-25T04:10:33.539 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/prctl.h usability... yes 2023-11-25T04:10:33.548 INFO:teuthology.orchestra.run.smithi002.stdout:checking sys/prctl.h presence... yes 2023-11-25T04:10:33.548 INFO:teuthology.orchestra.run.smithi002.stdout:checking for sys/prctl.h... yes 2023-11-25T04:10:33.572 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/fs.h usability... yes 2023-11-25T04:10:33.580 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/fs.h presence... yes 2023-11-25T04:10:33.580 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/fs.h... yes 2023-11-25T04:10:33.603 INFO:teuthology.orchestra.run.smithi002.stdout:checking btrfsutil.h usability... no 2023-11-25T04:10:33.614 INFO:teuthology.orchestra.run.smithi002.stdout:checking btrfsutil.h presence... no 2023-11-25T04:10:33.614 INFO:teuthology.orchestra.run.smithi002.stdout:checking for btrfsutil.h... no 2023-11-25T04:10:33.654 INFO:teuthology.orchestra.run.smithi002.stdout:checking for copy_file_range... yes 2023-11-25T04:10:33.691 INFO:teuthology.orchestra.run.smithi002.stdout:checking for SEEK_DATA... yes 2023-11-25T04:10:33.741 INFO:teuthology.orchestra.run.smithi002.stdout:checking for BMV_OF_SHARED... yes 2023-11-25T04:10:33.778 INFO:teuthology.orchestra.run.smithi002.stdout:checking for nftw... yes 2023-11-25T04:10:33.825 INFO:teuthology.orchestra.run.smithi002.stdout:checking for RLIMIT_NOFILE... yes 2023-11-25T04:10:33.844 INFO:teuthology.orchestra.run.smithi002.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-25T04:10:33.878 INFO:teuthology.orchestra.run.smithi002.stdout:checking for renameat2... yes 2023-11-25T04:10:33.913 INFO:teuthology.orchestra.run.smithi002.stdout:checking for reallocarray... yes 2023-11-25T04:10:33.943 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct mount_attr... yes 2023-11-25T04:10:33.977 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-25T04:10:34.010 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-25T04:10:34.043 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-25T04:10:34.075 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-25T04:10:34.108 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-25T04:10:34.140 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-25T04:10:34.173 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-25T04:10:34.200 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/btrfs.h usability... yes 2023-11-25T04:10:34.209 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/btrfs.h presence... yes 2023-11-25T04:10:34.209 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/btrfs.h... yes 2023-11-25T04:10:34.244 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/btrfs_tree.h usability... yes 2023-11-25T04:10:34.253 INFO:teuthology.orchestra.run.smithi002.stdout:checking linux/btrfs_tree.h presence... yes 2023-11-25T04:10:34.253 INFO:teuthology.orchestra.run.smithi002.stdout:checking for linux/btrfs_tree.h... yes 2023-11-25T04:10:34.274 INFO:teuthology.orchestra.run.smithi002.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-11-25T04:10:34.291 INFO:teuthology.orchestra.run.smithi002.stdout:configure: creating ./config.status 2023-11-25T04:10:34.598 INFO:teuthology.orchestra.run.smithi002.stdout:config.status: creating include/builddefs 2023-11-25T04:10:34.608 INFO:teuthology.orchestra.run.smithi002.stdout:config.status: creating include/config.h 2023-11-25T04:10:34.616 INFO:teuthology.orchestra.run.smithi002.stdout:config.status: executing libtool commands 2023-11-25T04:10:34.655 INFO:teuthology.orchestra.run.smithi002.stdout:Building include 2023-11-25T04:10:34.658 INFO:teuthology.orchestra.run.smithi002.stdout:Building lib 2023-11-25T04:10:34.662 INFO:teuthology.orchestra.run.smithi002.stdout: [LTDEP] 2023-11-25T04:10:34.799 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dataascii.lo 2023-11-25T04:10:34.908 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] databin.lo 2023-11-25T04:10:35.046 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] datapid.lo 2023-11-25T04:10:35.143 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] file_lock.lo 2023-11-25T04:10:35.281 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] forker.lo 2023-11-25T04:10:35.404 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] pattern.lo 2023-11-25T04:10:35.516 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] open_flags.lo 2023-11-25T04:10:35.646 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] random_range.lo 2023-11-25T04:10:35.861 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] string_to_tokens.lo 2023-11-25T04:10:35.956 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] str_to_bytes.lo 2023-11-25T04:10:36.079 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] tlibio.lo 2023-11-25T04:10:36.307 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] write_log.lo 2023-11-25T04:10:36.529 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] random.lo 2023-11-25T04:10:36.627 INFO:teuthology.orchestra.run.smithi002.stdout: [LD] 2023-11-25T04:10:36.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:10:36.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:10:36.707 INFO:teuthology.orchestra.run.smithi002.stdout:Building ltp 2023-11-25T04:10:36.709 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2023-11-25T04:10:36.859 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] doio 2023-11-25T04:10:37.486 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fsstress 2023-11-25T04:10:38.867 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fsx 2023-11-25T04:10:39.569 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] growfiles 2023-11-25T04:10:40.036 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] iogen 2023-11-25T04:10:40.382 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-stress 2023-11-25T04:10:40.776 INFO:teuthology.orchestra.run.smithi002.stdout:Building src 2023-11-25T04:10:40.781 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2023-11-25T04:10:42.490 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2023-11-25T04:10:42.521 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2023-11-25T04:10:42.528 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2023-11-25T04:10:42.745 INFO:teuthology.orchestra.run.smithi002.stdout: [DEP] 2023-11-25T04:10:42.767 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dirstress 2023-11-25T04:10:42.981 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fill 2023-11-25T04:10:43.115 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fill2 2023-11-25T04:10:43.324 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] getpagesize 2023-11-25T04:10:43.441 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] holes 2023-11-25T04:10:43.614 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] lstat64 2023-11-25T04:10:43.775 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] nametest 2023-11-25T04:10:43.991 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] permname 2023-11-25T04:10:44.168 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] randholes 2023-11-25T04:10:44.391 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] runas 2023-11-25T04:10:44.544 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] truncfile 2023-11-25T04:10:44.702 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] usemem 2023-11-25T04:10:44.833 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mmapcat 2023-11-25T04:10:44.962 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] append_reader 2023-11-25T04:10:45.093 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] append_writer 2023-11-25T04:10:45.227 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dirperf 2023-11-25T04:10:45.427 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] metaperf 2023-11-25T04:10:45.674 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] devzero 2023-11-25T04:10:45.829 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] feature 2023-11-25T04:10:46.019 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] alloc 2023-11-25T04:10:46.205 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fault 2023-11-25T04:10:46.347 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fstest 2023-11-25T04:10:46.560 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_access_root 2023-11-25T04:10:46.696 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] godown 2023-11-25T04:10:46.844 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] resvtest 2023-11-25T04:10:47.006 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] writemod 2023-11-25T04:10:47.132 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] writev_on_pagefault 2023-11-25T04:10:47.270 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] makeextents 2023-11-25T04:10:47.428 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] itrash 2023-11-25T04:10:47.561 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] rename 2023-11-25T04:10:47.682 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] multi_open_unlink 2023-11-25T04:10:47.827 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] unwritten_sync 2023-11-25T04:10:47.987 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] genhashnames 2023-11-25T04:10:48.160 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_holes 2023-11-25T04:10:48.289 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_writev 2023-11-25T04:10:48.418 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_truncate_cmtime 2023-11-25T04:10:48.556 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dirhash_collide 2023-11-25T04:10:48.716 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_rename_overwrite 2023-11-25T04:10:48.838 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] holetest 2023-11-25T04:10:49.042 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_truncate_self 2023-11-25T04:10:49.165 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] af_unix 2023-11-25T04:10:49.297 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_stale_pmd 2023-11-25T04:10:49.430 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_cow_race 2023-11-25T04:10:49.577 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_fallocate 2023-11-25T04:10:49.709 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fsync-err 2023-11-25T04:10:49.871 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_write_ro 2023-11-25T04:10:50.002 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-25T04:10:50.140 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-25T04:10:50.276 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_ofd_locks 2023-11-25T04:10:50.449 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_collision 2023-11-25T04:10:50.626 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mmap-write-concurrent 2023-11-25T04:10:50.775 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_get_file_time 2023-11-25T04:10:50.904 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_create_short_dirs 2023-11-25T04:10:51.052 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_create_long_dirs 2023-11-25T04:10:51.198 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_enospc 2023-11-25T04:10:51.366 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_writev_overlap 2023-11-25T04:10:51.518 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] checkpoint_journal 2023-11-25T04:10:51.650 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mmap-rw-fault 2023-11-25T04:10:51.812 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] allocstale 2023-11-25T04:10:51.959 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_cow_memory_failure 2023-11-25T04:10:52.109 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fake-dump-rootino 2023-11-25T04:10:52.241 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dio-buf-fault 2023-11-25T04:10:52.374 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] rewinddir-test 2023-11-25T04:10:52.524 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] xfsctl 2023-11-25T04:10:52.696 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] bstat 2023-11-25T04:10:52.877 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mtab 2023-11-25T04:10:53.042 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] getdevicesize 2023-11-25T04:10:53.166 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] preallo_rw_pattern_reader 2023-11-25T04:10:53.305 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] preallo_rw_pattern_writer 2023-11-25T04:10:53.443 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] ftrunc 2023-11-25T04:10:53.571 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] trunc 2023-11-25T04:10:53.730 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fs_perms 2023-11-25T04:10:53.874 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] testx 2023-11-25T04:10:53.988 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] looptest 2023-11-25T04:10:54.159 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] locktest 2023-11-25T04:10:54.445 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] unwritten_mmap 2023-11-25T04:10:54.587 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] bulkstat_unlink_test 2023-11-25T04:10:54.765 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] deduperace 2023-11-25T04:10:54.939 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] bulkstat_unlink_test_modified 2023-11-25T04:10:55.112 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_dir_offset 2023-11-25T04:10:55.242 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_futimens 2023-11-25T04:10:55.363 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_immutable 2023-11-25T04:10:55.943 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] stale_handle 2023-11-25T04:10:56.094 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] pwrite_mmap_blocked 2023-11-25T04:10:56.229 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_dir_offset2 2023-11-25T04:10:56.402 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] seek_sanity_test 2023-11-25T04:10:56.824 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] seek_copy_test 2023-11-25T04:10:56.980 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_readdir_1 2023-11-25T04:10:57.108 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_readdir_2 2023-11-25T04:10:57.241 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fsync-tester 2023-11-25T04:10:57.469 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] nsexec 2023-11-25T04:10:57.626 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] cloner 2023-11-25T04:10:57.783 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] renameat2 2023-11-25T04:10:57.932 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_getcwd 2023-11-25T04:10:58.071 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] e4compact 2023-11-25T04:10:58.252 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] test-nextquota 2023-11-25T04:10:58.403 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] punch-alternating 2023-11-25T04:10:58.553 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-25T04:10:58.700 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] listxattr 2023-11-25T04:10:58.831 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dio-interleaved 2023-11-25T04:10:58.974 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_dir_type 2023-11-25T04:10:59.109 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dio-invalidate-cache 2023-11-25T04:10:59.291 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] stat_test 2023-11-25T04:10:59.560 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_encrypted_d_revalidate 2023-11-25T04:10:59.706 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] attr_replace_test 2023-11-25T04:10:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] swapon 2023-11-25T04:10:59.992 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mkswap 2023-11-25T04:11:00.125 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_attr_corruption 2023-11-25T04:11:00.255 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_open_tmpfiles 2023-11-25T04:11:00.414 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fscrypt-crypt-util 2023-11-25T04:11:01.035 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] bulkstat_null_ocount 2023-11-25T04:11:01.174 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] splice-test 2023-11-25T04:11:01.335 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] chprojid_fail 2023-11-25T04:11:01.480 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] detached_mounts_propagation 2023-11-25T04:11:01.642 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] ext4_resize 2023-11-25T04:11:01.772 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_readdir_3 2023-11-25T04:11:01.945 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] splice2pipe 2023-11-25T04:11:02.087 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] uuid_ioctl 2023-11-25T04:11:02.226 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fiemap-tester 2023-11-25T04:11:02.466 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_stripealign 2023-11-25T04:11:02.601 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] open_by_handle 2023-11-25T04:11:02.830 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] dbtest 2023-11-25T04:11:03.053 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] t_mmap_dio 2023-11-25T04:11:03.198 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] xfsfind 2023-11-25T04:11:03.369 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] fssum 2023-11-25T04:11:03.780 INFO:teuthology.orchestra.run.smithi002.stdout:Building log-writes 2023-11-25T04:11:03.785 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] replay-log 2023-11-25T04:11:04.074 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2023-11-25T04:11:04.077 INFO:teuthology.orchestra.run.smithi002.stdout:Building aio-dio-regress 2023-11-25T04:11:04.083 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aiocp 2023-11-25T04:11:04.290 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-25T04:11:04.438 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-append-write-read-race 2023-11-25T04:11:04.592 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-cow-race 2023-11-25T04:11:04.726 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-cycle-write 2023-11-25T04:11:04.889 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-eof-race 2023-11-25T04:11:05.052 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-extend-stat 2023-11-25T04:11:05.196 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-fcntl-race 2023-11-25T04:11:05.340 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-hole-filling-race 2023-11-25T04:11:05.469 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-invalidate-failure 2023-11-25T04:11:05.610 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-invalidate-readahead 2023-11-25T04:11:05.755 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aiodio_sparse2 2023-11-25T04:11:05.951 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-subblock-eof-read 2023-11-25T04:11:06.074 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-dio-write-verify 2023-11-25T04:11:06.250 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-25T04:11:06.365 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-25T04:11:06.480 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] aio-last-ref-held-by-io 2023-11-25T04:11:06.634 INFO:teuthology.orchestra.run.smithi002.stdout:Building vfs 2023-11-25T04:11:06.639 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] vfstest 2023-11-25T04:11:06.744 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:11:06.748 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:11:10.075 INFO:teuthology.orchestra.run.smithi002.stdout: [CC] mount-idmapped 2023-11-25T04:11:10.435 INFO:teuthology.orchestra.run.smithi002.stdout:Building m4 2023-11-25T04:11:10.439 INFO:teuthology.orchestra.run.smithi002.stdout:Building common 2023-11-25T04:11:10.443 INFO:teuthology.orchestra.run.smithi002.stdout:Building tests 2023-11-25T04:11:10.448 INFO:teuthology.orchestra.run.smithi002.stdout:Building btrfs 2023-11-25T04:11:10.454 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/btrfs/group.list 2023-11-25T04:11:10.514 INFO:teuthology.orchestra.run.smithi002.stdout:Building ceph 2023-11-25T04:11:10.521 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/ceph/group.list 2023-11-25T04:11:10.534 INFO:teuthology.orchestra.run.smithi002.stdout:Building cifs 2023-11-25T04:11:10.539 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/cifs/group.list 2023-11-25T04:11:10.552 INFO:teuthology.orchestra.run.smithi002.stdout:Building ext4 2023-11-25T04:11:10.557 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/ext4/group.list 2023-11-25T04:11:10.595 INFO:teuthology.orchestra.run.smithi002.stdout:Building f2fs 2023-11-25T04:11:10.600 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/f2fs/group.list 2023-11-25T04:11:10.617 INFO:teuthology.orchestra.run.smithi002.stdout:Building generic 2023-11-25T04:11:10.624 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/generic/group.list 2023-11-25T04:11:10.724 INFO:teuthology.orchestra.run.smithi002.stdout:Building nfs 2023-11-25T04:11:10.729 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/nfs/group.list 2023-11-25T04:11:10.743 INFO:teuthology.orchestra.run.smithi002.stdout:Building ocfs2 2023-11-25T04:11:10.748 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/ocfs2/group.list 2023-11-25T04:11:10.761 INFO:teuthology.orchestra.run.smithi002.stdout:Building overlay 2023-11-25T04:11:10.767 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/overlay/group.list 2023-11-25T04:11:10.808 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2023-11-25T04:11:10.813 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/perf/group.list 2023-11-25T04:11:10.825 INFO:teuthology.orchestra.run.smithi002.stdout:Building selftest 2023-11-25T04:11:10.830 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/selftest/group.list 2023-11-25T04:11:10.842 INFO:teuthology.orchestra.run.smithi002.stdout:Building shared 2023-11-25T04:11:10.847 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/shared/group.list 2023-11-25T04:11:10.865 INFO:teuthology.orchestra.run.smithi002.stdout:Building tmpfs 2023-11-25T04:11:10.870 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/tmpfs/group.list 2023-11-25T04:11:10.883 INFO:teuthology.orchestra.run.smithi002.stdout:Building udf 2023-11-25T04:11:10.889 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/udf/group.list 2023-11-25T04:11:10.900 INFO:teuthology.orchestra.run.smithi002.stdout:Building xfs 2023-11-25T04:11:10.907 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/xfs/group.list 2023-11-25T04:11:11.008 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo make install) 2023-11-25T04:11:11.051 INFO:teuthology.orchestra.run.smithi002.stdout:Building include 2023-11-25T04:11:11.054 INFO:teuthology.orchestra.run.smithi002.stdout:Building lib 2023-11-25T04:11:11.058 INFO:teuthology.orchestra.run.smithi002.stdout:Building ltp 2023-11-25T04:11:11.062 INFO:teuthology.orchestra.run.smithi002.stdout:Building src 2023-11-25T04:11:11.096 INFO:teuthology.orchestra.run.smithi002.stdout:Building log-writes 2023-11-25T04:11:11.100 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2023-11-25T04:11:11.103 INFO:teuthology.orchestra.run.smithi002.stdout:Building aio-dio-regress 2023-11-25T04:11:11.111 INFO:teuthology.orchestra.run.smithi002.stdout:Building vfs 2023-11-25T04:11:11.111 INFO:teuthology.orchestra.run.smithi002.stdout:Building m4 2023-11-25T04:11:11.115 INFO:teuthology.orchestra.run.smithi002.stdout:Building common 2023-11-25T04:11:11.119 INFO:teuthology.orchestra.run.smithi002.stdout:Building tests 2023-11-25T04:11:11.123 INFO:teuthology.orchestra.run.smithi002.stdout:Building btrfs 2023-11-25T04:11:11.129 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/btrfs/group.list 2023-11-25T04:11:11.188 INFO:teuthology.orchestra.run.smithi002.stdout:Building ceph 2023-11-25T04:11:11.193 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/ceph/group.list 2023-11-25T04:11:11.207 INFO:teuthology.orchestra.run.smithi002.stdout:Building cifs 2023-11-25T04:11:11.212 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/cifs/group.list 2023-11-25T04:11:11.225 INFO:teuthology.orchestra.run.smithi002.stdout:Building ext4 2023-11-25T04:11:11.231 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/ext4/group.list 2023-11-25T04:11:11.269 INFO:teuthology.orchestra.run.smithi002.stdout:Building f2fs 2023-11-25T04:11:11.274 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/f2fs/group.list 2023-11-25T04:11:11.291 INFO:teuthology.orchestra.run.smithi002.stdout:Building generic 2023-11-25T04:11:11.298 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/generic/group.list 2023-11-25T04:11:11.396 INFO:teuthology.orchestra.run.smithi002.stdout:Building nfs 2023-11-25T04:11:11.401 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/nfs/group.list 2023-11-25T04:11:11.415 INFO:teuthology.orchestra.run.smithi002.stdout:Building ocfs2 2023-11-25T04:11:11.420 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/ocfs2/group.list 2023-11-25T04:11:11.434 INFO:teuthology.orchestra.run.smithi002.stdout:Building overlay 2023-11-25T04:11:11.439 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/overlay/group.list 2023-11-25T04:11:11.480 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2023-11-25T04:11:11.485 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/perf/group.list 2023-11-25T04:11:11.497 INFO:teuthology.orchestra.run.smithi002.stdout:Building selftest 2023-11-25T04:11:11.501 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/selftest/group.list 2023-11-25T04:11:11.514 INFO:teuthology.orchestra.run.smithi002.stdout:Building shared 2023-11-25T04:11:11.519 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/shared/group.list 2023-11-25T04:11:11.536 INFO:teuthology.orchestra.run.smithi002.stdout:Building tmpfs 2023-11-25T04:11:11.541 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/tmpfs/group.list 2023-11-25T04:11:11.554 INFO:teuthology.orchestra.run.smithi002.stdout:Building udf 2023-11-25T04:11:11.560 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/udf/group.list 2023-11-25T04:11:11.571 INFO:teuthology.orchestra.run.smithi002.stdout:Building xfs 2023-11-25T04:11:11.578 INFO:teuthology.orchestra.run.smithi002.stdout: [GROUP] /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/xfs/group.list 2023-11-25T04:11:11.675 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-25T04:11:11.676 INFO:teuthology.orchestra.run.smithi002.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-25T04:11:11.676 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-25T04:11:11.679 INFO:teuthology.orchestra.run.smithi002.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-25T04:11:11.679 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-25T04:11:11.681 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-25T04:11:11.690 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-25T04:11:11.758 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-25T04:11:11.767 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-25T04:11:11.784 INFO:teuthology.orchestra.run.smithi002.stdout:Building log-writes 2023-11-25T04:11:11.787 INFO:teuthology.orchestra.run.smithi002.stdout:Building perf 2023-11-25T04:11:11.791 INFO:teuthology.orchestra.run.smithi002.stdout:Building aio-dio-regress 2023-11-25T04:11:11.796 INFO:teuthology.orchestra.run.smithi002.stdout:Building vfs 2023-11-25T04:11:11.798 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake -C log-writes install 2023-11-25T04:11:11.799 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-25T04:11:11.811 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-25T04:11:11.819 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake -C perf install 2023-11-25T04:11:11.821 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-25T04:11:11.829 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-25T04:11:11.851 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-25T04:11:11.853 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-25T04:11:11.861 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-11-25T04:11:11.912 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake -C vfs install 2023-11-25T04:11:11.912 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-25T04:11:11.921 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-25T04:11:11.934 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-25T04:11:11.941 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-11-25T04:11:13.073 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-25T04:11:13.167 INFO:teuthology.orchestra.run.smithi002.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-25T04:11:13.192 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-25T04:11:13.194 INFO:teuthology.orchestra.run.smithi002.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-25T04:11:13.194 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-25T04:11:13.196 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-25T04:11:13.204 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-25T04:11:13.330 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-25T04:11:13.331 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/btrfs/ install 2023-11-25T04:11:13.334 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-25T04:11:13.343 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-11-25T04:11:14.107 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-25T04:11:14.116 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out /var/lib/xfstests/tests/btrfs 2023-11-25T04:11:14.885 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/ceph/ install 2023-11-25T04:11:14.887 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-25T04:11:14.895 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-25T04:11:14.914 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-25T04:11:14.922 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-11-25T04:11:14.941 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/cifs/ install 2023-11-25T04:11:14.942 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-25T04:11:14.951 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-25T04:11:14.960 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-25T04:11:14.968 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-25T04:11:14.977 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/ext4/ install 2023-11-25T04:11:14.980 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-25T04:11:14.988 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-25T04:11:15.163 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-25T04:11:15.171 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-11-25T04:11:15.355 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/f2fs/ install 2023-11-25T04:11:15.357 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-25T04:11:15.365 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-25T04:11:15.376 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-25T04:11:15.385 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-25T04:11:15.396 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/generic/ install 2023-11-25T04:11:15.402 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-25T04:11:15.410 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-25T04:11:17.269 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-25T04:11:17.277 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-11-25T04:11:19.147 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/nfs/ install 2023-11-25T04:11:19.149 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-25T04:11:19.157 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-25T04:11:19.166 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-25T04:11:19.175 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-25T04:11:19.183 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/ocfs2/ install 2023-11-25T04:11:19.186 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-25T04:11:19.193 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-25T04:11:19.202 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-25T04:11:19.210 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-25T04:11:19.219 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/overlay/ install 2023-11-25T04:11:19.221 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-25T04:11:19.230 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-25T04:11:19.490 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-25T04:11:19.498 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-11-25T04:11:19.758 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/perf/ install 2023-11-25T04:11:19.760 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-25T04:11:19.768 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-25T04:11:19.777 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-25T04:11:19.785 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-25T04:11:19.794 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/selftest/ install 2023-11-25T04:11:19.796 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-25T04:11:19.804 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-25T04:11:19.825 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-25T04:11:19.834 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-11-25T04:11:19.855 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/shared/ install 2023-11-25T04:11:19.856 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-25T04:11:19.865 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-25T04:11:19.878 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-25T04:11:19.887 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-11-25T04:11:19.901 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/tmpfs/ install 2023-11-25T04:11:19.902 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-25T04:11:19.911 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-25T04:11:19.920 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-25T04:11:19.931 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-25T04:11:19.938 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/udf/ install 2023-11-25T04:11:19.938 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-25T04:11:19.947 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-25T04:11:19.959 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-25T04:11:19.966 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-25T04:11:19.973 INFO:teuthology.orchestra.run.smithi002.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.qL1lhbO0Esxfstests-dev/tests/xfs/ install 2023-11-25T04:11:19.978 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-25T04:11:19.986 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-25T04:11:21.741 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-25T04:11:21.749 INFO:teuthology.orchestra.run.smithi002.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-11-25T04:11:23.530 INFO:teuthology.orchestra.run.smithi002.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-25T04:11:23.539 INFO:teuthology.orchestra.run.smithi002.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-25T04:11:23.547 INFO:teuthology.orchestra.run.smithi002.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-25T04:11:23.555 INFO:teuthology.orchestra.run.smithi002.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-25T04:11:23.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T04:11:23.568 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec ls tests/generic) 2023-11-25T04:11:23.624 INFO:teuthology.orchestra.run.smithi002.stdout:001 2023-11-25T04:11:23.624 INFO:teuthology.orchestra.run.smithi002.stdout:001.out 2023-11-25T04:11:23.624 INFO:teuthology.orchestra.run.smithi002.stdout:002 2023-11-25T04:11:23.624 INFO:teuthology.orchestra.run.smithi002.stdout:002.out 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:003 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:003.out 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:004 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:004.out 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:005 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:005.out 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:006 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:006.out 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:007 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:007.out 2023-11-25T04:11:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:008 2023-11-25T04:11:23.626 INFO:teuthology.orchestra.run.smithi002.stdout:008.out 2023-11-25T04:11:23.626 INFO:teuthology.orchestra.run.smithi002.stdout:009 2023-11-25T04:11:23.626 INFO:teuthology.orchestra.run.smithi002.stdout:009.out 2023-11-25T04:11:23.626 INFO:teuthology.orchestra.run.smithi002.stdout:010 2023-11-25T04:11:23.626 INFO:teuthology.orchestra.run.smithi002.stdout:010.out 2023-11-25T04:11:23.626 INFO:teuthology.orchestra.run.smithi002.stdout:011 2023-11-25T04:11:23.626 INFO:teuthology.orchestra.run.smithi002.stdout:011.out 2023-11-25T04:11:23.626 INFO:teuthology.orchestra.run.smithi002.stdout:012 2023-11-25T04:11:23.626 INFO:teuthology.orchestra.run.smithi002.stdout:012.out 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:013 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:013.out 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:014 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:014.out 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:015 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:015.out 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:016 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:016.out 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:017 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:017.out 2023-11-25T04:11:23.627 INFO:teuthology.orchestra.run.smithi002.stdout:018 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:018.out 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:019 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:019.out 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:020 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:020.out 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:021 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:021.out 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:022 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:022.out 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:023 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:023.out 2023-11-25T04:11:23.628 INFO:teuthology.orchestra.run.smithi002.stdout:024 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:024.out 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:025 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:025.out 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:026 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:026.out 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:027 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:027.out 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:028 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:028.out 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:029 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:029.out 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:030 2023-11-25T04:11:23.629 INFO:teuthology.orchestra.run.smithi002.stdout:030.out 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:031 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:031.out 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:032 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:032.out 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:033 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:033.out 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:034 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:034.out 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:035 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:035.cfg 2023-11-25T04:11:23.630 INFO:teuthology.orchestra.run.smithi002.stdout:035.out.default 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:035.out.nfs 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:036 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:036.out 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:037 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:037.out 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:038 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:038.out 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:039 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:039.out 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:040 2023-11-25T04:11:23.631 INFO:teuthology.orchestra.run.smithi002.stdout:040.out 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:041 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:041.out 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:042 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:042.out 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:043 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:043.out 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:044 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:044.out 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:045 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:045.out 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:046 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:046.out 2023-11-25T04:11:23.632 INFO:teuthology.orchestra.run.smithi002.stdout:047 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:047.out 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:048 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:048.out 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:049 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:049.out 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:050 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:050.cfg 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:050.out.default 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:050.out.nojournal 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:050.out.xfsquota 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:051 2023-11-25T04:11:23.633 INFO:teuthology.orchestra.run.smithi002.stdout:051.out 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:052 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:052.out 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:053 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:053.out 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:054 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:054.out 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:055 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:055.out 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:056 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:056.out 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:057 2023-11-25T04:11:23.634 INFO:teuthology.orchestra.run.smithi002.stdout:057.out 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:058 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:058.out 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:059 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:059.out 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:060 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:060.out 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:061 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:061.out 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:062 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:062.out 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:063 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:063.out 2023-11-25T04:11:23.635 INFO:teuthology.orchestra.run.smithi002.stdout:064 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:064.out 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:065 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:065.out 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:066 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:066.out 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:067 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:067.out 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:068 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:068.out 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:069 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:069.out 2023-11-25T04:11:23.636 INFO:teuthology.orchestra.run.smithi002.stdout:070 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:070.out 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:071 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:071.out 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:072 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:072.out 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:073 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:073.out 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:074 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:074.out 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:075 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:075.out 2023-11-25T04:11:23.637 INFO:teuthology.orchestra.run.smithi002.stdout:076 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:076.out 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:077 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:077.out 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:078 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:078.out 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:079 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:079.out 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:080 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:080.out 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:081 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:081.out 2023-11-25T04:11:23.638 INFO:teuthology.orchestra.run.smithi002.stdout:082 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:082.out 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:083 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:083.out 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:084 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:084.out 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:085 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:085.out 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:086 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:086.out 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:087 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:087.out 2023-11-25T04:11:23.639 INFO:teuthology.orchestra.run.smithi002.stdout:088 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:088.out 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:089 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:089.out 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:090 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:090.out 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:091 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:091.out 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:092 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:092.out 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:093 2023-11-25T04:11:23.640 INFO:teuthology.orchestra.run.smithi002.stdout:093.out 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:094 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:094.out 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:095 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:095.out 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:096 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:096.out 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:097 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:097.out 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:098 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:098.out 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:099 2023-11-25T04:11:23.641 INFO:teuthology.orchestra.run.smithi002.stdout:099.out 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:100 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:100.out 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:101 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:101.out 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:102 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:102.out 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:103 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:103.out 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:104 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:104.out 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:105 2023-11-25T04:11:23.642 INFO:teuthology.orchestra.run.smithi002.stdout:105.out 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:106 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:106.out 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:107 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:107.out 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:108 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:108.out 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:109 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:109.out 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:110 2023-11-25T04:11:23.643 INFO:teuthology.orchestra.run.smithi002.stdout:110.out 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:111 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:111.out 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:112 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:112.out 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:113 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:113.out 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:114 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:114.out 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:115 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:115.out 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:116 2023-11-25T04:11:23.644 INFO:teuthology.orchestra.run.smithi002.stdout:116.out 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:117 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:117.out 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:118 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:118.out 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:119 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:119.out 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:120 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:120.out 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:121 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:121.out 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:122 2023-11-25T04:11:23.645 INFO:teuthology.orchestra.run.smithi002.stdout:122.out 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:123 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:123.out 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:124 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:124.out 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:125 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:125.out 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:126 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:126.out 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:127 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:127.out 2023-11-25T04:11:23.646 INFO:teuthology.orchestra.run.smithi002.stdout:128 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:128.out 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:129 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:129.out 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:130 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:130.out 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:131 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:131.out 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:132 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:132.out 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:133 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:133.out 2023-11-25T04:11:23.647 INFO:teuthology.orchestra.run.smithi002.stdout:134 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:134.out 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:135 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:135.out 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:136 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:136.out 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:137 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:137.out 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:138 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:138.out 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:139 2023-11-25T04:11:23.648 INFO:teuthology.orchestra.run.smithi002.stdout:139.out 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:140 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:140.out 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:141 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:141.out 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:142 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:142.out 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:143 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:143.out 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:144 2023-11-25T04:11:23.649 INFO:teuthology.orchestra.run.smithi002.stdout:144.out 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:145 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:145.out 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:146 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:146.out 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:147 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:147.out 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:148 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:148.out 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:149 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:149.out 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:150 2023-11-25T04:11:23.650 INFO:teuthology.orchestra.run.smithi002.stdout:150.out 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:151 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:151.out 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:152 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:152.out 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:153 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:153.out 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:154 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:154.out 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:155 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:155.out 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:156 2023-11-25T04:11:23.651 INFO:teuthology.orchestra.run.smithi002.stdout:156.out 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:157 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:157.out 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:158 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:158.out 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:159 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:159.out 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:160 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:160.out 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:161 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:161.out 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:162 2023-11-25T04:11:23.652 INFO:teuthology.orchestra.run.smithi002.stdout:162.out 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:163 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:163.out 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:164 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:164.out 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:165 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:165.out 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:166 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:166.out 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:167 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:167.out 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:168 2023-11-25T04:11:23.653 INFO:teuthology.orchestra.run.smithi002.stdout:168.out 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:169 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:169.out 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:170 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:170.out 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:171 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:171.out 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:172 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:172.out 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:173 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:173.out 2023-11-25T04:11:23.654 INFO:teuthology.orchestra.run.smithi002.stdout:174 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:174.out 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:175 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:175.out 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:176 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:176.out 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:177 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:177.out 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:178 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:178.out 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:179 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:179.out 2023-11-25T04:11:23.655 INFO:teuthology.orchestra.run.smithi002.stdout:180 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:180.out 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:181 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:181.out 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:182 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:182.out 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:183 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:183.out 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:184 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:184.out 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:185 2023-11-25T04:11:23.656 INFO:teuthology.orchestra.run.smithi002.stdout:185.out 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:186 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:186.out 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:187 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:187.out 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:188 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:188.out 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:189 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:189.out 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:190 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:190.out 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:191 2023-11-25T04:11:23.657 INFO:teuthology.orchestra.run.smithi002.stdout:191.out 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:192 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:192.out 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:193 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:193.out 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:194 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:194.out 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:195 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:195.out 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:196 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:196.out 2023-11-25T04:11:23.658 INFO:teuthology.orchestra.run.smithi002.stdout:197 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:197.out 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:198 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:198.out 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:199 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:199.out 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:200 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:200.out 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:201 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:201.out 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:202 2023-11-25T04:11:23.659 INFO:teuthology.orchestra.run.smithi002.stdout:202.out 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:203 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:203.out 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:204 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:204.out 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:205 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:205.out 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:206 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:206.out 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:207 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:207.out 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:208 2023-11-25T04:11:23.660 INFO:teuthology.orchestra.run.smithi002.stdout:208.out 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:209 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:209.out 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:210 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:210.out 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:211 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:211.out 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:212 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:212.out 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:213 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:213.out 2023-11-25T04:11:23.661 INFO:teuthology.orchestra.run.smithi002.stdout:214 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:214.out 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:215 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:215.out 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:216 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:216.out 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:217 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:217.out 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:218 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:218.out 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:219 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:219.out 2023-11-25T04:11:23.662 INFO:teuthology.orchestra.run.smithi002.stdout:220 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:220.out 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:221 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:221.out 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:222 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:222.out 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:223 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:223.out 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:224 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:224.out 2023-11-25T04:11:23.663 INFO:teuthology.orchestra.run.smithi002.stdout:225 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:225.out 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:226 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:226.out 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:227 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:227.out 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:228 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:228.out 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:229 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:229.out 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:230 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:230.out 2023-11-25T04:11:23.664 INFO:teuthology.orchestra.run.smithi002.stdout:231 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:231.out 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:232 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:232.out 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:233 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:233.out 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:234 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:234.out 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:235 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:235.out 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:236 2023-11-25T04:11:23.665 INFO:teuthology.orchestra.run.smithi002.stdout:236.out 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:237 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:237.out 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:238 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:238.out 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:239 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:239.out 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:240 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:240.out 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:241 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:241.out 2023-11-25T04:11:23.666 INFO:teuthology.orchestra.run.smithi002.stdout:242 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:242.out 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:243 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:243.out 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:244 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:244.out 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:245 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:245.out 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:246 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:246.out 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:247 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:247.out 2023-11-25T04:11:23.667 INFO:teuthology.orchestra.run.smithi002.stdout:248 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:248.out 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:249 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:249.out 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:250 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:250.out 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:251 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:251.out 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:252 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:252.out 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:253 2023-11-25T04:11:23.668 INFO:teuthology.orchestra.run.smithi002.stdout:253.out 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:254 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:254.out 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:255 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:255.out 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:256 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:256.out 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:257 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:257.out 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:258 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:258.out 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:259 2023-11-25T04:11:23.669 INFO:teuthology.orchestra.run.smithi002.stdout:259.out 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:260 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:260.out 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:261 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:261.out 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:262 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:262.out 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:263 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:263.out 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:264 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:264.out 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:265 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:265.out 2023-11-25T04:11:23.670 INFO:teuthology.orchestra.run.smithi002.stdout:266 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:266.out 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:267 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:267.out 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:268 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:268.out 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:269 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:269.out 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:270 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:270.out 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:271 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:271.out 2023-11-25T04:11:23.671 INFO:teuthology.orchestra.run.smithi002.stdout:272 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:272.out 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:273 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:273.out 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:274 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:274.out 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:275 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:275.out 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:276 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:276.out 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:277 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:277.out 2023-11-25T04:11:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:278 2023-11-25T04:11:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:278.out 2023-11-25T04:11:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:279 2023-11-25T04:11:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:279.out 2023-11-25T04:11:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:280 2023-11-25T04:11:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:280.out 2023-11-25T04:11:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:281 2023-11-25T04:11:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:281.out 2023-11-25T04:11:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:282 2023-11-25T04:11:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:282.out 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:283 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:283.out 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:284 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:284.out 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:285 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:285.out 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:286 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:286.out 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:287 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:287.out 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:288 2023-11-25T04:11:23.674 INFO:teuthology.orchestra.run.smithi002.stdout:288.out 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:289 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:289.out 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:290 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:290.out 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:291 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:291.out 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:292 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:292.out 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:293 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:293.out 2023-11-25T04:11:23.675 INFO:teuthology.orchestra.run.smithi002.stdout:294 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:294.out 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:295 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:295.out 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:296 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:296.out 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:297 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:297.out 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:298 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:298.out 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:299 2023-11-25T04:11:23.676 INFO:teuthology.orchestra.run.smithi002.stdout:299.out 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:300 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:300.out 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:301 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:301.out 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:302 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:302.out 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:303 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:303.out 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:304 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:304.out 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:305 2023-11-25T04:11:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:305.out 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:306 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:306.out 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:307 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:307.out 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:308 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:308.out 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:309 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:309.out 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:310 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:310.out 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:311 2023-11-25T04:11:23.678 INFO:teuthology.orchestra.run.smithi002.stdout:311.out 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:312 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:312.out 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:313 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:313.out 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:314 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:314.out 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:315 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:315.out 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:316 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:316.out 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:317 2023-11-25T04:11:23.679 INFO:teuthology.orchestra.run.smithi002.stdout:317.out 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:318 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:318.out 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:319 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:319.out 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:320 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:320.out 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:321 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:321.out 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:322 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:322.out 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:323 2023-11-25T04:11:23.680 INFO:teuthology.orchestra.run.smithi002.stdout:323.out 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:324 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:324.out 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:325 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:325.out 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:326 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:326.out 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:327 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:327.out 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:328 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:328.out 2023-11-25T04:11:23.681 INFO:teuthology.orchestra.run.smithi002.stdout:329 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:329.out 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:330 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:330.out 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:331 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:331.out 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:332 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:332.out 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:333 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:333.out 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:334 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:334.out 2023-11-25T04:11:23.682 INFO:teuthology.orchestra.run.smithi002.stdout:335 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:335.out 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:336 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:336.out 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:337 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:337.out 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:338 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:338.out 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:339 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:339.out 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:340 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:340.out 2023-11-25T04:11:23.683 INFO:teuthology.orchestra.run.smithi002.stdout:341 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:341.out 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:342 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:342.out 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:343 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:343.out 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:344 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:344.out 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:345 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:345.out 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:346 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:346.out 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:347 2023-11-25T04:11:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:347.out 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:348 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:348.out 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:349 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:349.out 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:350 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:350.out 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:351 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:351.out 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:352 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:352.out 2023-11-25T04:11:23.685 INFO:teuthology.orchestra.run.smithi002.stdout:353 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:353.out 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:354 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:354.out 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:355 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:355.out 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:356 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:356.out 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:357 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:357.out 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:358 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:358.out 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:359 2023-11-25T04:11:23.686 INFO:teuthology.orchestra.run.smithi002.stdout:359.out 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:360 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:360.out 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:361 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:361.out 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:362 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:362.out 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:363 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:363.out 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:364 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:364.out 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:365 2023-11-25T04:11:23.687 INFO:teuthology.orchestra.run.smithi002.stdout:365.out 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:366 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:366.out 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:367 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:367.out 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:368 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:368.out 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:369 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:369.out 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:370 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:370.out 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:371 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:371.out 2023-11-25T04:11:23.688 INFO:teuthology.orchestra.run.smithi002.stdout:372 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:372.out 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:373 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:373.out 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:374 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:374.out 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:375 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:375.out 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:376 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:376.out 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:377 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:377.out 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:378 2023-11-25T04:11:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:378.out 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:379 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:379.out 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:380 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:380.out 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:381 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:381.out 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:382 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:382.out 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:383 2023-11-25T04:11:23.690 INFO:teuthology.orchestra.run.smithi002.stdout:383.out 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:384 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:384.out 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:385 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:385.out 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:386 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:386.out 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:387 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:387.out 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:388 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:388.out 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:389 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:389.out 2023-11-25T04:11:23.691 INFO:teuthology.orchestra.run.smithi002.stdout:390 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:390.out 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:391 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:391.out 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:392 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:392.out 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:393 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:393.out 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:394 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:394.out 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:395 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:395.out 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:396 2023-11-25T04:11:23.692 INFO:teuthology.orchestra.run.smithi002.stdout:396.out 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:397 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:397.out 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:398 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:398.out 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:399 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:399.out 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:400 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:400.out 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:401 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:401.out 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:402 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:402.out 2023-11-25T04:11:23.693 INFO:teuthology.orchestra.run.smithi002.stdout:403 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:403.out 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:404 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:404.out 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:405 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:405.out 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:406 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:406.out 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:407 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:407.out 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:408 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:408.out 2023-11-25T04:11:23.694 INFO:teuthology.orchestra.run.smithi002.stdout:409 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:409.out 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:410 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:410.out 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:411 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:411.out 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:412 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:412.out 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:413 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:413.out 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:414 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:414.out 2023-11-25T04:11:23.695 INFO:teuthology.orchestra.run.smithi002.stdout:415 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:415.out 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:416 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:416.out 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:417 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:417.out 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:418 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:418.out 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:419 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:419.out 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:420 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:420.out 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:421 2023-11-25T04:11:23.696 INFO:teuthology.orchestra.run.smithi002.stdout:421.out 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:422 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:422.out 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:423 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:423.out 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:424 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:424.out 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:425 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:425.out 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:426 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:426.out 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:427 2023-11-25T04:11:23.697 INFO:teuthology.orchestra.run.smithi002.stdout:427.out 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:428 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:428.out 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:429 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:429.out 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:430 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:430.out 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:431 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:431.out 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:432 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:432.out 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:433 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:433.out 2023-11-25T04:11:23.698 INFO:teuthology.orchestra.run.smithi002.stdout:434 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:434.out 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:435 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:435.out 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:436 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:436.out 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:437 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:437.out 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:438 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:438.out 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:439 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:439.out 2023-11-25T04:11:23.699 INFO:teuthology.orchestra.run.smithi002.stdout:440 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:440.out 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:441 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:441.out 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:442 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:442.out 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:443 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:443.out 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:444 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:444.out 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:445 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:445.out 2023-11-25T04:11:23.700 INFO:teuthology.orchestra.run.smithi002.stdout:446 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:446.out 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:447 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:447.out 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:448 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:448.out 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:449 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:449.out 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:450 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:450.out 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:451 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:451.out 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:452 2023-11-25T04:11:23.701 INFO:teuthology.orchestra.run.smithi002.stdout:452.out 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:453 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:453.out 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:454 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:454.out 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:455 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:455.out 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:456 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:456.out 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:457 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:457.out 2023-11-25T04:11:23.702 INFO:teuthology.orchestra.run.smithi002.stdout:458 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:458.out 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:459 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:459.out 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:460 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:460.out 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:461 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:461.out 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:462 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:462.out 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:463 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:463.out 2023-11-25T04:11:23.703 INFO:teuthology.orchestra.run.smithi002.stdout:464 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:464.out 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:465 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:465.out 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:466 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:466.out 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:467 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:467.out 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:468 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:468.out 2023-11-25T04:11:23.704 INFO:teuthology.orchestra.run.smithi002.stdout:469 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:469.out 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:470 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:470.out 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:471 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:471.out 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:472 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:472.out 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:473 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:473.out 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:474 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:474.out 2023-11-25T04:11:23.705 INFO:teuthology.orchestra.run.smithi002.stdout:475 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:475.out 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:476 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:476.out 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:477 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:477.out 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:478 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:478.out 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:479 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:479.out 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:480 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:480.out 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:481 2023-11-25T04:11:23.706 INFO:teuthology.orchestra.run.smithi002.stdout:481.out 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:482 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:482.out 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:483 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:483.out 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:484 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:484.out 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:485 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:485.out 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:486 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:486.out 2023-11-25T04:11:23.707 INFO:teuthology.orchestra.run.smithi002.stdout:487 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:487.out 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:488 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:488.out 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:489 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:489.out 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:490 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:490.out 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:491 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:491.out 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:492 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:492.out 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:493 2023-11-25T04:11:23.708 INFO:teuthology.orchestra.run.smithi002.stdout:493.out 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:494 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:494.out 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:495 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:495.out 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:496 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:496.out 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:497 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:497.out 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:498 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:498.out 2023-11-25T04:11:23.709 INFO:teuthology.orchestra.run.smithi002.stdout:499 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:499.out 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:500 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:500.out 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:501 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:501.out 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:502 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:502.out 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:503 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:503.out 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:504 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:504.out 2023-11-25T04:11:23.710 INFO:teuthology.orchestra.run.smithi002.stdout:505 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:505.out 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:506 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:506.out 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:507 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:507.out 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:508 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:508.out 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:509 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:509.out 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:510 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:510.out 2023-11-25T04:11:23.711 INFO:teuthology.orchestra.run.smithi002.stdout:511 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:511.out 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:512 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:512.out 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:513 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:513.out 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:514 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:514.out 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:515 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:515.out 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:516 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:516.out 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:517 2023-11-25T04:11:23.712 INFO:teuthology.orchestra.run.smithi002.stdout:517.out 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:518 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:518.out 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:519 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:519.out 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:520 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:520.out 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:521 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:521.out 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:522 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:522.out 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:523 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:523.out 2023-11-25T04:11:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:524 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:524.out 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:525 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:525.out 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:526 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:526.out 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:527 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:527.out 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:528 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:528.out 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:529 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:529.out 2023-11-25T04:11:23.714 INFO:teuthology.orchestra.run.smithi002.stdout:530 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:530.out 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:531 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:531.out 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:532 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:532.out 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:533 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:533.out 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:534 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:534.out 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:535 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:535.out 2023-11-25T04:11:23.715 INFO:teuthology.orchestra.run.smithi002.stdout:536 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:536.out 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:537 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:537.out 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:538 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:538.out 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:539 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:539.out 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:540 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:540.out 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:541 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:541.out 2023-11-25T04:11:23.716 INFO:teuthology.orchestra.run.smithi002.stdout:542 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:542.out 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:543 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:543.out 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:544 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:544.out 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:545 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:545.out 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:546 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:546.out 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:547 2023-11-25T04:11:23.717 INFO:teuthology.orchestra.run.smithi002.stdout:547.out 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:548 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:548.out 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:549 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:549.out 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:550 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:550.out 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:551 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:551.out 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:552 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:552.out 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:553 2023-11-25T04:11:23.718 INFO:teuthology.orchestra.run.smithi002.stdout:553.out 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:554 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:554.out 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:555 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:555.out 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:556 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:556.out 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:557 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:557.out 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:558 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:558.out 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:559 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:559.out 2023-11-25T04:11:23.719 INFO:teuthology.orchestra.run.smithi002.stdout:560 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:560.out 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:561 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:561.out 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:562 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:562.out 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:563 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:563.out 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:564 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:564.out 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:565 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:565.out 2023-11-25T04:11:23.720 INFO:teuthology.orchestra.run.smithi002.stdout:566 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:566.out 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:567 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:567.out 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:568 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:568.out 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:569 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:569.out 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:570 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:570.out 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:571 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:571.out 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:572 2023-11-25T04:11:23.721 INFO:teuthology.orchestra.run.smithi002.stdout:572.out 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:573 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:573.out 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:574 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:574.out 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:575 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:575.out 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:576 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:576.out 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:577 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:577.out 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:578 2023-11-25T04:11:23.722 INFO:teuthology.orchestra.run.smithi002.stdout:578.out 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:579 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:579.out 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:580 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:580.out 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:581 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:581.out 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:582 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:582.out 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:583 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:583.out 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:584 2023-11-25T04:11:23.723 INFO:teuthology.orchestra.run.smithi002.stdout:584.out 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:585 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:585.out 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:586 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:586.out 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:587 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:587.out 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:588 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:588.out 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:589 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:589.out 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:590 2023-11-25T04:11:23.724 INFO:teuthology.orchestra.run.smithi002.stdout:590.out 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:591 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:591.out 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:592 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:592.out 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:593 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:593.out 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:594 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:594.out 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:595 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:595.out 2023-11-25T04:11:23.725 INFO:teuthology.orchestra.run.smithi002.stdout:596 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:596.out 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:597 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:597.out 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:598 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:598.out 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:599 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:599.out 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:600 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:600.out 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:601 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:601.out 2023-11-25T04:11:23.726 INFO:teuthology.orchestra.run.smithi002.stdout:602 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:602.out 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:603 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:603.out 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:604 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:604.out 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:605 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:605.out 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:606 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:606.out 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:607 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:607.out 2023-11-25T04:11:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:608 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:608.out 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:609 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:609.out 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:610 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:610.out 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:611 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:611.out 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:612 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:612.out 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:613 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:613.out 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:614 2023-11-25T04:11:23.728 INFO:teuthology.orchestra.run.smithi002.stdout:614.out 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:615 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:615.out 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:616 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:616.out 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:617 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:617.out 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:618 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:618.out 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:619 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:619.out 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:620 2023-11-25T04:11:23.729 INFO:teuthology.orchestra.run.smithi002.stdout:620.out 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:621 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:621.out 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:622 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:622.out 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:623 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:623.out 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:624 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:624.out 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:625 2023-11-25T04:11:23.730 INFO:teuthology.orchestra.run.smithi002.stdout:625.out 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:626 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:626.out 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:627 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:627.out 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:628 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:628.out 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:629 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:629.out 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:630 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:630.out 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:631 2023-11-25T04:11:23.731 INFO:teuthology.orchestra.run.smithi002.stdout:631.out 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:632 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:632.out 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:633 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:633.out 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:634 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:634.out 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:635 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:635.out 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:636 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:636.out 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:637 2023-11-25T04:11:23.732 INFO:teuthology.orchestra.run.smithi002.stdout:637.out 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:638 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:638.out 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:639 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:639.out 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:640 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:640.out 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:641 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:641.out 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:642 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:642.out 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:643 2023-11-25T04:11:23.733 INFO:teuthology.orchestra.run.smithi002.stdout:643.out 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:644 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:644.out 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:645 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:645.out 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:646 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:646.out 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:647 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:647.out 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:648 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:648.out 2023-11-25T04:11:23.734 INFO:teuthology.orchestra.run.smithi002.stdout:649 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:649.out 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:650 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:650.out 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:651 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:651.out 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:652 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:652.out 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:653 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:653.out 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:654 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:654.out 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:655 2023-11-25T04:11:23.735 INFO:teuthology.orchestra.run.smithi002.stdout:655.out 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:656 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:656.out 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:657 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:657.out 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:658 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:658.out 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:659 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:659.out 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:660 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:660.out 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:661 2023-11-25T04:11:23.736 INFO:teuthology.orchestra.run.smithi002.stdout:661.out 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:662 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:662.out 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:663 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:663.out 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:664 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:664.out 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:665 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:665.out 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:666 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:666.out 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:667 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:667.out 2023-11-25T04:11:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:668 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:668.out 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:669 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:669.out 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:670 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:670.out 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:671 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:671.out 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:672 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:672.out 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:673 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:673.out 2023-11-25T04:11:23.738 INFO:teuthology.orchestra.run.smithi002.stdout:674 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:674.out 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:675 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:675.out 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:676 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:676.out 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:677 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:677.out 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:678 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:678.out 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:679 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:679.out 2023-11-25T04:11:23.739 INFO:teuthology.orchestra.run.smithi002.stdout:680 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:680.out 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:681 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:681.out 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:682 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:682.out 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:683 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:683.out 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:684 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:684.out 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:685 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:685.out 2023-11-25T04:11:23.740 INFO:teuthology.orchestra.run.smithi002.stdout:686 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:686.out 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:687 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:687.out 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:688 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:688.out 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:689 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:689.out 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:690 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:690.out 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:691 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:691.out 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:692 2023-11-25T04:11:23.741 INFO:teuthology.orchestra.run.smithi002.stdout:692.out 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:693 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:693.out 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:694 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:694.out 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:695 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:695.out 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:696 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:696.out 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:697 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:697.out 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:698 2023-11-25T04:11:23.742 INFO:teuthology.orchestra.run.smithi002.stdout:698.out 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:699 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:699.out 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:700 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:700.out 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:701 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:701.out 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:702 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:702.out 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:703 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:703.out 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:704 2023-11-25T04:11:23.743 INFO:teuthology.orchestra.run.smithi002.stdout:704.out 2023-11-25T04:11:23.744 INFO:teuthology.orchestra.run.smithi002.stdout:705 2023-11-25T04:11:23.744 INFO:teuthology.orchestra.run.smithi002.stdout:705.out 2023-11-25T04:11:23.744 INFO:teuthology.orchestra.run.smithi002.stdout:706 2023-11-25T04:11:23.744 INFO:teuthology.orchestra.run.smithi002.stdout:706.out 2023-11-25T04:11:23.744 INFO:teuthology.orchestra.run.smithi002.stdout:707 2023-11-25T04:11:23.744 INFO:teuthology.orchestra.run.smithi002.stdout:707.out 2023-11-25T04:11:23.744 INFO:teuthology.orchestra.run.smithi002.stdout:708 2023-11-25T04:11:23.744 INFO:teuthology.orchestra.run.smithi002.stdout:708.out 2023-11-25T04:11:23.744 INFO:teuthology.orchestra.run.smithi002.stdout:709 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:709.out 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:710 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:710.out 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:711 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:711.out 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:712 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:712.out 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:713 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:713.out 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:714 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:714.out 2023-11-25T04:11:23.745 INFO:teuthology.orchestra.run.smithi002.stdout:715 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:715.out 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:716 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:716.out 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:717 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:717.out 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:718 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:718.out 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:719 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:719.out 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:720 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:720.out 2023-11-25T04:11:23.746 INFO:teuthology.orchestra.run.smithi002.stdout:721 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:721.out 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:722 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:722.out 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:723 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:723.out 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:724 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:724.out 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:725 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:725.out 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:726 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:726.out 2023-11-25T04:11:23.747 INFO:teuthology.orchestra.run.smithi002.stdout:727 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:727.out 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:728 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:728.out 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:729 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:729.out 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:730 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:730.out 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:731 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:731.out 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:732 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:732.out 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:group.list 2023-11-25T04:11:23.748 INFO:teuthology.orchestra.run.smithi002.stdout:Makefile 2023-11-25T04:11:23.749 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-11-25T04:11:23.900 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:11:23.905 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:11:23.905 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:25.861 INFO:teuthology.orchestra.run.smithi002.stdout:generic/001 2s 2023-11-25T04:11:25.866 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/001 2023-11-25T04:11:25.867 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:11:25.869 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:25.870 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi002.stderr:ceph-fuse[103094]: fuse finished with error 0 and tester_r 0 2023-11-25T04:11:25.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:11:25.878 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-11-25T04:11:26.048 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:11:26.052 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:11:26.053 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:26.437 INFO:teuthology.orchestra.run.smithi002.stdout:generic/002 0s 2023-11-25T04:11:26.443 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/002 2023-11-25T04:11:26.443 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:11:26.445 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:26.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:11:26.454 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-11-25T04:11:26.667 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:11:26.671 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:11:26.671 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:26.778 INFO:teuthology.orchestra.run.smithi002.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:11:26.782 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/003 2023-11-25T04:11:26.782 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/003 2023-11-25T04:11:26.782 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:11:26.784 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:26.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:11:26.793 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-11-25T04:11:26.962 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:11:26.966 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:11:26.966 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:27.082 INFO:teuthology.orchestra.run.smithi002.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-25T04:11:27.085 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/004 2023-11-25T04:11:27.085 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/004 2023-11-25T04:11:27.085 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:11:27.088 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:27.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:11:27.098 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-11-25T04:11:27.269 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:11:27.272 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:11:27.272 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:27.745 INFO:teuthology.orchestra.run.smithi002.stdout:generic/005 0s 2023-11-25T04:11:27.750 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/005 2023-11-25T04:11:27.750 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:11:27.753 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:27.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:11:27.762 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-11-25T04:11:27.959 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:11:27.963 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:11:27.963 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:36.813 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:11:36.817 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:11:58.942 INFO:teuthology.orchestra.run.smithi002.stdout:generic/006 31s 2023-11-25T04:11:59.020 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/006 2023-11-25T04:11:59.021 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:11:59.023 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:11:59.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:11:59.108 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-11-25T04:11:59.282 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:11:59.286 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:11:59.286 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:12:06.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:12:06.885 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:12:37.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:12:37.220 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:13:04.287 INFO:teuthology.orchestra.run.smithi002.stdout:generic/007 65s 2023-11-25T04:13:04.364 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/007 2023-11-25T04:13:04.364 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:13:04.366 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:04.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:13:04.375 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-11-25T04:13:04.579 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:13:04.583 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:13:04.583 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:05.432 INFO:teuthology.orchestra.run.smithi002.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-25T04:13:05.436 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/008 2023-11-25T04:13:05.436 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/008 2023-11-25T04:13:05.436 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:13:05.438 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:05.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:13:05.447 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-11-25T04:13:05.616 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:13:05.620 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:13:05.620 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:06.443 INFO:teuthology.orchestra.run.smithi002.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-25T04:13:06.447 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/009 2023-11-25T04:13:06.447 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/009 2023-11-25T04:13:06.447 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:13:06.450 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:06.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:13:06.458 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-11-25T04:13:06.627 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:13:06.631 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:13:06.632 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:07.256 INFO:teuthology.orchestra.run.smithi002.stdout:generic/010 1s 2023-11-25T04:13:07.285 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:13:07.288 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:13:07.374 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/010 2023-11-25T04:13:07.374 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:13:07.376 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:07.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:13:07.396 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-11-25T04:13:07.584 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:13:07.588 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:13:07.588 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:37.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:13:37.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:13:43.224 INFO:teuthology.orchestra.run.smithi002.stdout:generic/011 36s 2023-11-25T04:13:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/011 2023-11-25T04:13:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:13:43.327 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:43.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:13:43.336 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-11-25T04:13:43.642 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:13:43.647 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:13:43.647 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:44.500 INFO:teuthology.orchestra.run.smithi002.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T04:13:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/012 2023-11-25T04:13:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/012 2023-11-25T04:13:44.503 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:13:44.506 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:13:44.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:13:44.517 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-11-25T04:13:44.711 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:13:44.715 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:13:44.716 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:14:07.781 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:14:07.785 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:14:38.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:14:38.390 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:15:08.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:15:08.789 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:15:13.219 INFO:teuthology.orchestra.run.smithi002.stdout:generic/013 89s 2023-11-25T04:15:13.227 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/013 2023-11-25T04:15:13.227 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:15:13.230 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:15:13.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:15:13.242 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-11-25T04:15:13.507 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:15:13.514 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:15:13.514 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:15:38.866 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:15:38.869 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:15:38.940 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T04:15:38.938+0000 7fe9009f3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166953) UID: 0 2023-11-25T04:15:38.940 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T04:15:38.938+0000 7f607a7b0640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 166953) UID: 0 2023-11-25T04:18:52.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:18:52.520 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:19:22.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:19:22.603 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:19:52.678 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:19:52.682 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:19:57.477 INFO:teuthology.orchestra.run.smithi002.stdout:generic/014 284s 2023-11-25T04:19:57.484 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/014 2023-11-25T04:19:57.485 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:19:57.488 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:19:57.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:19:57.502 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-11-25T04:19:57.757 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:19:57.762 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:19:57.762 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:19:57.922 INFO:teuthology.orchestra.run.smithi002.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:19:57.926 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/015 2023-11-25T04:19:57.926 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/015 2023-11-25T04:19:57.926 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:19:57.929 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:19:57.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:19:57.944 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-11-25T04:19:58.210 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:19:58.217 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:19:58.217 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:19:59.610 INFO:teuthology.orchestra.run.smithi002.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T04:19:59.614 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/016 2023-11-25T04:19:59.614 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/016 2023-11-25T04:19:59.614 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:19:59.617 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:19:59.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:19:59.631 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-11-25T04:20:00.060 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:00.065 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:00.065 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:00.226 INFO:teuthology.orchestra.run.smithi002.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:00.230 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/017 2023-11-25T04:20:00.231 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/017 2023-11-25T04:20:00.231 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:00.234 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:00.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:00.246 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-11-25T04:20:00.496 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:00.501 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:00.501 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:00.654 INFO:teuthology.orchestra.run.smithi002.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:00.658 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/018 2023-11-25T04:20:00.658 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/018 2023-11-25T04:20:00.658 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:00.662 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:00.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:00.677 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-11-25T04:20:00.943 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:00.949 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:00.949 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:01.112 INFO:teuthology.orchestra.run.smithi002.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:01.116 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/019 2023-11-25T04:20:01.117 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/019 2023-11-25T04:20:01.117 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:01.120 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:01.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:01.135 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-11-25T04:20:01.387 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:01.393 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:01.393 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:10.680 INFO:teuthology.orchestra.run.smithi002.stdout:generic/020 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/020.out.bad) 2023-11-25T04:20:10.684 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/020.out 2023-11-25 04:09:45.751124906 +0000 2023-11-25T04:20:10.684 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/020.out.bad 2023-11-25 04:20:10.676524437 +0000 2023-11-25T04:20:10.684 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -47,9 +47,13 @@ 2023-11-25T04:20:10.684 INFO:teuthology.orchestra.run.smithi002.stdout: user.snrub="fish2\012" 2023-11-25T04:20:10.684 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:10.684 INFO:teuthology.orchestra.run.smithi002.stdout: *** really long value 2023-11-25T04:20:10.684 INFO:teuthology.orchestra.run.smithi002.stdout: -0000000 00 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: -* 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: -ATTRSIZE 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: +attr_set: No space left on device 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: +Could not set "long_attr" for 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: +attr_get: No data available 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: +Could not get "long_attr" for 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: +0000000 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: +attr_remove: No data available 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: +Could not remove "long_attr" for 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: *** set/get/remove really long names (expect failure) 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: attr_set: Invalid argument 2023-11-25T04:20:10.685 INFO:teuthology.orchestra.run.smithi002.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-11-25T04:20:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/020 2023-11-25T04:20:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/020 2023-11-25T04:20:10.687 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T04:20:10.691 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:10.703 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T04:20:10.703 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T04:20:10.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T04:20:10.703 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-11-25T04:20:11.131 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:11.137 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:11.138 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:12.525 INFO:teuthology.orchestra.run.smithi002.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T04:20:12.529 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/021 2023-11-25T04:20:12.530 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/021 2023-11-25T04:20:12.530 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:12.533 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:12.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:12.545 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-11-25T04:20:12.988 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:12.992 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:12.992 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:14.356 INFO:teuthology.orchestra.run.smithi002.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T04:20:14.361 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/022 2023-11-25T04:20:14.362 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/022 2023-11-25T04:20:14.362 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:14.364 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:14.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:14.378 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-11-25T04:20:14.820 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:14.826 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:14.826 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:16.620 INFO:teuthology.orchestra.run.smithi002.stdout:generic/023 2s 2023-11-25T04:20:16.626 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/023 2023-11-25T04:20:16.626 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:16.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:16.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:16.641 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-11-25T04:20:17.095 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:17.100 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:17.100 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:17.307 INFO:teuthology.orchestra.run.smithi002.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-25T04:20:17.312 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/024 2023-11-25T04:20:17.313 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/024 2023-11-25T04:20:17.313 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:17.316 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:17.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:17.331 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-11-25T04:20:17.767 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:17.772 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:17.772 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:17.989 INFO:teuthology.orchestra.run.smithi002.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-25T04:20:17.993 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/025 2023-11-25T04:20:17.994 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/025 2023-11-25T04:20:17.994 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:17.997 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:18.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:18.012 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-11-25T04:20:18.478 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:18.484 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:18.484 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:18.682 INFO:teuthology.orchestra.run.smithi002.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-25T04:20:18.688 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/026 2023-11-25T04:20:18.688 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/026 2023-11-25T04:20:18.688 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:18.691 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:18.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:18.704 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-11-25T04:20:18.956 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:18.961 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:18.961 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:19.124 INFO:teuthology.orchestra.run.smithi002.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:19.128 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/027 2023-11-25T04:20:19.128 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/027 2023-11-25T04:20:19.128 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:19.131 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:19.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:19.146 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-11-25T04:20:19.408 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:19.412 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:19.412 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:22.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:20:22.764 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:20:24.588 INFO:teuthology.orchestra.run.smithi002.stdout:generic/028 5s 2023-11-25T04:20:24.595 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/028 2023-11-25T04:20:24.596 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:24.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:24.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:24.611 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-11-25T04:20:24.870 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:24.877 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:24.877 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:25.033 INFO:teuthology.orchestra.run.smithi002.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:25.038 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/029 2023-11-25T04:20:25.038 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/029 2023-11-25T04:20:25.038 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:25.041 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:25.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:25.052 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-11-25T04:20:25.303 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:25.308 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:25.309 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:25.465 INFO:teuthology.orchestra.run.smithi002.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:25.472 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/030 2023-11-25T04:20:25.472 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/030 2023-11-25T04:20:25.472 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:25.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:25.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:25.484 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-11-25T04:20:25.739 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:25.744 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:25.745 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:25.908 INFO:teuthology.orchestra.run.smithi002.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:25.912 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/031 2023-11-25T04:20:25.912 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/031 2023-11-25T04:20:25.912 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:25.914 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:25.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:25.925 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-11-25T04:20:26.183 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:26.196 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:26.196 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:26.354 INFO:teuthology.orchestra.run.smithi002.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:26.358 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/032 2023-11-25T04:20:26.358 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/032 2023-11-25T04:20:26.358 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:26.360 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:26.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:26.372 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-11-25T04:20:26.623 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:26.629 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:26.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:26.787 INFO:teuthology.orchestra.run.smithi002.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:26.791 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/033 2023-11-25T04:20:26.791 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/033 2023-11-25T04:20:26.791 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:26.795 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:26.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:26.810 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-11-25T04:20:27.067 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:27.072 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:27.072 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:27.237 INFO:teuthology.orchestra.run.smithi002.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:27.243 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/034 2023-11-25T04:20:27.243 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/034 2023-11-25T04:20:27.243 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:27.245 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:27.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:27.257 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-11-25T04:20:27.502 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:27.508 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:27.508 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:27.748 INFO:teuthology.orchestra.run.smithi002.stdout:generic/035 0s 2023-11-25T04:20:27.757 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/035 2023-11-25T04:20:27.757 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:27.760 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:27.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:27.778 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-11-25T04:20:28.208 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:28.215 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:28.215 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:38.505 INFO:teuthology.orchestra.run.smithi002.stdout:generic/036 10s 2023-11-25T04:20:38.512 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/036 2023-11-25T04:20:38.512 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:38.515 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:38.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:38.532 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-11-25T04:20:38.939 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:38.944 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:38.945 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:39.103 INFO:teuthology.orchestra.run.smithi002.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:39.108 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/037 2023-11-25T04:20:39.108 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/037 2023-11-25T04:20:39.108 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:39.111 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:39.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:39.125 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-11-25T04:20:39.377 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:39.382 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:39.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:39.545 INFO:teuthology.orchestra.run.smithi002.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/038 2023-11-25T04:20:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/038 2023-11-25T04:20:39.551 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:39.554 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:39.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:39.564 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-11-25T04:20:39.810 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:39.815 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:39.815 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:39.992 INFO:teuthology.orchestra.run.smithi002.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/039 2023-11-25T04:20:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/039 2023-11-25T04:20:39.997 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:40.000 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:40.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:40.010 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-11-25T04:20:40.246 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:40.252 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:40.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:40.437 INFO:teuthology.orchestra.run.smithi002.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/040 2023-11-25T04:20:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/040 2023-11-25T04:20:40.442 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:40.445 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:40.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:40.456 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-11-25T04:20:40.692 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:40.698 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:40.698 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:40.868 INFO:teuthology.orchestra.run.smithi002.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/041 2023-11-25T04:20:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/041 2023-11-25T04:20:40.875 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:40.878 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:40.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:40.894 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-11-25T04:20:41.157 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:41.162 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:41.162 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:41.309 INFO:teuthology.orchestra.run.smithi002.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/042 2023-11-25T04:20:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/042 2023-11-25T04:20:41.314 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:41.318 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:41.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:41.330 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-11-25T04:20:41.577 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:41.584 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:41.584 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:41.745 INFO:teuthology.orchestra.run.smithi002.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/043 2023-11-25T04:20:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/043 2023-11-25T04:20:41.750 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:41.752 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:41.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:41.766 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-11-25T04:20:42.015 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:42.020 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:42.020 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:42.173 INFO:teuthology.orchestra.run.smithi002.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:42.177 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/044 2023-11-25T04:20:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/044 2023-11-25T04:20:42.178 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:42.183 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:42.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:42.199 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-11-25T04:20:42.452 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:42.457 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:42.457 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:42.604 INFO:teuthology.orchestra.run.smithi002.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/045 2023-11-25T04:20:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/045 2023-11-25T04:20:42.608 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:42.611 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:42.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:42.625 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-11-25T04:20:42.875 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:42.879 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:42.879 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:43.051 INFO:teuthology.orchestra.run.smithi002.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:43.055 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/046 2023-11-25T04:20:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/046 2023-11-25T04:20:43.056 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:43.059 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:43.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:43.073 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-11-25T04:20:43.324 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:43.329 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:43.329 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:43.497 INFO:teuthology.orchestra.run.smithi002.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/047 2023-11-25T04:20:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/047 2023-11-25T04:20:43.506 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:43.509 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:43.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:43.521 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-11-25T04:20:43.780 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:43.787 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:43.787 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:43.950 INFO:teuthology.orchestra.run.smithi002.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/048 2023-11-25T04:20:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/048 2023-11-25T04:20:43.957 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:43.960 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:43.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:43.972 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-11-25T04:20:44.242 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:44.247 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:44.248 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:44.405 INFO:teuthology.orchestra.run.smithi002.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/049 2023-11-25T04:20:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/049 2023-11-25T04:20:44.409 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:44.412 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:44.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:44.423 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-11-25T04:20:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:44.680 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:44.680 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:44.870 INFO:teuthology.orchestra.run.smithi002.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/050 2023-11-25T04:20:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/050 2023-11-25T04:20:44.874 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:44.878 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:44.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:44.889 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-11-25T04:20:45.141 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:45.147 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:45.148 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:45.301 INFO:teuthology.orchestra.run.smithi002.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:45.306 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/051 2023-11-25T04:20:45.306 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/051 2023-11-25T04:20:45.307 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:45.311 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:45.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:45.323 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-11-25T04:20:45.573 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:45.578 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:45.579 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:45.743 INFO:teuthology.orchestra.run.smithi002.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:45.747 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/052 2023-11-25T04:20:45.747 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/052 2023-11-25T04:20:45.747 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:45.750 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:45.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:45.762 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-11-25T04:20:46.011 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:46.017 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:46.017 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:46.166 INFO:teuthology.orchestra.run.smithi002.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:46.170 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/053 2023-11-25T04:20:46.170 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/053 2023-11-25T04:20:46.170 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:46.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:46.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:46.193 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-11-25T04:20:46.442 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:46.447 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:46.447 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:46.608 INFO:teuthology.orchestra.run.smithi002.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:46.611 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/054 2023-11-25T04:20:46.611 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/054 2023-11-25T04:20:46.611 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:46.614 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:46.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:46.627 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-11-25T04:20:46.881 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:46.886 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:46.886 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:47.060 INFO:teuthology.orchestra.run.smithi002.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:47.064 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/055 2023-11-25T04:20:47.064 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/055 2023-11-25T04:20:47.064 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:47.067 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:47.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:47.081 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-11-25T04:20:47.318 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:47.324 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:47.324 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:47.497 INFO:teuthology.orchestra.run.smithi002.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:47.502 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/056 2023-11-25T04:20:47.502 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/056 2023-11-25T04:20:47.502 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:47.504 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:47.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:47.515 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-11-25T04:20:47.774 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:47.779 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:47.779 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:47.947 INFO:teuthology.orchestra.run.smithi002.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:47.951 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/057 2023-11-25T04:20:47.951 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/057 2023-11-25T04:20:47.952 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:47.954 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:47.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:47.967 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-11-25T04:20:48.226 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:48.232 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:48.232 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:49.614 INFO:teuthology.orchestra.run.smithi002.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T04:20:49.619 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/058 2023-11-25T04:20:49.619 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/058 2023-11-25T04:20:49.619 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:49.622 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:49.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:49.646 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-11-25T04:20:50.062 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:50.068 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:50.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:50.254 INFO:teuthology.orchestra.run.smithi002.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:50.259 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/059 2023-11-25T04:20:50.259 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/059 2023-11-25T04:20:50.259 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:50.263 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:50.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:50.277 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-11-25T04:20:50.535 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:50.541 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:50.541 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:51.915 INFO:teuthology.orchestra.run.smithi002.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T04:20:51.920 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/060 2023-11-25T04:20:51.920 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/060 2023-11-25T04:20:51.920 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:51.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:51.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:51.935 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-11-25T04:20:52.364 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:52.370 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:52.370 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:52.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:20:52.831 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:20:53.702 INFO:teuthology.orchestra.run.smithi002.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T04:20:53.707 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/061 2023-11-25T04:20:53.707 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/061 2023-11-25T04:20:53.707 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:53.710 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:53.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:53.747 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-11-25T04:20:54.209 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:54.215 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:54.215 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:54.397 INFO:teuthology.orchestra.run.smithi002.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:54.401 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/062 2023-11-25T04:20:54.402 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/062 2023-11-25T04:20:54.402 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:54.405 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:54.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:54.417 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-11-25T04:20:54.702 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:54.708 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:54.708 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:56.153 INFO:teuthology.orchestra.run.smithi002.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T04:20:56.158 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/063 2023-11-25T04:20:56.158 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/063 2023-11-25T04:20:56.159 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:56.162 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:56.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:56.191 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-11-25T04:20:56.605 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:56.613 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:56.613 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:56.762 INFO:teuthology.orchestra.run.smithi002.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:56.766 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/064 2023-11-25T04:20:56.766 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/064 2023-11-25T04:20:56.766 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:56.769 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:56.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:56.781 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-11-25T04:20:57.035 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:57.042 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:57.042 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:57.219 INFO:teuthology.orchestra.run.smithi002.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:57.223 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/065 2023-11-25T04:20:57.223 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/065 2023-11-25T04:20:57.223 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:57.226 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:57.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:57.240 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-11-25T04:20:57.505 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:57.511 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:57.511 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:57.684 INFO:teuthology.orchestra.run.smithi002.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:57.688 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/066 2023-11-25T04:20:57.688 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/066 2023-11-25T04:20:57.688 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:57.691 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:57.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:57.703 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-11-25T04:20:57.950 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:57.954 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:57.954 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:58.152 INFO:teuthology.orchestra.run.smithi002.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:58.156 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/067 2023-11-25T04:20:58.156 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/067 2023-11-25T04:20:58.156 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:58.159 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:58.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:58.171 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-11-25T04:20:58.425 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:58.431 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:58.431 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:58.593 INFO:teuthology.orchestra.run.smithi002.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:58.597 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/068 2023-11-25T04:20:58.597 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/068 2023-11-25T04:20:58.597 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:58.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:58.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:58.611 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-11-25T04:20:58.854 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:58.860 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:58.860 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:59.011 INFO:teuthology.orchestra.run.smithi002.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:20:59.016 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/069 2023-11-25T04:20:59.016 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/069 2023-11-25T04:20:59.016 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:20:59.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:20:59.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:20:59.031 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-11-25T04:20:59.279 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:20:59.285 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:20:59.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:21:23.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:21:23.154 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:21:53.216 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:21:53.219 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:21:58.163 INFO:teuthology.orchestra.run.smithi002.stdout:generic/070 59s 2023-11-25T04:21:58.168 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/070 2023-11-25T04:21:58.168 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:21:58.170 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:21:58.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:21:58.179 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-11-25T04:21:58.597 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:21:58.601 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:21:58.601 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:21:58.708 INFO:teuthology.orchestra.run.smithi002.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:21:58.712 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/071 2023-11-25T04:21:58.712 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/071 2023-11-25T04:21:58.712 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:21:58.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:21:58.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:21:58.723 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-11-25T04:21:58.890 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:21:58.894 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:21:58.894 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:22:00.257 INFO:teuthology.orchestra.run.smithi002.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-25T04:22:00.261 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/072 2023-11-25T04:22:00.261 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/072 2023-11-25T04:22:00.262 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:22:00.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:22:00.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:22:00.278 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-11-25T04:22:00.523 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:22:00.528 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:22:00.528 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:22:00.717 INFO:teuthology.orchestra.run.smithi002.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:22:00.722 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/073 2023-11-25T04:22:00.722 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/073 2023-11-25T04:22:00.723 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:22:00.725 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:22:00.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:22:00.737 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-11-25T04:22:00.992 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:22:00.997 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:22:00.997 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:22:23.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:22:23.327 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:22:53.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:22:53.627 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:23:23.710 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:23:23.713 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:23:53.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:23:53.788 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:24:24.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:24:24.228 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:24:54.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:24:54.517 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:25:26.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:25:26.134 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:25:56.234 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:25:56.238 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:26:26.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:26:26.375 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:26:56.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:26:56.455 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:27:26.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:27:26.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:27:56.616 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:27:56.619 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:28:26.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:28:26.699 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:28:56.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:28:56.802 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:29:26.871 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:29:26.874 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:29:56.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:29:56.965 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:30:27.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:30:27.048 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:30:57.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:30:57.186 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:31:27.264 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:31:27.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:31:57.589 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:31:57.591 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:32:27.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:32:27.835 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:32:57.991 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:32:57.994 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:33:28.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:33:28.136 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:33:58.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:33:58.299 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:34:28.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:34:28.380 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:34:58.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:34:58.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:35:28.540 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:35:28.543 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:35:58.646 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:35:58.649 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:36:28.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:36:28.920 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:36:59.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:36:59.163 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:37:29.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:37:29.424 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:37:59.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:37:59.519 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:38:29.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:38:29.756 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:38:59.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:38:59.849 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:39:29.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:39:29.923 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:39:59.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:40:00.002 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:40:30.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:40:30.093 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:41:00.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:41:00.182 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:41:30.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:41:30.256 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:42:00.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:42:00.570 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:42:30.812 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:42:30.815 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:43:00.886 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:43:00.890 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:43:31.215 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:43:31.218 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:44:01.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:44:01.300 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:44:31.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:44:31.402 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:45:01.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:45:01.470 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:45:31.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:45:31.542 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:45:31.626 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T04:45:31.624+0000 7f24fefda640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97930) UID: 0 2023-11-25T04:45:31.627 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T04:45:31.624+0000 7f46899b2640 -1 received signal: Hangup from (PID: 97930) UID: 0 2023-11-25T04:45:31.627 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T04:45:31.624+0000 7f36e3756640 -1 Fail to open '/proc/97930/cmdline' error = (2) No such file or directory 2023-11-25T04:45:31.627 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T04:45:31.624+0000 7f36e3756640 -1 received signal: Hangup from (PID: 97930) UID: 0 2023-11-25T04:45:31.628 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T04:45:31.626+0000 7f82c4e49640 -1 Fail to open '/proc/97930/cmdline' error = (2) No such file or directory 2023-11-25T04:45:31.628 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T04:45:31.626+0000 7f82c4e49640 -1 received signal: Hangup from (PID: 97930) UID: 0 2023-11-25T04:48:40.357 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:48:40.360 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:48:40.430 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T04:48:40.428+0000 7fa32f6d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198263) UID: 0 2023-11-25T04:48:40.430 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T04:48:40.428+0000 7feffe992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198263) UID: 0 2023-11-25T04:48:40.430 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T04:48:40.428+0000 7fc60d779640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198263) UID: 0 2023-11-25T04:48:40.444 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T04:48:40.428+0000 7f7298afa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 198263) UID: 0 2023-11-25T04:50:19.740 INFO:teuthology.orchestra.run.smithi002.stdout:generic/074 1698s 2023-11-25T04:50:19.821 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/074 2023-11-25T04:50:19.821 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:50:19.823 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:50:19.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:50:19.838 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-11-25T04:50:20.585 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:50:20.589 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:50:20.589 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:50:58.325 INFO:teuthology.orchestra.run.smithi002.stdout:generic/075 38s 2023-11-25T04:50:58.358 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/075 2023-11-25T04:50:58.358 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:50:58.360 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:50:58.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:50:58.371 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-11-25T04:50:59.068 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:50:59.072 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:50:59.072 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:50:59.435 INFO:teuthology.orchestra.run.smithi002.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:50:59.439 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/076 2023-11-25T04:50:59.439 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/076 2023-11-25T04:50:59.439 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:50:59.441 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:50:59.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:50:59.450 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-11-25T04:50:59.624 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:50:59.628 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:50:59.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:02.056 INFO:teuthology.orchestra.run.smithi002.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:51:02.059 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/077 2023-11-25T04:51:02.060 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/077 2023-11-25T04:51:02.060 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:02.062 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:02.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:02.071 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-11-25T04:51:02.269 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:02.273 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:02.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:02.543 INFO:teuthology.orchestra.run.smithi002.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-25T04:51:02.547 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/078 2023-11-25T04:51:02.547 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/078 2023-11-25T04:51:02.547 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:02.549 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:02.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:02.559 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-11-25T04:51:03.008 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:03.016 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:03.016 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:03.301 INFO:teuthology.orchestra.run.smithi002.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-25T04:51:03.305 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/079 2023-11-25T04:51:03.305 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/079 2023-11-25T04:51:03.305 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:03.308 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:03.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:03.337 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-11-25T04:51:03.511 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:03.515 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:03.515 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:05.686 INFO:teuthology.orchestra.run.smithi002.stdout:generic/080 2s 2023-11-25T04:51:05.691 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/080 2023-11-25T04:51:05.692 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:05.694 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:05.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:05.704 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-11-25T04:51:05.878 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:05.882 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:05.882 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:06.001 INFO:teuthology.orchestra.run.smithi002.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:51:06.004 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/081 2023-11-25T04:51:06.004 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/081 2023-11-25T04:51:06.004 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:06.007 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:06.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:06.018 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-11-25T04:51:06.192 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:06.196 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:06.197 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:06.324 INFO:teuthology.orchestra.run.smithi002.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:51:06.331 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/082 2023-11-25T04:51:06.332 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/082 2023-11-25T04:51:06.332 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:06.332 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:06.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:06.339 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-11-25T04:51:06.512 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:06.516 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:06.516 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:06.625 INFO:teuthology.orchestra.run.smithi002.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:51:06.628 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/083 2023-11-25T04:51:06.629 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/083 2023-11-25T04:51:06.629 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:06.631 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:06.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:06.639 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-11-25T04:51:06.812 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:06.816 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:06.816 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:06.938 INFO:teuthology.orchestra.run.smithi002.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:51:06.942 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/084 2023-11-25T04:51:06.942 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/084 2023-11-25T04:51:06.942 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:06.944 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:06.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:06.955 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-11-25T04:51:07.134 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:07.138 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:07.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:07.291 INFO:teuthology.orchestra.run.smithi002.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T04:51:07.295 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/085 2023-11-25T04:51:07.295 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/085 2023-11-25T04:51:07.295 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:07.298 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:07.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:07.307 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-11-25T04:51:07.479 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:07.483 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:07.483 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:12.975 INFO:teuthology.orchestra.run.smithi002.stdout:generic/086 5s 2023-11-25T04:51:13.101 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/086 2023-11-25T04:51:13.101 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:13.103 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:13.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:13.290 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-11-25T04:51:15.339 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:15.349 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:15.349 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:15.862 INFO:teuthology.orchestra.run.smithi002.stdout:generic/087 0s 2023-11-25T04:51:15.867 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/087 2023-11-25T04:51:15.867 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:15.869 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:15.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:15.879 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-11-25T04:51:16.319 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:16.325 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:16.325 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:16.570 INFO:teuthology.orchestra.run.smithi002.stdout:generic/088 0s 2023-11-25T04:51:16.576 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/088 2023-11-25T04:51:16.576 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T04:51:16.578 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:51:16.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T04:51:16.588 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-11-25T04:51:17.059 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T04:51:17.065 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T04:51:17.065 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T04:52:11.710 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:52:11.713 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:52:41.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:52:41.810 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:53:11.889 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:53:11.892 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:53:41.946 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:53:41.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:54:12.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:54:12.332 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T04:54:12.379 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T04:54:12.377+0000 7fe9009f3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 205796) UID: 0 2023-11-25T04:54:12.379 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T04:54:12.377+0000 7f607a7b0640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 205796) UID: 0 2023-11-25T04:56:58.141 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T04:56:58.139+0000 7fa32f6d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 206011) UID: 0 2023-11-25T04:56:58.141 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T04:56:58.139+0000 7f7298afa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 206011) UID: 0 2023-11-25T04:56:58.142 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T04:56:58.139+0000 7fc60d779640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 206011) UID: 0 2023-11-25T04:56:58.142 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T04:56:58.139+0000 7feffe992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 206011) UID: 0 2023-11-25T05:01:22.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:01:22.923 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:01:23.134 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T05:01:23.132+0000 7f607a7b0640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 208053) UID: 0 2023-11-25T05:01:23.134 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T05:01:23.132+0000 7fe9009f3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 208053) UID: 0 2023-11-25T05:06:20.714 INFO:teuthology.orchestra.run.smithi002.stdout:generic/089 903s 2023-11-25T05:06:21.080 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/089 2023-11-25T05:06:21.081 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:06:21.098 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:06:21.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:06:21.427 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-11-25T05:06:24.713 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:06:24.718 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:06:24.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:06:25.722 INFO:teuthology.orchestra.run.smithi002.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:06:25.726 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/090 2023-11-25T05:06:25.726 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/090 2023-11-25T05:06:25.726 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:06:25.729 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:06:25.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:06:25.749 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-11-25T05:06:25.931 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:06:25.935 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:06:25.935 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:22.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:08:22.060 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:08:22.096 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T05:08:22.094+0000 7f24fefda640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98107) UID: 0 2023-11-25T05:08:22.097 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T05:08:22.094+0000 7f46899b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98107) UID: 0 2023-11-25T05:08:22.098 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T05:08:22.095+0000 7f36e3756640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98107) UID: 0 2023-11-25T05:08:22.098 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T05:08:22.095+0000 7f82c4e49640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98107) UID: 0 2023-11-25T05:08:22.112 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T05:08:22.111+0000 7fe9009f3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 209014) UID: 0 2023-11-25T05:08:22.113 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T05:08:22.111+0000 7f607a7b0640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 209014) UID: 0 2023-11-25T05:08:23.946 INFO:teuthology.orchestra.run.smithi002.stdout:generic/091 118s 2023-11-25T05:08:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/091 2023-11-25T05:08:23.952 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:23.954 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:23.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:23.965 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-11-25T05:08:24.458 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:24.464 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:24.464 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:24.688 INFO:teuthology.orchestra.run.smithi002.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T05:08:24.692 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/092 2023-11-25T05:08:24.692 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/092 2023-11-25T05:08:24.692 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:24.694 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:24.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:24.705 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-11-25T05:08:25.141 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:25.148 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:25.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:26.688 INFO:teuthology.orchestra.run.smithi002.stdout:generic/093 1s 2023-11-25T05:08:26.693 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/093 2023-11-25T05:08:26.693 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:26.696 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:26.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:26.706 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-11-25T05:08:27.170 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:27.175 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:27.175 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:27.335 INFO:teuthology.orchestra.run.smithi002.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:08:27.339 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/094 2023-11-25T05:08:27.339 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/094 2023-11-25T05:08:27.339 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:27.341 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:27.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:27.351 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-11-25T05:08:27.525 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:27.529 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:27.529 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:27.656 INFO:teuthology.orchestra.run.smithi002.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:08:27.659 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/095 2023-11-25T05:08:27.660 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/095 2023-11-25T05:08:27.660 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:27.662 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:27.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:27.671 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-11-25T05:08:27.846 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:27.850 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:27.850 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:27.962 INFO:teuthology.orchestra.run.smithi002.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:08:27.966 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/096 2023-11-25T05:08:27.966 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/096 2023-11-25T05:08:27.966 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:27.968 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:27.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:27.977 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-11-25T05:08:28.151 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:28.155 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:28.155 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:28.796 INFO:teuthology.orchestra.run.smithi002.stdout:generic/097 0s 2023-11-25T05:08:28.803 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/097 2023-11-25T05:08:28.803 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:28.806 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:28.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:28.815 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-11-25T05:08:28.995 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:28.999 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:28.999 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:29.108 INFO:teuthology.orchestra.run.smithi002.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:08:29.111 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/098 2023-11-25T05:08:29.111 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/098 2023-11-25T05:08:29.111 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:29.114 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:29.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:29.123 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-11-25T05:08:29.297 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:29.301 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:29.301 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:29.461 INFO:teuthology.orchestra.run.smithi002.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-25T05:08:29.465 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/099 2023-11-25T05:08:29.465 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/099 2023-11-25T05:08:29.465 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:29.467 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:29.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:29.478 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-11-25T05:08:29.653 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:29.657 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:29.657 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:57.701 INFO:teuthology.orchestra.run.smithi002.stdout:generic/100 28s 2023-11-25T05:08:57.727 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/100 2023-11-25T05:08:57.727 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:57.729 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:57.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:57.746 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-11-25T05:08:58.084 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:58.091 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:58.091 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:58.485 INFO:teuthology.orchestra.run.smithi002.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:08:58.488 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/101 2023-11-25T05:08:58.488 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/101 2023-11-25T05:08:58.488 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:58.491 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:58.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:58.500 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-11-25T05:08:58.674 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:58.678 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:58.679 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:59.245 INFO:teuthology.orchestra.run.smithi002.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:08:59.249 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/102 2023-11-25T05:08:59.249 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/102 2023-11-25T05:08:59.249 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:59.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:59.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:59.261 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-11-25T05:08:59.434 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:59.438 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:59.439 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:59.571 INFO:teuthology.orchestra.run.smithi002.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:08:59.574 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/103 2023-11-25T05:08:59.575 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/103 2023-11-25T05:08:59.575 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:59.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:59.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:59.586 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-11-25T05:08:59.760 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:08:59.764 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:08:59.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:59.905 INFO:teuthology.orchestra.run.smithi002.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:08:59.908 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/104 2023-11-25T05:08:59.908 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/104 2023-11-25T05:08:59.908 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:08:59.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:08:59.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:08:59.920 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-11-25T05:09:00.093 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:09:00.096 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:09:00.096 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:00.269 INFO:teuthology.orchestra.run.smithi002.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:09:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/105 2023-11-25T05:09:00.273 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/105 2023-11-25T05:09:00.274 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:09:00.275 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:00.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:09:00.284 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-11-25T05:09:00.454 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:09:00.458 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:09:00.458 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:00.581 INFO:teuthology.orchestra.run.smithi002.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:09:00.584 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/106 2023-11-25T05:09:00.585 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/106 2023-11-25T05:09:00.585 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:09:00.587 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:00.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:09:00.596 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-11-25T05:09:00.767 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:09:00.771 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:09:00.771 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:00.889 INFO:teuthology.orchestra.run.smithi002.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:09:00.892 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/107 2023-11-25T05:09:00.892 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/107 2023-11-25T05:09:00.893 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:09:00.895 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:00.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:09:00.904 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-11-25T05:09:01.076 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:09:01.080 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:09:01.081 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:02.282 INFO:teuthology.orchestra.run.smithi002.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:09:02.286 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/108 2023-11-25T05:09:02.287 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/108 2023-11-25T05:09:02.287 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:09:02.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:02.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:09:02.300 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-11-25T05:09:02.480 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:09:02.484 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:09:02.484 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:02.632 INFO:teuthology.orchestra.run.smithi002.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:09:02.635 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/109 2023-11-25T05:09:02.636 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/109 2023-11-25T05:09:02.636 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:09:02.638 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:02.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:09:02.648 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-11-25T05:09:03.173 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:09:03.175 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:09:03.175 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:03.556 INFO:teuthology.orchestra.run.smithi002.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:09:03.560 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/110 2023-11-25T05:09:03.560 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/110 2023-11-25T05:09:03.561 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:09:03.562 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:03.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:09:03.572 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-11-25T05:09:03.995 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:09:04.001 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:09:04.001 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:04.214 INFO:teuthology.orchestra.run.smithi002.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:09:04.216 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/111 2023-11-25T05:09:04.217 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/111 2023-11-25T05:09:04.217 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:09:04.219 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:04.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:09:04.229 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-11-25T05:09:04.657 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:09:04.662 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:09:04.663 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:49.402 INFO:teuthology.orchestra.run.smithi002.stdout:generic/112 45s 2023-11-25T05:09:49.407 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/112 2023-11-25T05:09:49.407 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:09:49.410 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:09:49.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:09:49.420 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-11-25T05:09:49.884 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:09:49.889 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:09:49.889 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:35.661 INFO:teuthology.orchestra.run.smithi002.stdout:generic/113 46s 2023-11-25T05:10:35.667 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/113 2023-11-25T05:10:35.667 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:35.669 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:35.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:35.700 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-11-25T05:10:36.137 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:36.150 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:36.151 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:36.384 INFO:teuthology.orchestra.run.smithi002.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-11-25T05:10:36.387 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/114 2023-11-25T05:10:36.387 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/114 2023-11-25T05:10:36.388 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:36.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:36.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:36.398 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-11-25T05:10:36.573 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:36.578 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:36.578 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:36.730 INFO:teuthology.orchestra.run.smithi002.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:10:36.733 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/115 2023-11-25T05:10:36.733 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/115 2023-11-25T05:10:36.734 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:36.736 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:36.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:36.745 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-11-25T05:10:37.208 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:37.214 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:37.215 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:37.386 INFO:teuthology.orchestra.run.smithi002.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:10:37.389 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/116 2023-11-25T05:10:37.390 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/116 2023-11-25T05:10:37.390 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:37.392 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:37.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:37.401 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-11-25T05:10:37.860 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:37.867 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:37.867 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:38.112 INFO:teuthology.orchestra.run.smithi002.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:10:38.117 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/117 2023-11-25T05:10:38.117 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/117 2023-11-25T05:10:38.117 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:38.118 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:38.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:38.127 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-11-25T05:10:38.303 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:38.307 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:38.307 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:38.553 INFO:teuthology.orchestra.run.smithi002.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:10:38.556 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/118 2023-11-25T05:10:38.557 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/118 2023-11-25T05:10:38.557 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:38.559 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:38.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:38.567 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-11-25T05:10:39.033 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:39.040 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:39.040 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:39.356 INFO:teuthology.orchestra.run.smithi002.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:10:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/119 2023-11-25T05:10:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/119 2023-11-25T05:10:39.360 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:39.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:39.371 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-11-25T05:10:39.839 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:39.844 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:39.972 INFO:teuthology.orchestra.run.smithi002.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:10:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/120 2023-11-25T05:10:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/120 2023-11-25T05:10:39.976 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:39.978 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:39.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:39.986 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-11-25T05:10:40.161 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:40.166 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:40.166 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:40.319 INFO:teuthology.orchestra.run.smithi002.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-25T05:10:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/121 2023-11-25T05:10:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/121 2023-11-25T05:10:40.323 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:40.325 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:40.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:40.336 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-11-25T05:10:40.801 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:40.806 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:40.806 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:40.979 INFO:teuthology.orchestra.run.smithi002.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-25T05:10:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/122 2023-11-25T05:10:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/122 2023-11-25T05:10:40.983 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:40.985 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:40.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:40.994 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-11-25T05:10:41.457 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:41.462 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:41.462 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:41.899 INFO:teuthology.orchestra.run.smithi002.stdout:generic/123 0s 2023-11-25T05:10:41.904 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/123 2023-11-25T05:10:41.905 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:41.907 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:41.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:41.917 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-11-25T05:10:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:42.391 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:42.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:42.519 INFO:teuthology.orchestra.run.smithi002.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:10:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/124 2023-11-25T05:10:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/124 2023-11-25T05:10:42.524 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:10:42.525 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:10:42.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:10:42.535 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-11-25T05:10:42.709 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:10:42.713 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:10:42.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:11:44.043 INFO:teuthology.orchestra.run.smithi002.stdout:generic/125 62s 2023-11-25T05:11:44.049 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/125 2023-11-25T05:11:44.050 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:11:44.052 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:11:44.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:11:44.074 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-11-25T05:11:44.501 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:11:44.504 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:11:44.504 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:11:45.041 INFO:teuthology.orchestra.run.smithi002.stdout:generic/126 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/126.out.bad) 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/126.out 2023-11-25 04:09:45.758124742 +0000 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/126.out.bad 2023-11-25 05:11:45.038365762 +0000 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1,7 +1,7 @@ 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 126 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-11-25T05:11:45.043 INFO:teuthology.orchestra.run.smithi002.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-11-25T05:11:45.044 INFO:teuthology.orchestra.run.smithi002.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-11-25T05:11:45.044 INFO:teuthology.orchestra.run.smithi002.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-11-25T05:11:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/126 2023-11-25T05:11:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/126 2023-11-25T05:11:45.045 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:11:45.047 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:11:45.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:11:45.056 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:11:45.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:11:45.056 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-11-25T05:11:45.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:11:45.441 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:11:45.513 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:11:45.517 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:11:45.518 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:11:45.639 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T05:11:45.638+0000 7f24fefda640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98132) UID: 0 2023-11-25T05:11:45.639 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T05:11:45.638+0000 7f46899b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98132) UID: 0 2023-11-25T05:11:45.639 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T05:11:45.638+0000 7f82c4e49640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98132) UID: 0 2023-11-25T05:11:45.640 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T05:11:45.638+0000 7f36e3756640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98132) UID: 0 2023-11-25T05:14:14.649 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:14:14.652 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:14:44.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:14:44.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:15:14.776 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:15:14.778 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:15:44.834 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:15:44.837 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:16:14.896 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:16:14.898 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:16:44.955 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:16:44.958 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:17:15.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:17:15.056 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:17:45.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:17:45.433 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:18:15.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:18:15.498 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:18:45.581 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:18:45.584 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:19:15.690 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:19:15.693 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:19:45.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:19:45.766 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:20:15.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:20:15.876 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:20:45.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:20:45.942 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:21:15.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:21:15.999 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:21:46.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:21:46.056 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:22:16.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:22:16.336 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:22:46.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:22:46.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:23:16.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:23:16.490 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:23:46.570 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:23:46.577 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:24:16.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:24:16.629 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:24:19.217 INFO:teuthology.orchestra.run.smithi002.stdout:generic/127 754s 2023-11-25T05:24:19.222 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/127 2023-11-25T05:24:19.223 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:24:19.225 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:19.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:24:19.235 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-11-25T05:24:19.657 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:24:19.660 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:24:19.660 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:19.774 INFO:teuthology.orchestra.run.smithi002.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:24:19.778 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/128 2023-11-25T05:24:19.778 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/128 2023-11-25T05:24:19.778 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:24:19.781 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:19.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:24:19.790 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-11-25T05:24:19.962 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:24:19.966 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:24:19.966 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:20.075 INFO:teuthology.orchestra.run.smithi002.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:24:20.078 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/129 2023-11-25T05:24:20.078 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/129 2023-11-25T05:24:20.078 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:24:20.081 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:20.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:24:20.089 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-11-25T05:24:20.263 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:24:20.265 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:24:20.265 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:20.379 INFO:teuthology.orchestra.run.smithi002.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:24:20.382 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/130 2023-11-25T05:24:20.383 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/130 2023-11-25T05:24:20.383 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:24:20.385 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:20.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:24:20.394 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-11-25T05:24:20.566 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:24:20.570 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:24:20.570 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:21.867 INFO:teuthology.orchestra.run.smithi002.stdout:generic/131 1s 2023-11-25T05:24:21.873 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/131 2023-11-25T05:24:21.873 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:24:21.876 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:21.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:24:21.885 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-11-25T05:24:22.325 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:24:22.330 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:24:22.330 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:22.443 INFO:teuthology.orchestra.run.smithi002.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:24:22.446 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/132 2023-11-25T05:24:22.446 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/132 2023-11-25T05:24:22.446 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:24:22.448 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:22.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:24:22.457 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-11-25T05:24:22.630 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:24:22.634 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:24:22.634 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:24:46.688 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:24:46.692 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:25:16.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:25:16.757 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:25:46.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:25:46.838 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:26:16.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:26:16.904 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:26:46.973 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:26:46.976 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:27:17.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:27:17.053 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:27:47.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:27:47.114 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:28:07.790 INFO:teuthology.orchestra.run.smithi002.stdout:generic/133 225s 2023-11-25T05:28:07.795 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/133 2023-11-25T05:28:07.796 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:07.798 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:07.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:07.808 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-11-25T05:28:08.258 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:08.262 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:08.262 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:08.442 INFO:teuthology.orchestra.run.smithi002.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:08.446 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/134 2023-11-25T05:28:08.446 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/134 2023-11-25T05:28:08.446 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:08.448 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:08.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:08.458 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-11-25T05:28:08.916 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:08.922 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:08.922 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:09.134 INFO:teuthology.orchestra.run.smithi002.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:09.135 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/135 2023-11-25T05:28:09.135 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/135 2023-11-25T05:28:09.135 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:09.137 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:09.146 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:09.146 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-11-25T05:28:09.319 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:09.324 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:09.324 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:09.480 INFO:teuthology.orchestra.run.smithi002.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:09.483 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/136 2023-11-25T05:28:09.483 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/136 2023-11-25T05:28:09.483 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:09.486 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:09.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:09.495 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-11-25T05:28:09.974 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:09.978 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:09.978 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:10.133 INFO:teuthology.orchestra.run.smithi002.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:10.136 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/137 2023-11-25T05:28:10.136 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/137 2023-11-25T05:28:10.136 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:10.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:10.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:10.148 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-11-25T05:28:10.622 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:10.626 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:10.627 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:10.779 INFO:teuthology.orchestra.run.smithi002.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:10.782 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/138 2023-11-25T05:28:10.782 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/138 2023-11-25T05:28:10.782 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:10.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:10.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:10.793 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-11-25T05:28:11.263 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:11.267 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:11.267 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:11.422 INFO:teuthology.orchestra.run.smithi002.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:11.426 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/139 2023-11-25T05:28:11.426 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/139 2023-11-25T05:28:11.426 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:11.428 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:11.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:11.438 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-11-25T05:28:11.911 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:11.915 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:11.916 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:12.068 INFO:teuthology.orchestra.run.smithi002.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:12.071 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/140 2023-11-25T05:28:12.072 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/140 2023-11-25T05:28:12.072 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:12.074 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:12.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:12.083 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-11-25T05:28:12.505 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:12.510 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:12.630 INFO:teuthology.orchestra.run.smithi002.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:12.633 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/141 2023-11-25T05:28:12.633 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/141 2023-11-25T05:28:12.633 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:12.636 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:12.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:12.645 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-11-25T05:28:12.817 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:12.821 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:12.822 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:12.977 INFO:teuthology.orchestra.run.smithi002.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:12.981 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/142 2023-11-25T05:28:12.981 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/142 2023-11-25T05:28:12.981 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:12.983 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:12.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:12.992 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-11-25T05:28:13.459 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:13.463 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:13.463 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:13.621 INFO:teuthology.orchestra.run.smithi002.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:13.625 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/143 2023-11-25T05:28:13.625 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/143 2023-11-25T05:28:13.625 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:13.627 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:13.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:13.638 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-11-25T05:28:14.116 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:14.120 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:14.120 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:14.326 INFO:teuthology.orchestra.run.smithi002.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:14.329 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/144 2023-11-25T05:28:14.329 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/144 2023-11-25T05:28:14.330 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:14.332 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:14.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:14.341 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-11-25T05:28:14.813 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:14.817 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:14.817 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:14.973 INFO:teuthology.orchestra.run.smithi002.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:14.977 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/145 2023-11-25T05:28:14.977 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/145 2023-11-25T05:28:14.977 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:14.979 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:14.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:14.989 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-11-25T05:28:15.429 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:15.433 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:15.433 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:15.588 INFO:teuthology.orchestra.run.smithi002.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:15.592 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/146 2023-11-25T05:28:15.592 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/146 2023-11-25T05:28:15.592 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:15.594 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:15.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:15.625 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-11-25T05:28:16.059 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:16.063 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:16.063 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:16.220 INFO:teuthology.orchestra.run.smithi002.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:16.224 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/147 2023-11-25T05:28:16.224 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/147 2023-11-25T05:28:16.224 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:16.225 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:16.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:16.235 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-11-25T05:28:16.707 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:16.711 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:16.711 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:16.862 INFO:teuthology.orchestra.run.smithi002.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:16.865 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/148 2023-11-25T05:28:16.865 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/148 2023-11-25T05:28:16.866 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:16.868 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:16.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:16.877 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-11-25T05:28:17.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:28:17.169 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:28:17.349 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:17.353 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:17.353 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:17.505 INFO:teuthology.orchestra.run.smithi002.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:17.508 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/149 2023-11-25T05:28:17.509 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/149 2023-11-25T05:28:17.509 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:17.511 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:17.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:17.521 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-11-25T05:28:17.992 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:17.997 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:17.997 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:18.150 INFO:teuthology.orchestra.run.smithi002.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/150 2023-11-25T05:28:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/150 2023-11-25T05:28:18.153 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:18.156 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:18.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:18.191 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-11-25T05:28:18.632 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:18.637 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:18.637 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:18.788 INFO:teuthology.orchestra.run.smithi002.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:18.792 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/151 2023-11-25T05:28:18.792 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/151 2023-11-25T05:28:18.792 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:18.794 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:18.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:18.804 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-11-25T05:28:19.267 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:19.271 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:19.271 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:19.424 INFO:teuthology.orchestra.run.smithi002.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:19.427 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/152 2023-11-25T05:28:19.428 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/152 2023-11-25T05:28:19.428 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:19.430 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:19.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:19.439 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-11-25T05:28:19.901 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:19.905 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:19.905 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:20.058 INFO:teuthology.orchestra.run.smithi002.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:20.061 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/153 2023-11-25T05:28:20.062 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/153 2023-11-25T05:28:20.062 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:20.063 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:20.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:20.116 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-11-25T05:28:20.557 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:20.561 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:20.562 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:20.713 INFO:teuthology.orchestra.run.smithi002.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:20.716 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/154 2023-11-25T05:28:20.717 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/154 2023-11-25T05:28:20.717 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:20.719 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:20.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:20.728 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-11-25T05:28:21.191 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:21.195 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:21.195 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:21.345 INFO:teuthology.orchestra.run.smithi002.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:21.348 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/155 2023-11-25T05:28:21.349 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/155 2023-11-25T05:28:21.349 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:21.351 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:21.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:21.360 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-11-25T05:28:21.810 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:21.814 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:21.815 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:21.968 INFO:teuthology.orchestra.run.smithi002.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:21.972 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/156 2023-11-25T05:28:21.972 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/156 2023-11-25T05:28:21.972 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:21.974 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:21.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:21.983 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-11-25T05:28:22.420 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:22.425 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:22.425 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:22.582 INFO:teuthology.orchestra.run.smithi002.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:22.585 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/157 2023-11-25T05:28:22.585 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/157 2023-11-25T05:28:22.585 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:22.588 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:22.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:22.597 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-11-25T05:28:23.043 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:23.044 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:23.044 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:23.207 INFO:teuthology.orchestra.run.smithi002.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:23.210 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/158 2023-11-25T05:28:23.210 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/158 2023-11-25T05:28:23.211 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:23.213 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:23.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:23.262 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-11-25T05:28:23.672 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:23.727 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:23.727 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:23.853 INFO:teuthology.orchestra.run.smithi002.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-11-25T05:28:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/159 2023-11-25T05:28:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/159 2023-11-25T05:28:23.856 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:23.858 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:23.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:23.870 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-11-25T05:28:24.042 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:24.046 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:24.047 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:24.194 INFO:teuthology.orchestra.run.smithi002.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-11-25T05:28:24.198 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/160 2023-11-25T05:28:24.198 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/160 2023-11-25T05:28:24.198 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:24.200 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:24.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:24.218 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-11-25T05:28:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:24.393 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:24.393 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:24.502 INFO:teuthology.orchestra.run.smithi002.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/161 2023-11-25T05:28:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/161 2023-11-25T05:28:24.506 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:24.508 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:24.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:24.517 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-11-25T05:28:24.691 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:24.695 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:24.695 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:24.804 INFO:teuthology.orchestra.run.smithi002.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:24.810 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/162 2023-11-25T05:28:24.810 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/162 2023-11-25T05:28:24.810 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:24.810 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:24.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:24.819 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-11-25T05:28:24.991 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:24.995 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:24.995 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:25.104 INFO:teuthology.orchestra.run.smithi002.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:25.108 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/163 2023-11-25T05:28:25.108 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/163 2023-11-25T05:28:25.108 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:25.110 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:25.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:25.120 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-11-25T05:28:25.294 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:25.298 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:25.298 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:25.406 INFO:teuthology.orchestra.run.smithi002.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:25.409 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/164 2023-11-25T05:28:25.409 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/164 2023-11-25T05:28:25.410 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:25.412 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:25.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:25.420 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-11-25T05:28:25.592 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:25.597 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:25.597 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:25.711 INFO:teuthology.orchestra.run.smithi002.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:25.715 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/165 2023-11-25T05:28:25.715 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/165 2023-11-25T05:28:25.715 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:25.719 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:25.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:25.727 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-11-25T05:28:25.899 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:25.903 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:25.903 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:26.012 INFO:teuthology.orchestra.run.smithi002.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:26.016 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/166 2023-11-25T05:28:26.016 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/166 2023-11-25T05:28:26.016 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:26.018 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:26.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:26.027 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-11-25T05:28:26.200 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:26.204 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:26.205 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:26.314 INFO:teuthology.orchestra.run.smithi002.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:26.318 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/167 2023-11-25T05:28:26.318 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/167 2023-11-25T05:28:26.318 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:26.320 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:26.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:26.329 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-11-25T05:28:26.502 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:26.506 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:26.506 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:26.615 INFO:teuthology.orchestra.run.smithi002.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:26.619 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/168 2023-11-25T05:28:26.619 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/168 2023-11-25T05:28:26.619 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:26.622 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:26.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:26.630 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-11-25T05:28:26.805 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:26.809 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:26.809 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:26.917 INFO:teuthology.orchestra.run.smithi002.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:26.921 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/169 2023-11-25T05:28:26.921 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/169 2023-11-25T05:28:26.921 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:26.923 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:26.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:26.933 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-11-25T05:28:27.105 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:27.110 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:27.110 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:27.225 INFO:teuthology.orchestra.run.smithi002.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:27.228 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/170 2023-11-25T05:28:27.228 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/170 2023-11-25T05:28:27.228 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:27.230 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:27.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:27.239 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-11-25T05:28:27.412 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:27.418 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:27.419 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:27.536 INFO:teuthology.orchestra.run.smithi002.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:27.539 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/171 2023-11-25T05:28:27.539 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/171 2023-11-25T05:28:27.539 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:27.541 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:27.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:27.551 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-11-25T05:28:27.724 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:27.729 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:27.729 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:27.843 INFO:teuthology.orchestra.run.smithi002.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:27.846 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/172 2023-11-25T05:28:27.846 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/172 2023-11-25T05:28:27.846 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:27.848 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:27.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:27.868 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-11-25T05:28:28.041 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:28.045 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:28.045 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:28.159 INFO:teuthology.orchestra.run.smithi002.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:28.162 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/173 2023-11-25T05:28:28.162 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/173 2023-11-25T05:28:28.162 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:28.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:28.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:28.174 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-11-25T05:28:28.350 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:28.354 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:28.355 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:28.467 INFO:teuthology.orchestra.run.smithi002.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:28.470 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/174 2023-11-25T05:28:28.471 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/174 2023-11-25T05:28:28.471 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:28.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:28.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:28.482 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-11-25T05:28:28.655 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:28.659 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:28.659 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:28.769 INFO:teuthology.orchestra.run.smithi002.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:28.773 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/175 2023-11-25T05:28:28.773 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/175 2023-11-25T05:28:28.773 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:28.775 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:28.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:28.794 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-11-25T05:28:28.967 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:28.971 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:28.971 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:29.081 INFO:teuthology.orchestra.run.smithi002.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:29.085 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/176 2023-11-25T05:28:29.085 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/176 2023-11-25T05:28:29.085 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:29.087 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:29.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:29.096 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-11-25T05:28:29.269 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:29.273 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:29.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:29.393 INFO:teuthology.orchestra.run.smithi002.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:29.398 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/177 2023-11-25T05:28:29.401 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/177 2023-11-25T05:28:29.401 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:29.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:29.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:29.408 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-11-25T05:28:29.582 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:29.587 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:29.587 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:29.740 INFO:teuthology.orchestra.run.smithi002.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:29.744 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/178 2023-11-25T05:28:29.744 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/178 2023-11-25T05:28:29.744 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:29.746 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:29.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:29.755 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-11-25T05:28:30.205 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:30.209 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:30.209 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:30.359 INFO:teuthology.orchestra.run.smithi002.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:30.363 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/179 2023-11-25T05:28:30.363 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/179 2023-11-25T05:28:30.363 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:30.366 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:30.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:30.374 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-11-25T05:28:30.819 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:30.824 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:30.824 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:30.986 INFO:teuthology.orchestra.run.smithi002.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:30.989 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/180 2023-11-25T05:28:30.989 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/180 2023-11-25T05:28:30.989 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:30.992 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:31.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:31.048 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-11-25T05:28:31.450 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:31.455 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:31.455 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:31.606 INFO:teuthology.orchestra.run.smithi002.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/181 2023-11-25T05:28:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/181 2023-11-25T05:28:31.610 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:31.612 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:31.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:31.621 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-11-25T05:28:32.067 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:32.074 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:32.075 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:32.228 INFO:teuthology.orchestra.run.smithi002.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-25T05:28:32.233 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/182 2023-11-25T05:28:32.233 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/182 2023-11-25T05:28:32.233 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:32.234 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:32.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:32.243 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-11-25T05:28:32.674 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:32.678 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:32.678 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:32.789 INFO:teuthology.orchestra.run.smithi002.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:32.793 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/183 2023-11-25T05:28:32.793 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/183 2023-11-25T05:28:32.793 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:32.795 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:32.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:32.804 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-11-25T05:28:32.975 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:32.979 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:32.979 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:33.142 INFO:teuthology.orchestra.run.smithi002.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/184.out.bad) 2023-11-25T05:28:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/184.out 2023-11-25 04:09:45.763124624 +0000 2023-11-25T05:28:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/184.out.bad 2023-11-25 05:28:33.139206486 +0000 2023-11-25T05:28:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1 +1,2 @@ 2023-11-25T05:28:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 184 2023-11-25T05:28:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +/tmp/tmp.qL1lhbO0Esxfstests-dev/tests/generic/184: line 23: /tmp/tmp.VDcWebYyYttest/null: Permission denied 2023-11-25T05:28:33.146 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/184 2023-11-25T05:28:33.146 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/184 2023-11-25T05:28:33.146 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:28:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:33.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:28:33.157 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:28:33.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:28:33.157 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-11-25T05:28:33.330 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:33.334 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:33.334 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:33.443 INFO:teuthology.orchestra.run.smithi002.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:33.446 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/185 2023-11-25T05:28:33.447 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/185 2023-11-25T05:28:33.447 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:33.448 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:33.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:33.471 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-11-25T05:28:33.644 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:33.648 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:33.648 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:33.757 INFO:teuthology.orchestra.run.smithi002.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:33.761 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/186 2023-11-25T05:28:33.761 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/186 2023-11-25T05:28:33.761 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:33.763 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:33.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:33.772 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-11-25T05:28:33.947 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:33.952 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:33.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:34.060 INFO:teuthology.orchestra.run.smithi002.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:34.063 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/187 2023-11-25T05:28:34.064 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/187 2023-11-25T05:28:34.064 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:34.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:34.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:34.075 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-11-25T05:28:34.247 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:34.251 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:34.251 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:34.373 INFO:teuthology.orchestra.run.smithi002.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:34.377 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/188 2023-11-25T05:28:34.377 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/188 2023-11-25T05:28:34.377 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:34.379 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:34.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:34.389 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-11-25T05:28:34.562 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:34.566 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:34.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:34.676 INFO:teuthology.orchestra.run.smithi002.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/189 2023-11-25T05:28:34.679 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/189 2023-11-25T05:28:34.680 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:34.682 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:34.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:34.691 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-11-25T05:28:34.864 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:34.871 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:34.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:34.978 INFO:teuthology.orchestra.run.smithi002.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:34.982 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/190 2023-11-25T05:28:34.982 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/190 2023-11-25T05:28:34.982 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:34.984 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:35.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:35.008 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-11-25T05:28:35.181 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:35.185 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:35.185 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:35.294 INFO:teuthology.orchestra.run.smithi002.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:35.298 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/191 2023-11-25T05:28:35.298 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/191 2023-11-25T05:28:35.298 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:35.300 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:35.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:35.310 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-11-25T05:28:35.483 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:35.487 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:35.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:35.604 INFO:teuthology.orchestra.run.smithi002.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-11-25T05:28:35.607 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/192 2023-11-25T05:28:35.607 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/192 2023-11-25T05:28:35.607 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:35.609 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:35.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:35.618 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-11-25T05:28:35.792 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:35.796 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:35.796 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:36.485 INFO:teuthology.orchestra.run.smithi002.stdout:generic/193 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/193.out.bad) 2023-11-25T05:28:36.487 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/193.out 2023-11-25 04:09:45.763124624 +0000 2023-11-25T05:28:36.487 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/193.out.bad 2023-11-25 05:28:36.483129743 +0000 2023-11-25T05:28:36.487 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -24,7 +24,6 @@ 2023-11-25T05:28:36.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:36.487 INFO:teuthology.orchestra.run.smithi002.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-11-25T05:28:36.487 INFO:teuthology.orchestra.run.smithi002.stdout: user: chmod a+r on root owned file (should fail) 2023-11-25T05:28:36.488 INFO:teuthology.orchestra.run.smithi002.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-11-25T05:28:36.488 INFO:teuthology.orchestra.run.smithi002.stdout: check that the sgid bit is cleared 2023-11-25T05:28:36.488 INFO:teuthology.orchestra.run.smithi002.stdout: -rw-rw-rw- 2023-11-25T05:28:36.488 INFO:teuthology.orchestra.run.smithi002.stdout: check that suid bit is not cleared 2023-11-25T05:28:36.489 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/193 2023-11-25T05:28:36.489 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/193 2023-11-25T05:28:36.490 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:28:36.492 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:36.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:28:36.501 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:28:36.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:28:36.501 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-11-25T05:28:36.959 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:36.963 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:36.964 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:37.073 INFO:teuthology.orchestra.run.smithi002.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:37.076 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/194 2023-11-25T05:28:37.076 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/194 2023-11-25T05:28:37.077 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:37.079 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:37.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:37.089 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-11-25T05:28:37.264 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:37.265 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:37.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:37.374 INFO:teuthology.orchestra.run.smithi002.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:37.378 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/195 2023-11-25T05:28:37.378 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/195 2023-11-25T05:28:37.378 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:37.380 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:37.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:37.389 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-11-25T05:28:37.563 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:37.567 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:37.567 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:37.676 INFO:teuthology.orchestra.run.smithi002.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:37.680 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/196 2023-11-25T05:28:37.680 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/196 2023-11-25T05:28:37.680 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:37.682 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:37.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:37.691 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-11-25T05:28:37.864 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:37.868 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:37.868 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:37.977 INFO:teuthology.orchestra.run.smithi002.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:37.981 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/197 2023-11-25T05:28:37.981 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/197 2023-11-25T05:28:37.981 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:37.983 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:37.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:37.993 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-11-25T05:28:38.165 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:38.171 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:38.171 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:38.881 INFO:teuthology.orchestra.run.smithi002.stdout:generic/198 0s 2023-11-25T05:28:38.886 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/198 2023-11-25T05:28:38.886 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:38.890 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:38.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:38.898 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-11-25T05:28:39.358 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:39.362 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:39.362 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:39.472 INFO:teuthology.orchestra.run.smithi002.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/199 2023-11-25T05:28:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/199 2023-11-25T05:28:39.476 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:39.478 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:39.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:39.488 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-11-25T05:28:39.686 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:39.691 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:39.691 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/200 2023-11-25T05:28:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/200 2023-11-25T05:28:39.803 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:39.805 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:39.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:39.815 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-11-25T05:28:39.988 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:39.993 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:39.993 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:40.101 INFO:teuthology.orchestra.run.smithi002.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/201 2023-11-25T05:28:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/201 2023-11-25T05:28:40.105 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:40.107 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:40.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:40.126 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-11-25T05:28:40.298 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:40.302 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:40.302 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:40.411 INFO:teuthology.orchestra.run.smithi002.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/202 2023-11-25T05:28:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/202 2023-11-25T05:28:40.415 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:40.417 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:40.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:40.426 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-11-25T05:28:40.601 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:40.605 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:40.605 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:40.715 INFO:teuthology.orchestra.run.smithi002.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/203 2023-11-25T05:28:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/203 2023-11-25T05:28:40.719 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:40.721 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:40.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:40.731 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-11-25T05:28:40.906 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:40.907 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:40.907 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:42.493 INFO:teuthology.orchestra.run.smithi002.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/204 2023-11-25T05:28:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/204 2023-11-25T05:28:42.496 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:42.499 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:42.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:42.519 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-11-25T05:28:42.701 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:42.705 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:42.705 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:42.818 INFO:teuthology.orchestra.run.smithi002.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/205 2023-11-25T05:28:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/205 2023-11-25T05:28:42.822 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:42.824 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:42.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:42.834 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-11-25T05:28:43.008 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:43.012 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:43.013 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:43.122 INFO:teuthology.orchestra.run.smithi002.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:28:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/206 2023-11-25T05:28:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/206 2023-11-25T05:28:43.126 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:43.128 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:43.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:43.138 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-11-25T05:28:43.310 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:43.314 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:43.315 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:47.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:28:47.263 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:28:57.402 INFO:teuthology.orchestra.run.smithi002.stdout:generic/207 14s 2023-11-25T05:28:57.407 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/207 2023-11-25T05:28:57.407 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:28:57.410 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:28:57.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:28:57.419 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-11-25T05:28:57.889 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:28:57.893 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:28:57.893 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:29:17.332 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:29:17.334 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:29:47.412 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:29:47.414 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:30:17.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:30:17.480 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:30:47.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:30:47.813 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:31:17.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:31:17.875 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:31:47.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:31:47.939 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:32:18.019 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:32:18.021 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:32:18.130 INFO:teuthology.orchestra.run.smithi002.stdout:generic/208 201s 2023-11-25T05:32:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/208 2023-11-25T05:32:18.135 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:18.138 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:18.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:18.149 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-11-25T05:32:18.554 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:18.558 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:18.559 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:26.333 INFO:teuthology.orchestra.run.smithi002.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/209.out.bad) 2023-11-25T05:32:26.343 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/209.out 2023-11-25 04:09:45.764124601 +0000 2023-11-25T05:32:26.343 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/209.out.bad 2023-11-25 05:32:26.326854784 +0000 2023-11-25T05:32:26.344 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1,2 +1,2 @@ 2023-11-25T05:32:26.344 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 209 2023-11-25T05:32:26.344 INFO:teuthology.orchestra.run.smithi002.stdout: -test ran for 30 seconds without error 2023-11-25T05:32:26.344 INFO:teuthology.orchestra.run.smithi002.stdout: +reader found old byte at pos 4096 2023-11-25T05:32:26.344 INFO:teuthology.orchestra.run.smithi002.stdout: \ No newline at end of file 2023-11-25T05:32:26.351 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/209 2023-11-25T05:32:26.351 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/209 2023-11-25T05:32:26.351 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:32:26.352 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:26.364 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:32:26.365 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:32:26.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:32:26.365 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-11-25T05:32:26.800 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:26.805 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:26.805 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:27.099 INFO:teuthology.orchestra.run.smithi002.stdout:generic/210 1s 2023-11-25T05:32:27.146 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/210 2023-11-25T05:32:27.146 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:27.148 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:27.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:27.159 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-11-25T05:32:27.592 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:27.597 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:27.597 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:27.914 INFO:teuthology.orchestra.run.smithi002.stdout:generic/211 0s 2023-11-25T05:32:27.920 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/211 2023-11-25T05:32:27.920 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:27.922 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:27.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:27.931 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-11-25T05:32:28.106 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:28.110 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:28.110 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:28.322 INFO:teuthology.orchestra.run.smithi002.stdout:generic/212 0s 2023-11-25T05:32:28.327 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/212 2023-11-25T05:32:28.328 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:28.329 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:28.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:28.338 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-11-25T05:32:28.511 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:28.515 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:28.515 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:28.939 INFO:teuthology.orchestra.run.smithi002.stdout:generic/213 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/213.out.bad) 2023-11-25T05:32:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/213.out 2023-11-25 04:09:45.765124578 +0000 2023-11-25T05:32:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/213.out.bad 2023-11-25 05:32:28.936794886 +0000 2023-11-25T05:32:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1,4 +1,3 @@ 2023-11-25T05:32:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 213 2023-11-25T05:32:28.941 INFO:teuthology.orchestra.run.smithi002.stdout: We should get: fallocate: No space left on device 2023-11-25T05:32:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-11-25T05:32:28.942 INFO:teuthology.orchestra.run.smithi002.stdout: -fallocate: No space left on device 2023-11-25T05:32:28.943 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/213 2023-11-25T05:32:28.943 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/213 2023-11-25T05:32:28.944 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:32:28.946 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:28.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:32:28.955 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:32:28.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:32:28.956 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-11-25T05:32:29.410 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:29.414 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:29.414 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:29.801 INFO:teuthology.orchestra.run.smithi002.stdout:generic/214 0s 2023-11-25T05:32:29.812 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/214 2023-11-25T05:32:29.812 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:29.815 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:29.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:29.827 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-11-25T05:32:30.321 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:30.326 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:30.327 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:33.336 INFO:teuthology.orchestra.run.smithi002.stdout:generic/215 3s 2023-11-25T05:32:33.345 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/215 2023-11-25T05:32:33.345 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:33.349 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:33.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:33.361 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-11-25T05:32:33.620 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:33.625 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:33.626 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:33.789 INFO:teuthology.orchestra.run.smithi002.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:33.793 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/216 2023-11-25T05:32:33.794 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/216 2023-11-25T05:32:33.794 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:33.797 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:33.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:33.808 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-11-25T05:32:34.060 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:34.064 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:34.064 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:34.230 INFO:teuthology.orchestra.run.smithi002.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:34.236 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/217 2023-11-25T05:32:34.236 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/217 2023-11-25T05:32:34.236 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:34.239 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:34.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:34.255 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-11-25T05:32:34.512 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:34.518 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:34.518 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:34.681 INFO:teuthology.orchestra.run.smithi002.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:34.686 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/218 2023-11-25T05:32:34.686 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/218 2023-11-25T05:32:34.686 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:34.689 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:34.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:34.701 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-11-25T05:32:34.936 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:34.942 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:34.942 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:35.105 INFO:teuthology.orchestra.run.smithi002.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:35.109 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/219 2023-11-25T05:32:35.109 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/219 2023-11-25T05:32:35.109 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:35.113 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:35.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:35.125 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-11-25T05:32:35.391 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:35.398 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:35.398 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:35.549 INFO:teuthology.orchestra.run.smithi002.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:35.555 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/220 2023-11-25T05:32:35.555 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/220 2023-11-25T05:32:35.555 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:35.557 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:35.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:35.568 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-11-25T05:32:35.841 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:35.849 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:35.849 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:37.044 INFO:teuthology.orchestra.run.smithi002.stdout:generic/221 2s 2023-11-25T05:32:37.052 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/221 2023-11-25T05:32:37.052 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:37.056 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:37.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:37.070 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-11-25T05:32:37.325 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:37.329 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:37.329 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:37.482 INFO:teuthology.orchestra.run.smithi002.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:37.486 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/222 2023-11-25T05:32:37.486 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/222 2023-11-25T05:32:37.487 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:37.489 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:37.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:37.500 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-11-25T05:32:37.748 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:37.752 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:37.752 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:37.903 INFO:teuthology.orchestra.run.smithi002.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:37.909 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/223 2023-11-25T05:32:37.909 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/223 2023-11-25T05:32:37.909 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:37.911 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:37.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:37.924 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-11-25T05:32:38.174 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:38.182 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:38.182 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:38.353 INFO:teuthology.orchestra.run.smithi002.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:38.358 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/224 2023-11-25T05:32:38.358 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/224 2023-11-25T05:32:38.358 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:38.363 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:38.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:38.372 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-11-25T05:32:38.619 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:38.624 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:38.625 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:38.776 INFO:teuthology.orchestra.run.smithi002.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:38.780 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/225 2023-11-25T05:32:38.780 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/225 2023-11-25T05:32:38.780 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:38.783 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:38.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:38.799 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-11-25T05:32:39.049 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:39.054 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:39.055 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:39.206 INFO:teuthology.orchestra.run.smithi002.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/226 2023-11-25T05:32:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/226 2023-11-25T05:32:39.211 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:39.214 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:39.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:39.231 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-11-25T05:32:39.489 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:39.494 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:39.494 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:39.654 INFO:teuthology.orchestra.run.smithi002.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/227 2023-11-25T05:32:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/227 2023-11-25T05:32:39.658 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:39.662 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:39.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:39.679 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-11-25T05:32:39.929 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:39.935 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:39.936 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:40.200 INFO:teuthology.orchestra.run.smithi002.stdout:generic/228 1s 2023-11-25T05:32:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/228 2023-11-25T05:32:40.208 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:40.211 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:40.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:40.228 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-11-25T05:32:40.669 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:40.675 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:40.675 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:40.833 INFO:teuthology.orchestra.run.smithi002.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:40.837 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/229 2023-11-25T05:32:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/229 2023-11-25T05:32:40.838 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:40.841 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:40.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:40.867 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-11-25T05:32:41.088 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:41.093 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:41.093 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:41.246 INFO:teuthology.orchestra.run.smithi002.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:41.251 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/230 2023-11-25T05:32:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/230 2023-11-25T05:32:41.252 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:41.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:41.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:41.270 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-11-25T05:32:41.537 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:41.542 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:41.542 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:41.697 INFO:teuthology.orchestra.run.smithi002.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:41.702 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/231 2023-11-25T05:32:41.702 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/231 2023-11-25T05:32:41.702 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:41.705 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:41.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:41.717 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-11-25T05:32:41.977 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:41.982 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:41.983 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/232 2023-11-25T05:32:42.155 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/232 2023-11-25T05:32:42.156 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:42.156 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:42.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:42.163 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-11-25T05:32:42.400 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:42.405 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:42.406 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:42.566 INFO:teuthology.orchestra.run.smithi002.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:42.570 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/233 2023-11-25T05:32:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/233 2023-11-25T05:32:42.571 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:42.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:42.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:42.590 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-11-25T05:32:42.853 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:42.859 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:42.859 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:43.015 INFO:teuthology.orchestra.run.smithi002.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/234 2023-11-25T05:32:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/234 2023-11-25T05:32:43.019 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:43.027 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:43.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:43.039 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-11-25T05:32:43.297 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:43.302 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:43.302 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:43.459 INFO:teuthology.orchestra.run.smithi002.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/235 2023-11-25T05:32:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/235 2023-11-25T05:32:43.465 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:43.468 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:43.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:43.480 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-11-25T05:32:43.741 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:43.746 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:43.747 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:45.027 INFO:teuthology.orchestra.run.smithi002.stdout:generic/236 2s 2023-11-25T05:32:45.034 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/236 2023-11-25T05:32:45.190 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:45.191 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:45.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:45.192 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-11-25T05:32:45.553 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:45.563 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:45.563 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:45.783 INFO:teuthology.orchestra.run.smithi002.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-25T05:32:45.786 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/237 2023-11-25T05:32:45.787 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/237 2023-11-25T05:32:45.787 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:45.790 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:45.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:45.802 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-11-25T05:32:46.058 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:46.062 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:46.062 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:46.230 INFO:teuthology.orchestra.run.smithi002.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:32:46.235 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/238 2023-11-25T05:32:46.235 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/238 2023-11-25T05:32:46.236 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:32:46.238 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:46.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:32:46.253 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-11-25T05:32:46.501 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:32:46.507 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:32:46.507 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:32:48.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:32:48.092 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:33:18.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:33:18.162 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:33:48.233 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:33:48.236 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:34:18.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:34:18.335 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:34:48.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:34:48.424 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:35:03.432 INFO:teuthology.orchestra.run.smithi002.stdout:generic/239 137s 2023-11-25T05:35:03.445 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/239 2023-11-25T05:35:03.445 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:35:03.448 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:35:03.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:35:03.463 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-11-25T05:35:03.938 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:35:03.944 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:35:03.944 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:35:06.807 INFO:teuthology.orchestra.run.smithi002.stdout:generic/240 3s 2023-11-25T05:35:06.814 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/240 2023-11-25T05:35:06.815 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:35:06.817 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:35:06.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:35:06.831 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-11-25T05:35:07.304 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:35:07.310 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:35:07.311 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:35:18.770 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:35:18.773 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:35:48.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:35:48.864 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:36:19.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:36:19.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:36:20.744 INFO:teuthology.orchestra.run.smithi002.stdout:generic/241 73s 2023-11-25T05:36:20.778 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/241 2023-11-25T05:36:20.779 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:36:20.781 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:20.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:36:20.809 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-11-25T05:36:23.352 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:36:23.357 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:36:23.357 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:23.882 INFO:teuthology.orchestra.run.smithi002.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:36:23.887 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/242 2023-11-25T05:36:23.888 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/242 2023-11-25T05:36:23.888 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:36:23.890 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:23.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:36:23.902 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-11-25T05:36:24.164 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:36:24.169 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:36:24.169 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:24.348 INFO:teuthology.orchestra.run.smithi002.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:36:24.352 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/243 2023-11-25T05:36:24.352 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/243 2023-11-25T05:36:24.352 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:36:24.354 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:24.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:36:24.369 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-11-25T05:36:24.629 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:36:24.634 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:36:24.634 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:24.958 INFO:teuthology.orchestra.run.smithi002.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-25T05:36:24.962 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/244 2023-11-25T05:36:24.962 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/244 2023-11-25T05:36:24.963 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:36:24.965 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:24.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:36:24.979 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-11-25T05:36:25.248 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:36:25.254 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:36:25.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:25.554 INFO:teuthology.orchestra.run.smithi002.stdout:generic/245 0s 2023-11-25T05:36:25.561 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/245 2023-11-25T05:36:25.562 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:36:25.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:25.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:36:25.578 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-11-25T05:36:26.050 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:36:26.055 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:36:26.055 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:26.308 INFO:teuthology.orchestra.run.smithi002.stdout:generic/246 0s 2023-11-25T05:36:26.315 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/246 2023-11-25T05:36:26.315 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:36:26.318 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:26.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:36:26.331 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-11-25T05:36:26.818 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:36:26.824 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:36:26.825 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:36:49.647 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:36:49.650 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:37:12.071 INFO:teuthology.orchestra.run.smithi002.stdout:generic/247 46s 2023-11-25T05:37:12.079 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/247 2023-11-25T05:37:12.080 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:12.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:12.094 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-11-25T05:37:12.338 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:12.349 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:12.618 INFO:teuthology.orchestra.run.smithi002.stdout:generic/248 0s 2023-11-25T05:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/248 2023-11-25T05:37:12.626 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:12.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:12.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:12.644 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-11-25T05:37:12.884 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:12.889 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:12.890 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:15.158 INFO:teuthology.orchestra.run.smithi002.stdout:generic/249 3s 2023-11-25T05:37:15.163 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/249 2023-11-25T05:37:15.163 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:15.164 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:15.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:15.182 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-11-25T05:37:15.641 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:15.648 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:15.648 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:15.866 INFO:teuthology.orchestra.run.smithi002.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:15.870 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/250 2023-11-25T05:37:15.871 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/250 2023-11-25T05:37:15.871 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:15.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:15.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:15.886 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-11-25T05:37:16.134 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:16.139 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:16.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:16.335 INFO:teuthology.orchestra.run.smithi002.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:16.340 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/251 2023-11-25T05:37:16.340 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/251 2023-11-25T05:37:16.340 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:16.343 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:16.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:16.357 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-11-25T05:37:16.609 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:16.614 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:16.614 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:16.785 INFO:teuthology.orchestra.run.smithi002.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:16.789 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/252 2023-11-25T05:37:16.789 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/252 2023-11-25T05:37:16.789 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:16.791 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:16.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:16.807 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-11-25T05:37:17.071 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:17.076 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:17.076 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:17.234 INFO:teuthology.orchestra.run.smithi002.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:17.238 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/253 2023-11-25T05:37:17.238 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/253 2023-11-25T05:37:17.238 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:17.242 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:17.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:17.257 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-11-25T05:37:17.508 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:17.514 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:17.514 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:17.685 INFO:teuthology.orchestra.run.smithi002.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/254 2023-11-25T05:37:17.689 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/254 2023-11-25T05:37:17.690 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:17.692 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:17.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:17.706 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-11-25T05:37:17.954 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:17.960 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:17.960 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:19.345 INFO:teuthology.orchestra.run.smithi002.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T05:37:19.349 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/255 2023-11-25T05:37:19.350 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/255 2023-11-25T05:37:19.350 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:19.353 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:19.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:19.377 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-11-25T05:37:19.718 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:37:19.721 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:37:19.849 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:19.857 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:19.857 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:21.193 INFO:teuthology.orchestra.run.smithi002.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:21.198 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/256 2023-11-25T05:37:21.198 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/256 2023-11-25T05:37:21.198 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:21.202 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:21.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:21.214 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-11-25T05:37:21.470 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:21.475 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:21.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:23.183 INFO:teuthology.orchestra.run.smithi002.stdout:generic/257 2s 2023-11-25T05:37:23.191 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/257 2023-11-25T05:37:23.191 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:23.194 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:23.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:23.205 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-11-25T05:37:23.677 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:23.684 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:23.684 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:23.911 INFO:teuthology.orchestra.run.smithi002.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/258.out.bad) 2023-11-25T05:37:23.914 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/258.out 2023-11-25 04:09:45.768124507 +0000 2023-11-25T05:37:23.914 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/258.out.bad 2023-11-25 05:37:23.909023459 +0000 2023-11-25T05:37:23.914 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1,5 +1,6 @@ 2023-11-25T05:37:23.914 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 258 2023-11-25T05:37:23.914 INFO:teuthology.orchestra.run.smithi002.stdout: Creating file with timestamp of Jan 1, 1960 2023-11-25T05:37:23.914 INFO:teuthology.orchestra.run.smithi002.stdout: Testing for negative seconds since epoch 2023-11-25T05:37:23.914 INFO:teuthology.orchestra.run.smithi002.stdout: -Remounting to flush cache 2023-11-25T05:37:23.914 INFO:teuthology.orchestra.run.smithi002.stdout: -Testing for negative seconds since epoch 2023-11-25T05:37:23.914 INFO:teuthology.orchestra.run.smithi002.stdout: +Timestamp wrapped: 3979351756 2023-11-25T05:37:23.915 INFO:teuthology.orchestra.run.smithi002.stdout: +Timestamp wrapped 2023-11-25T05:37:23.915 INFO:teuthology.orchestra.run.smithi002.stdout: +(see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/258.full for details) 2023-11-25T05:37:23.917 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/258 2023-11-25T05:37:23.917 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/258 2023-11-25T05:37:23.917 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:37:23.920 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:23.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:37:23.931 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:37:23.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:37:23.931 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-11-25T05:37:24.189 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:24.194 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:24.194 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:24.358 INFO:teuthology.orchestra.run.smithi002.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:24.358 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/259 2023-11-25T05:37:24.358 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/259 2023-11-25T05:37:24.358 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:24.361 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:24.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:24.378 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-11-25T05:37:24.635 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:24.641 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:24.641 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:24.799 INFO:teuthology.orchestra.run.smithi002.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:24.804 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/260 2023-11-25T05:37:24.804 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/260 2023-11-25T05:37:24.804 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:24.807 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:24.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:24.821 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-11-25T05:37:25.092 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:25.098 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:25.098 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:25.238 INFO:teuthology.orchestra.run.smithi002.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/261 2023-11-25T05:37:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/261 2023-11-25T05:37:25.243 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:25.245 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:25.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:25.257 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-11-25T05:37:25.505 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:25.510 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:25.510 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:25.659 INFO:teuthology.orchestra.run.smithi002.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:37:25.664 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/262 2023-11-25T05:37:25.664 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/262 2023-11-25T05:37:25.664 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:37:25.667 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:25.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:37:25.681 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-11-25T05:37:25.917 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:37:25.923 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:37:25.924 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:37:49.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:37:49.813 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:38:19.880 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:38:19.883 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:38:28.157 INFO:teuthology.orchestra.run.smithi002.stdout:generic/263 63s 2023-11-25T05:38:28.163 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/263 2023-11-25T05:38:28.163 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:28.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:28.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:28.175 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-11-25T05:38:28.624 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:28.629 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:28.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:28.745 INFO:teuthology.orchestra.run.smithi002.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:28.749 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/264 2023-11-25T05:38:28.749 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/264 2023-11-25T05:38:28.749 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:28.751 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:28.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:28.760 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-11-25T05:38:28.932 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:28.937 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:28.937 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:29.104 INFO:teuthology.orchestra.run.smithi002.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:29.107 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/265 2023-11-25T05:38:29.107 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/265 2023-11-25T05:38:29.107 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:29.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:29.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:29.118 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-11-25T05:38:29.290 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:29.295 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:29.295 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:29.424 INFO:teuthology.orchestra.run.smithi002.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:29.428 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/266 2023-11-25T05:38:29.428 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/266 2023-11-25T05:38:29.428 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:29.430 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:29.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:29.439 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-11-25T05:38:29.613 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:29.618 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:29.618 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:29.737 INFO:teuthology.orchestra.run.smithi002.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:29.741 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/267 2023-11-25T05:38:29.741 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/267 2023-11-25T05:38:29.741 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:29.743 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:29.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:29.752 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-11-25T05:38:29.925 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:29.929 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:29.929 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:30.049 INFO:teuthology.orchestra.run.smithi002.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:30.052 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/268 2023-11-25T05:38:30.053 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/268 2023-11-25T05:38:30.053 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:30.055 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:30.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:30.063 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-11-25T05:38:30.237 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:30.240 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:30.240 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:30.354 INFO:teuthology.orchestra.run.smithi002.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:30.357 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/269 2023-11-25T05:38:30.357 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/269 2023-11-25T05:38:30.358 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:30.360 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:30.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:30.369 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-11-25T05:38:30.542 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:30.547 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:30.547 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:30.658 INFO:teuthology.orchestra.run.smithi002.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-25T05:38:30.662 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/270 2023-11-25T05:38:30.662 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/270 2023-11-25T05:38:30.662 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:30.664 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:30.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:30.673 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-11-25T05:38:30.848 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:30.851 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:30.852 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:30.977 INFO:teuthology.orchestra.run.smithi002.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:30.981 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/271 2023-11-25T05:38:30.981 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/271 2023-11-25T05:38:30.981 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:30.983 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:30.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:30.992 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-11-25T05:38:31.165 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:31.169 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:31.169 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:31.294 INFO:teuthology.orchestra.run.smithi002.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:31.297 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/272 2023-11-25T05:38:31.297 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/272 2023-11-25T05:38:31.297 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:31.301 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:31.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:31.308 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-11-25T05:38:31.483 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:31.487 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:31.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:31.597 INFO:teuthology.orchestra.run.smithi002.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:31.600 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/273 2023-11-25T05:38:31.600 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/273 2023-11-25T05:38:31.600 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:31.602 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:31.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:31.611 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-11-25T05:38:31.784 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:31.788 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:31.788 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:31.898 INFO:teuthology.orchestra.run.smithi002.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:31.901 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/274 2023-11-25T05:38:31.901 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/274 2023-11-25T05:38:31.901 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:31.904 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:31.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:31.914 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-11-25T05:38:32.086 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:32.090 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:32.090 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:32.204 INFO:teuthology.orchestra.run.smithi002.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:32.208 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/275 2023-11-25T05:38:32.208 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/275 2023-11-25T05:38:32.208 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:32.210 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:32.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:32.220 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-11-25T05:38:32.395 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:32.399 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:32.399 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:32.536 INFO:teuthology.orchestra.run.smithi002.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:32.540 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/276 2023-11-25T05:38:32.540 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/276 2023-11-25T05:38:32.540 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:32.542 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:32.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:32.551 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-11-25T05:38:32.724 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:32.728 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:32.728 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:32.843 INFO:teuthology.orchestra.run.smithi002.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:32.847 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/277 2023-11-25T05:38:32.847 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/277 2023-11-25T05:38:32.847 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:32.849 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:32.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:32.858 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-11-25T05:38:33.031 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:33.035 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:33.035 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:33.159 INFO:teuthology.orchestra.run.smithi002.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:33.162 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/278 2023-11-25T05:38:33.162 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/278 2023-11-25T05:38:33.162 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:33.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:33.174 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-11-25T05:38:33.348 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:33.352 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:33.353 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:33.474 INFO:teuthology.orchestra.run.smithi002.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:33.477 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/279 2023-11-25T05:38:33.477 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/279 2023-11-25T05:38:33.477 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:33.480 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:33.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:33.488 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-11-25T05:38:33.661 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:33.665 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:33.665 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:33.918 INFO:teuthology.orchestra.run.smithi002.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:33.921 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/280 2023-11-25T05:38:33.922 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/280 2023-11-25T05:38:33.922 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:33.924 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:33.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:33.933 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-11-25T05:38:34.105 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:34.109 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:34.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:34.247 INFO:teuthology.orchestra.run.smithi002.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:34.251 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/281 2023-11-25T05:38:34.251 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/281 2023-11-25T05:38:34.251 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:34.253 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:34.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:34.262 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-11-25T05:38:34.437 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:34.441 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:34.441 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:34.565 INFO:teuthology.orchestra.run.smithi002.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:34.569 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/282 2023-11-25T05:38:34.569 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/282 2023-11-25T05:38:34.569 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:34.571 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:34.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:34.590 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-11-25T05:38:34.762 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:34.766 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:34.766 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:34.887 INFO:teuthology.orchestra.run.smithi002.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/283 2023-11-25T05:38:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/283 2023-11-25T05:38:34.891 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:34.893 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:34.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:34.902 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-11-25T05:38:35.074 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:35.079 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:35.079 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:35.198 INFO:teuthology.orchestra.run.smithi002.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:38:35.202 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/284 2023-11-25T05:38:35.202 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/284 2023-11-25T05:38:35.202 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:35.204 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:35.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:35.213 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-11-25T05:38:35.387 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:35.391 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:35.391 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:37.004 INFO:teuthology.orchestra.run.smithi002.stdout:generic/285 1s 2023-11-25T05:38:37.009 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/285 2023-11-25T05:38:37.009 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:38:37.012 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:37.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:38:37.021 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-11-25T05:38:37.445 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:38:37.449 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:38:37.450 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:38:49.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:38:49.956 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:39:09.288 INFO:teuthology.orchestra.run.smithi002.stdout:generic/286 32s 2023-11-25T05:39:09.293 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/286 2023-11-25T05:39:09.293 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:09.295 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:09.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:09.304 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-11-25T05:39:09.743 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:09.748 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:09.748 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:09.869 INFO:teuthology.orchestra.run.smithi002.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:09.873 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/287 2023-11-25T05:39:09.873 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/287 2023-11-25T05:39:09.873 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:09.875 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:09.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:09.884 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-11-25T05:39:10.112 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:10.118 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:10.118 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:10.271 INFO:teuthology.orchestra.run.smithi002.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:10.276 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/288 2023-11-25T05:39:10.276 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/288 2023-11-25T05:39:10.277 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:10.280 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:10.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:10.291 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-11-25T05:39:10.466 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:10.470 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:10.471 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:10.593 INFO:teuthology.orchestra.run.smithi002.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:10.598 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/289 2023-11-25T05:39:10.598 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/289 2023-11-25T05:39:10.598 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:10.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:10.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:10.608 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-11-25T05:39:10.782 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:10.787 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:10.787 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:10.896 INFO:teuthology.orchestra.run.smithi002.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:10.900 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/290 2023-11-25T05:39:10.900 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/290 2023-11-25T05:39:10.900 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:10.902 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:10.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:10.911 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-11-25T05:39:11.084 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:11.088 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:11.088 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:11.198 INFO:teuthology.orchestra.run.smithi002.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:11.201 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/291 2023-11-25T05:39:11.202 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/291 2023-11-25T05:39:11.202 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:11.204 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:11.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:11.213 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-11-25T05:39:11.385 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:11.389 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:11.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:11.498 INFO:teuthology.orchestra.run.smithi002.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:11.502 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/292 2023-11-25T05:39:11.502 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/292 2023-11-25T05:39:11.502 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:11.504 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:11.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:11.513 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-11-25T05:39:11.687 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:11.691 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:11.691 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:11.801 INFO:teuthology.orchestra.run.smithi002.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:11.805 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/293 2023-11-25T05:39:11.805 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/293 2023-11-25T05:39:11.805 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:11.807 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:11.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:11.816 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-11-25T05:39:11.990 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:11.994 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:11.994 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:12.147 INFO:teuthology.orchestra.run.smithi002.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:12.151 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/294 2023-11-25T05:39:12.151 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/294 2023-11-25T05:39:12.151 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:12.153 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:12.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:12.162 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-11-25T05:39:12.335 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:12.339 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:12.339 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:12.483 INFO:teuthology.orchestra.run.smithi002.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:12.487 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/295 2023-11-25T05:39:12.487 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/295 2023-11-25T05:39:12.487 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:12.490 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:12.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:12.498 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-11-25T05:39:12.671 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:12.675 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:12.676 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:12.811 INFO:teuthology.orchestra.run.smithi002.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:12.814 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/296 2023-11-25T05:39:12.814 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/296 2023-11-25T05:39:12.814 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:12.817 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:12.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:12.826 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-11-25T05:39:12.998 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:13.002 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:13.002 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:13.502 INFO:teuthology.orchestra.run.smithi002.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:13.505 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/297 2023-11-25T05:39:13.505 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/297 2023-11-25T05:39:13.505 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:13.508 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:13.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:13.519 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-11-25T05:39:13.703 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:13.706 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:13.706 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:14.067 INFO:teuthology.orchestra.run.smithi002.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:14.071 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/298 2023-11-25T05:39:14.071 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/298 2023-11-25T05:39:14.071 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:14.074 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:14.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:14.083 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-11-25T05:39:14.256 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:14.261 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:14.261 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:14.415 INFO:teuthology.orchestra.run.smithi002.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:14.419 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/299 2023-11-25T05:39:14.419 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/299 2023-11-25T05:39:14.419 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:14.421 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:14.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:14.430 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-11-25T05:39:14.607 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:14.612 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:14.612 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:14.769 INFO:teuthology.orchestra.run.smithi002.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:14.773 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/300 2023-11-25T05:39:14.773 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/300 2023-11-25T05:39:14.773 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:14.776 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:14.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:14.784 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-11-25T05:39:14.958 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:14.962 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:14.962 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:15.263 INFO:teuthology.orchestra.run.smithi002.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:15.267 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/301 2023-11-25T05:39:15.267 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/301 2023-11-25T05:39:15.267 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:15.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:15.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:15.278 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-11-25T05:39:15.453 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:15.457 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:15.458 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:15.591 INFO:teuthology.orchestra.run.smithi002.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:15.594 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/302 2023-11-25T05:39:15.594 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/302 2023-11-25T05:39:15.594 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:15.597 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:15.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:15.605 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-11-25T05:39:15.778 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:15.782 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:15.782 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:16.139 INFO:teuthology.orchestra.run.smithi002.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:39:16.143 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/303 2023-11-25T05:39:16.143 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/303 2023-11-25T05:39:16.143 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:16.145 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:16.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:16.181 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-11-25T05:39:16.591 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:16.598 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:16.598 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:16.764 INFO:teuthology.orchestra.run.smithi002.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-25T05:39:16.768 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/304 2023-11-25T05:39:16.768 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/304 2023-11-25T05:39:16.768 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:16.770 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:16.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:16.780 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-11-25T05:39:17.225 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:17.230 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:17.230 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:17.539 INFO:teuthology.orchestra.run.smithi002.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:17.542 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/305 2023-11-25T05:39:17.543 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/305 2023-11-25T05:39:17.543 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:17.545 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:17.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:17.564 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-11-25T05:39:18.106 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:18.109 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:18.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:18.302 INFO:teuthology.orchestra.run.smithi002.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:18.304 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/306 2023-11-25T05:39:18.304 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/306 2023-11-25T05:39:18.304 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:18.307 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:18.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:18.316 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-11-25T05:39:18.498 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:18.502 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:18.502 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:18.622 INFO:teuthology.orchestra.run.smithi002.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:39:18.624 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/307 2023-11-25T05:39:18.624 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/307 2023-11-25T05:39:18.624 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:18.626 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:18.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:18.638 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-11-25T05:39:18.828 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:18.831 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:18.831 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:18.985 INFO:teuthology.orchestra.run.smithi002.stdout:generic/308 0s 2023-11-25T05:39:18.990 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/308 2023-11-25T05:39:18.990 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:18.992 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:19.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:19.001 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-11-25T05:39:19.177 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:19.180 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:19.180 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:20.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:39:20.022 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:39:20.384 INFO:teuthology.orchestra.run.smithi002.stdout:generic/309 1s 2023-11-25T05:39:20.391 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/309 2023-11-25T05:39:20.391 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:39:20.393 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:20.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:39:20.404 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-11-25T05:39:20.853 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:39:20.858 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:39:20.858 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:39:50.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:39:50.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:40:20.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:40:20.159 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:40:41.357 INFO:teuthology.orchestra.run.smithi002.stdout:generic/310 81s 2023-11-25T05:40:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/310 2023-11-25T05:40:41.372 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:41.374 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:41.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:41.388 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-11-25T05:40:41.579 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:41.583 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:41.583 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:42.479 INFO:teuthology.orchestra.run.smithi002.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:40:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/311 2023-11-25T05:40:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/311 2023-11-25T05:40:42.483 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:42.485 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:42.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:42.494 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-11-25T05:40:42.668 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:42.672 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:42.672 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:42.979 INFO:teuthology.orchestra.run.smithi002.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:40:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/312 2023-11-25T05:40:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/312 2023-11-25T05:40:42.983 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:42.985 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:42.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:42.994 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-11-25T05:40:43.168 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:43.172 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:43.172 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:47.741 INFO:teuthology.orchestra.run.smithi002.stdout:generic/313 4s 2023-11-25T05:40:47.748 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/313 2023-11-25T05:40:47.748 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:47.751 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:47.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:47.772 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-11-25T05:40:47.955 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:47.959 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:47.959 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:48.492 INFO:teuthology.orchestra.run.smithi002.stdout:generic/314 1s 2023-11-25T05:40:48.497 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/314 2023-11-25T05:40:48.497 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:48.500 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:48.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:48.509 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-11-25T05:40:48.684 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:48.688 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:48.688 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:50.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:40:50.421 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:40:51.787 INFO:teuthology.orchestra.run.smithi002.stdout:generic/315 3s 2023-11-25T05:40:51.794 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/315 2023-11-25T05:40:51.794 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:51.796 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:51.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:51.807 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-11-25T05:40:52.264 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:52.269 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:52.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:53.222 INFO:teuthology.orchestra.run.smithi002.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T05:40:53.226 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/316 2023-11-25T05:40:53.226 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/316 2023-11-25T05:40:53.226 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:53.228 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:53.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:53.237 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-11-25T05:40:53.682 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:53.691 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:53.691 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:53.830 INFO:teuthology.orchestra.run.smithi002.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:40:53.834 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/317 2023-11-25T05:40:53.834 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/317 2023-11-25T05:40:53.834 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:53.836 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:53.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:53.845 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-11-25T05:40:54.027 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:54.031 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:54.031 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:54.150 INFO:teuthology.orchestra.run.smithi002.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:40:54.154 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/318 2023-11-25T05:40:54.154 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/318 2023-11-25T05:40:54.154 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:54.156 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:54.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:54.165 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-11-25T05:40:54.344 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:54.348 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:54.348 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:54.493 INFO:teuthology.orchestra.run.smithi002.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-25T05:40:54.497 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/319 2023-11-25T05:40:54.497 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/319 2023-11-25T05:40:54.497 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:54.500 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:54.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:54.508 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-11-25T05:40:54.686 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:54.690 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:54.690 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:54.803 INFO:teuthology.orchestra.run.smithi002.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:40:54.806 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/320 2023-11-25T05:40:54.806 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/320 2023-11-25T05:40:54.806 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:54.808 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:54.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:54.817 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-11-25T05:40:54.992 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:54.997 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:54.997 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:55.137 INFO:teuthology.orchestra.run.smithi002.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:40:55.140 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/321 2023-11-25T05:40:55.140 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/321 2023-11-25T05:40:55.140 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:55.143 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:55.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:55.151 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-11-25T05:40:55.326 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:55.330 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:55.330 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:55.448 INFO:teuthology.orchestra.run.smithi002.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:40:55.451 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/322 2023-11-25T05:40:55.451 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/322 2023-11-25T05:40:55.452 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:40:55.454 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:40:55.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:40:55.462 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-11-25T05:40:55.637 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:40:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:40:55.642 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:41:20.952 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:41:20.955 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:41:51.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:41:51.047 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:42:21.117 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:42:21.120 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:42:51.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:42:51.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:42:51.772 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T05:42:51.771+0000 7f24fefda640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99201) UID: 0 2023-11-25T05:42:51.772 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T05:42:51.771+0000 7f36e3756640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99201) UID: 0 2023-11-25T05:42:51.773 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T05:42:51.771+0000 7f82c4e49640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99201) UID: 0 2023-11-25T05:42:51.773 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T05:42:51.771+0000 7f46899b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99201) UID: 0 2023-11-25T05:42:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:generic/323 121s 2023-11-25T05:42:56.382 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/323 2023-11-25T05:42:56.382 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:56.384 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:56.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:56.397 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-11-25T05:42:56.847 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:56.850 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:56.851 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:56.986 INFO:teuthology.orchestra.run.smithi002.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:56.989 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/324 2023-11-25T05:42:56.990 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/324 2023-11-25T05:42:56.990 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:56.992 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:57.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:57.000 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-11-25T05:42:57.174 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:57.178 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:57.178 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:57.325 INFO:teuthology.orchestra.run.smithi002.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:57.329 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/325 2023-11-25T05:42:57.329 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/325 2023-11-25T05:42:57.329 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:57.331 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:57.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:57.340 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-11-25T05:42:57.515 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:57.519 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:57.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:57.637 INFO:teuthology.orchestra.run.smithi002.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:57.640 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/326 2023-11-25T05:42:57.640 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/326 2023-11-25T05:42:57.640 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:57.643 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:57.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:57.651 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-11-25T05:42:57.827 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:57.831 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:57.831 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:57.946 INFO:teuthology.orchestra.run.smithi002.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:57.949 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/327 2023-11-25T05:42:57.949 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/327 2023-11-25T05:42:57.950 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:57.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:57.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:57.960 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-11-25T05:42:58.132 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:58.136 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:58.137 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:58.252 INFO:teuthology.orchestra.run.smithi002.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:58.255 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/328 2023-11-25T05:42:58.255 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/328 2023-11-25T05:42:58.255 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:58.258 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:58.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:58.266 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-11-25T05:42:58.440 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:58.444 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:58.444 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:58.582 INFO:teuthology.orchestra.run.smithi002.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:58.586 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/329 2023-11-25T05:42:58.586 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/329 2023-11-25T05:42:58.586 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:58.588 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:58.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:58.597 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-11-25T05:42:58.772 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:58.776 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:58.776 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:58.892 INFO:teuthology.orchestra.run.smithi002.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:58.895 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/330 2023-11-25T05:42:58.895 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/330 2023-11-25T05:42:58.895 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:58.898 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:58.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:58.906 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-11-25T05:42:59.080 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:59.084 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:59.084 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:59.208 INFO:teuthology.orchestra.run.smithi002.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:59.212 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/331 2023-11-25T05:42:59.212 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/331 2023-11-25T05:42:59.212 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:59.214 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:59.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:59.223 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-11-25T05:42:59.397 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:59.401 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:59.401 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:59.511 INFO:teuthology.orchestra.run.smithi002.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:59.514 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/332 2023-11-25T05:42:59.515 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/332 2023-11-25T05:42:59.515 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:59.517 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:59.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:59.525 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-11-25T05:42:59.700 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:42:59.705 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:42:59.705 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:59.814 INFO:teuthology.orchestra.run.smithi002.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:42:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/333 2023-11-25T05:42:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/333 2023-11-25T05:42:59.818 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:42:59.821 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:42:59.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:42:59.829 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-11-25T05:43:00.003 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:00.007 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:00.007 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:00.117 INFO:teuthology.orchestra.run.smithi002.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/334 2023-11-25T05:43:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/334 2023-11-25T05:43:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:00.122 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:00.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:00.131 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-11-25T05:43:00.305 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:00.309 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:00.309 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:00.428 INFO:teuthology.orchestra.run.smithi002.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:00.431 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/335 2023-11-25T05:43:00.431 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/335 2023-11-25T05:43:00.432 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:00.434 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:00.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:00.442 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-11-25T05:43:00.615 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:00.619 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:00.620 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:00.742 INFO:teuthology.orchestra.run.smithi002.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:00.745 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/336 2023-11-25T05:43:00.745 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/336 2023-11-25T05:43:00.745 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:00.748 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:00.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:00.756 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-11-25T05:43:00.929 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:00.933 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:00.934 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:01.044 INFO:teuthology.orchestra.run.smithi002.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:01.047 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/337 2023-11-25T05:43:01.047 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/337 2023-11-25T05:43:01.047 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:01.050 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:01.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:01.058 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-11-25T05:43:01.230 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:01.234 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:01.234 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:01.352 INFO:teuthology.orchestra.run.smithi002.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:01.356 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/338 2023-11-25T05:43:01.356 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/338 2023-11-25T05:43:01.356 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:01.358 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:01.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:01.367 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-11-25T05:43:01.541 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:01.545 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:01.545 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:01.659 INFO:teuthology.orchestra.run.smithi002.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:01.663 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/339 2023-11-25T05:43:01.663 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/339 2023-11-25T05:43:01.663 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:01.665 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:01.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:01.674 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-11-25T05:43:01.848 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:01.851 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:01.852 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:01.959 INFO:teuthology.orchestra.run.smithi002.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:01.962 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/340 2023-11-25T05:43:01.963 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/340 2023-11-25T05:43:01.963 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:01.965 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:01.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:01.974 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-11-25T05:43:02.147 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:02.151 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:02.151 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:02.270 INFO:teuthology.orchestra.run.smithi002.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:02.273 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/341 2023-11-25T05:43:02.274 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/341 2023-11-25T05:43:02.274 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:02.276 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:02.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:02.295 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-11-25T05:43:02.470 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:02.474 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:02.474 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:02.593 INFO:teuthology.orchestra.run.smithi002.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:02.597 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/342 2023-11-25T05:43:02.597 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/342 2023-11-25T05:43:02.597 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:02.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:02.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:02.608 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-11-25T05:43:02.781 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:02.785 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:02.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:02.904 INFO:teuthology.orchestra.run.smithi002.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:02.907 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/343 2023-11-25T05:43:02.907 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/343 2023-11-25T05:43:02.907 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:02.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:02.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:02.918 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-11-25T05:43:03.091 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:03.095 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:03.095 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:03.202 INFO:teuthology.orchestra.run.smithi002.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:03.206 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/344 2023-11-25T05:43:03.206 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/344 2023-11-25T05:43:03.206 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:03.208 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:03.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:03.217 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-11-25T05:43:03.390 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:03.394 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:03.394 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:03.502 INFO:teuthology.orchestra.run.smithi002.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:03.506 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/345 2023-11-25T05:43:03.506 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/345 2023-11-25T05:43:03.506 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:03.509 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:03.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:03.517 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-11-25T05:43:03.689 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:03.693 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:03.693 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:03.800 INFO:teuthology.orchestra.run.smithi002.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:03.804 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/346 2023-11-25T05:43:03.804 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/346 2023-11-25T05:43:03.804 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:03.806 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:03.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:03.827 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-11-25T05:43:03.999 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:04.003 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:04.004 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:04.142 INFO:teuthology.orchestra.run.smithi002.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:04.145 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/347 2023-11-25T05:43:04.146 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/347 2023-11-25T05:43:04.146 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:04.148 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:04.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:04.156 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-11-25T05:43:04.329 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:04.333 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:04.333 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:04.454 INFO:teuthology.orchestra.run.smithi002.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:04.457 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/348 2023-11-25T05:43:04.457 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/348 2023-11-25T05:43:04.457 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:04.460 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:04.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:04.468 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-11-25T05:43:04.642 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:04.646 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:04.646 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:05.564 INFO:teuthology.orchestra.run.smithi002.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-25T05:43:05.567 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/349 2023-11-25T05:43:05.567 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/349 2023-11-25T05:43:05.568 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:05.570 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:05.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:05.588 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-11-25T05:43:05.762 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:05.766 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:05.766 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:07.038 INFO:teuthology.orchestra.run.smithi002.stdout:generic/350 2s 2023-11-25T05:43:07.044 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/350 2023-11-25T05:43:07.044 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:07.046 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:07.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:07.056 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-11-25T05:43:07.230 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:07.235 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:07.235 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:08.105 INFO:teuthology.orchestra.run.smithi002.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-25T05:43:08.109 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/351 2023-11-25T05:43:08.109 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/351 2023-11-25T05:43:08.109 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:08.111 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:08.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:08.166 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-11-25T05:43:08.577 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:08.581 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:08.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:08.694 INFO:teuthology.orchestra.run.smithi002.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:08.695 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/352 2023-11-25T05:43:08.695 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/352 2023-11-25T05:43:08.695 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:08.697 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:08.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:08.713 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-11-25T05:43:08.889 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:08.893 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:08.893 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:09.003 INFO:teuthology.orchestra.run.smithi002.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:09.006 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/353 2023-11-25T05:43:09.007 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/353 2023-11-25T05:43:09.007 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:09.009 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:09.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:09.017 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-11-25T05:43:09.191 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:09.195 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:09.195 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:09.305 INFO:teuthology.orchestra.run.smithi002.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:09.307 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/354 2023-11-25T05:43:09.307 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/354 2023-11-25T05:43:09.308 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:09.310 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:09.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:09.318 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-11-25T05:43:09.492 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:09.496 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:09.496 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:10.102 INFO:teuthology.orchestra.run.smithi002.stdout:generic/355 1s 2023-11-25T05:43:10.108 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/355 2023-11-25T05:43:10.108 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:10.110 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:10.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:10.119 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-11-25T05:43:10.581 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:10.586 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:10.586 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:10.704 INFO:teuthology.orchestra.run.smithi002.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:10.707 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/356 2023-11-25T05:43:10.708 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/356 2023-11-25T05:43:10.708 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:10.710 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:10.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:10.719 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-11-25T05:43:10.893 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:10.898 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:10.898 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:11.008 INFO:teuthology.orchestra.run.smithi002.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:11.011 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/357 2023-11-25T05:43:11.012 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/357 2023-11-25T05:43:11.012 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:11.014 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:11.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:11.034 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-11-25T05:43:11.208 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:11.213 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:11.213 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:11.333 INFO:teuthology.orchestra.run.smithi002.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:11.336 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/358 2023-11-25T05:43:11.336 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/358 2023-11-25T05:43:11.336 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:11.339 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:11.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:11.347 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-11-25T05:43:11.521 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:11.525 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:11.525 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:11.634 INFO:teuthology.orchestra.run.smithi002.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:11.638 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/359 2023-11-25T05:43:11.638 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/359 2023-11-25T05:43:11.638 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:11.641 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:11.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:11.649 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-11-25T05:43:11.822 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:11.826 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:11.826 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:11.994 INFO:teuthology.orchestra.run.smithi002.stdout:generic/360 0s 2023-11-25T05:43:11.999 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/360 2023-11-25T05:43:11.999 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:12.001 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:12.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:12.010 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-11-25T05:43:12.185 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:12.189 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:12.189 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:12.317 INFO:teuthology.orchestra.run.smithi002.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:12.320 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/361 2023-11-25T05:43:12.320 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/361 2023-11-25T05:43:12.320 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:12.323 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:12.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:12.331 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-11-25T05:43:12.505 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:12.509 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:12.510 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:12.617 INFO:teuthology.orchestra.run.smithi002.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:12.620 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/362 2023-11-25T05:43:12.621 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/362 2023-11-25T05:43:12.621 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:12.623 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:12.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:12.631 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-11-25T05:43:12.804 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:12.808 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:12.809 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:12.916 INFO:teuthology.orchestra.run.smithi002.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:12.920 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/363 2023-11-25T05:43:12.920 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/363 2023-11-25T05:43:12.920 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:12.922 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:12.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:12.931 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-11-25T05:43:13.103 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:13.108 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:13.108 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:13.232 INFO:teuthology.orchestra.run.smithi002.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:13.236 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/364 2023-11-25T05:43:13.236 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/364 2023-11-25T05:43:13.236 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:13.238 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:13.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:13.247 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-11-25T05:43:13.421 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:13.426 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:13.426 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:13.534 INFO:teuthology.orchestra.run.smithi002.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:13.538 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/365 2023-11-25T05:43:13.538 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/365 2023-11-25T05:43:13.538 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:13.541 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:13.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:13.549 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-11-25T05:43:13.724 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:13.728 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:13.728 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:13.835 INFO:teuthology.orchestra.run.smithi002.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:13.838 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/366 2023-11-25T05:43:13.839 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/366 2023-11-25T05:43:13.839 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:13.841 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:13.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:13.850 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-11-25T05:43:14.022 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:14.026 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:14.027 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:14.136 INFO:teuthology.orchestra.run.smithi002.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:14.139 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/367 2023-11-25T05:43:14.139 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/367 2023-11-25T05:43:14.139 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:14.141 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:14.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:14.150 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-11-25T05:43:14.325 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:14.329 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:14.329 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:14.436 INFO:teuthology.orchestra.run.smithi002.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:14.440 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/368 2023-11-25T05:43:14.440 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/368 2023-11-25T05:43:14.440 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:14.442 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:14.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:14.451 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-11-25T05:43:14.626 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:14.628 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:14.628 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:14.749 INFO:teuthology.orchestra.run.smithi002.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:14.753 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/369 2023-11-25T05:43:14.753 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/369 2023-11-25T05:43:14.753 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:14.755 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:14.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:14.764 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-11-25T05:43:14.937 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:14.941 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:14.941 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:15.090 INFO:teuthology.orchestra.run.smithi002.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:15.093 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/370 2023-11-25T05:43:15.093 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/370 2023-11-25T05:43:15.093 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:15.096 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:15.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:15.115 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-11-25T05:43:15.289 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:15.293 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:15.293 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:15.592 INFO:teuthology.orchestra.run.smithi002.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:15.596 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/371 2023-11-25T05:43:15.596 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/371 2023-11-25T05:43:15.596 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:15.599 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:15.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:15.607 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-11-25T05:43:15.781 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:15.785 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:15.785 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:16.088 INFO:teuthology.orchestra.run.smithi002.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:16.091 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/372 2023-11-25T05:43:16.091 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/372 2023-11-25T05:43:16.091 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:16.094 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:16.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:16.102 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-11-25T05:43:16.276 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:16.280 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:16.280 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:16.394 INFO:teuthology.orchestra.run.smithi002.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:16.397 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/373 2023-11-25T05:43:16.398 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/373 2023-11-25T05:43:16.398 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:16.400 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:16.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:16.409 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-11-25T05:43:16.582 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:16.586 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:16.586 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:16.696 INFO:teuthology.orchestra.run.smithi002.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:16.700 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/374 2023-11-25T05:43:16.700 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/374 2023-11-25T05:43:16.700 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:16.702 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:16.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:16.710 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-11-25T05:43:16.885 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:16.892 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:16.892 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:17.033 INFO:teuthology.orchestra.run.smithi002.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-25T05:43:17.037 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/375 2023-11-25T05:43:17.037 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/375 2023-11-25T05:43:17.037 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:17.039 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:17.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:17.048 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-11-25T05:43:17.222 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:17.226 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:17.226 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:17.360 INFO:teuthology.orchestra.run.smithi002.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:17.364 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/376 2023-11-25T05:43:17.364 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/376 2023-11-25T05:43:17.364 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:17.366 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:17.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:17.375 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-11-25T05:43:17.549 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:17.553 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:17.553 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:17.676 INFO:teuthology.orchestra.run.smithi002.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:17.679 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/377 2023-11-25T05:43:17.679 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/377 2023-11-25T05:43:17.679 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:17.682 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:17.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:17.702 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-11-25T05:43:17.877 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:17.881 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:17.881 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:18.087 INFO:teuthology.orchestra.run.smithi002.stdout:generic/378 1s 2023-11-25T05:43:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/378 2023-11-25T05:43:18.093 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:18.095 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:18.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:18.105 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-11-25T05:43:18.557 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:18.561 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:18.562 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:18.672 INFO:teuthology.orchestra.run.smithi002.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:18.676 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/379 2023-11-25T05:43:18.676 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/379 2023-11-25T05:43:18.676 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:18.678 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:18.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:18.696 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-11-25T05:43:18.873 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:18.877 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:18.877 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:18.987 INFO:teuthology.orchestra.run.smithi002.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:18.991 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/380 2023-11-25T05:43:18.991 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/380 2023-11-25T05:43:18.991 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:18.993 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:19.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:19.002 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-11-25T05:43:19.176 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:19.181 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:19.181 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:19.296 INFO:teuthology.orchestra.run.smithi002.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:19.300 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/381 2023-11-25T05:43:19.300 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/381 2023-11-25T05:43:19.300 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:19.302 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:19.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:19.311 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-11-25T05:43:19.483 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:19.487 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:19.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:19.598 INFO:teuthology.orchestra.run.smithi002.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:19.602 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/382 2023-11-25T05:43:19.602 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/382 2023-11-25T05:43:19.602 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:19.604 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:19.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:19.613 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-11-25T05:43:19.787 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:19.791 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:19.791 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:19.902 INFO:teuthology.orchestra.run.smithi002.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:19.905 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/383 2023-11-25T05:43:19.905 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/383 2023-11-25T05:43:19.905 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:19.907 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:19.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:19.916 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-11-25T05:43:20.089 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:20.093 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:20.093 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:20.209 INFO:teuthology.orchestra.run.smithi002.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-25T05:43:20.212 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/384 2023-11-25T05:43:20.212 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/384 2023-11-25T05:43:20.212 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:20.215 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:20.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:20.234 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-11-25T05:43:20.408 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:20.412 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:20.412 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:20.522 INFO:teuthology.orchestra.run.smithi002.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/385 2023-11-25T05:43:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/385 2023-11-25T05:43:20.526 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:20.528 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:20.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:20.537 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-11-25T05:43:20.710 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:20.714 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:20.714 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:20.825 INFO:teuthology.orchestra.run.smithi002.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-25T05:43:20.828 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/386 2023-11-25T05:43:20.828 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/386 2023-11-25T05:43:20.829 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:20.831 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:20.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:20.839 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-11-25T05:43:21.012 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:21.016 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:21.016 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:21.127 INFO:teuthology.orchestra.run.smithi002.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:21.130 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/387 2023-11-25T05:43:21.131 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/387 2023-11-25T05:43:21.131 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:21.133 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:21.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:21.142 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-11-25T05:43:21.317 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:21.321 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:21.321 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:21.436 INFO:teuthology.orchestra.run.smithi002.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:21.440 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/388 2023-11-25T05:43:21.440 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/388 2023-11-25T05:43:21.440 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:21.442 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:21.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:21.451 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-11-25T05:43:21.625 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:21.629 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:21.629 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:21.746 INFO:teuthology.orchestra.run.smithi002.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-11-25T05:43:21.750 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/389 2023-11-25T05:43:21.750 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/389 2023-11-25T05:43:21.750 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:21.752 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:21.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:21.771 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-11-25T05:43:21.943 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:21.947 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:21.947 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:22.089 INFO:teuthology.orchestra.run.smithi002.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:22.093 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/390 2023-11-25T05:43:22.093 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/390 2023-11-25T05:43:22.093 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:22.095 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:22.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:22.104 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-11-25T05:43:22.280 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:22.284 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:22.284 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:41.736 INFO:teuthology.orchestra.run.smithi002.stdout:generic/391 19s 2023-11-25T05:43:45.487 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/391 2023-11-25T05:43:45.487 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:45.487 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:45.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:45.488 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-11-25T05:43:46.429 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:46.433 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:46.433 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:46.571 INFO:teuthology.orchestra.run.smithi002.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:46.575 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/392 2023-11-25T05:43:46.575 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/392 2023-11-25T05:43:46.575 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:46.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:46.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:46.586 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-11-25T05:43:46.758 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:46.762 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:46.762 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:46.872 INFO:teuthology.orchestra.run.smithi002.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:46.875 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/393 2023-11-25T05:43:46.875 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/393 2023-11-25T05:43:46.875 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:46.877 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:46.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:46.886 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-11-25T05:43:47.059 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:47.063 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:47.063 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:47.219 INFO:teuthology.orchestra.run.smithi002.stdout:generic/394 0s 2023-11-25T05:43:47.224 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/394 2023-11-25T05:43:47.224 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:47.227 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:47.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:47.235 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-11-25T05:43:47.691 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:47.697 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:47.698 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:47.891 INFO:teuthology.orchestra.run.smithi002.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:47.896 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/395 2023-11-25T05:43:47.896 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/395 2023-11-25T05:43:47.896 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:47.900 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:47.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:47.910 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-11-25T05:43:48.153 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:48.161 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:48.161 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:48.348 INFO:teuthology.orchestra.run.smithi002.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:48.352 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/396 2023-11-25T05:43:48.352 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/396 2023-11-25T05:43:48.352 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:48.354 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:48.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:48.363 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-11-25T05:43:48.537 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:48.541 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:48.541 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:48.696 INFO:teuthology.orchestra.run.smithi002.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:48.699 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/397 2023-11-25T05:43:48.699 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/397 2023-11-25T05:43:48.699 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:48.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:48.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:48.710 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-11-25T05:43:48.883 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:48.887 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:48.887 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:49.022 INFO:teuthology.orchestra.run.smithi002.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:49.026 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/398 2023-11-25T05:43:49.026 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/398 2023-11-25T05:43:49.026 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:49.029 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:49.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:49.038 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-11-25T05:43:49.211 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:49.215 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:49.215 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:49.352 INFO:teuthology.orchestra.run.smithi002.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:49.355 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/399 2023-11-25T05:43:49.355 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/399 2023-11-25T05:43:49.356 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:49.357 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:49.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:49.367 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-11-25T05:43:49.539 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:49.543 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:49.543 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:49.653 INFO:teuthology.orchestra.run.smithi002.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-25T05:43:49.657 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/400 2023-11-25T05:43:49.657 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/400 2023-11-25T05:43:49.657 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:49.659 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:49.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:49.668 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-11-25T05:43:49.843 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:49.847 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:49.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:49.956 INFO:teuthology.orchestra.run.smithi002.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:49.959 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/401 2023-11-25T05:43:49.959 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/401 2023-11-25T05:43:49.959 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:49.961 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:49.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:49.970 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-11-25T05:43:50.141 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:50.145 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:50.145 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:50.255 INFO:teuthology.orchestra.run.smithi002.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:50.259 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/402 2023-11-25T05:43:50.259 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/402 2023-11-25T05:43:50.259 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:50.261 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:50.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:50.270 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-11-25T05:43:50.444 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:50.448 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:50.448 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:50.557 INFO:teuthology.orchestra.run.smithi002.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:50.560 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/403 2023-11-25T05:43:50.560 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/403 2023-11-25T05:43:50.560 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:50.563 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:50.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:50.571 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-11-25T05:43:50.744 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:50.749 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:50.749 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:51.613 INFO:teuthology.orchestra.run.smithi002.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-25T05:43:51.617 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/404 2023-11-25T05:43:51.617 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/404 2023-11-25T05:43:51.617 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:51.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:51.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:51.628 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-11-25T05:43:52.063 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:52.068 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:52.068 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:52.269 INFO:teuthology.orchestra.run.smithi002.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:52.274 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/405 2023-11-25T05:43:52.275 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/405 2023-11-25T05:43:52.275 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:52.278 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:52.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:52.287 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-11-25T05:43:52.463 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:52.465 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:52.465 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:52.781 INFO:teuthology.orchestra.run.smithi002.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:52.784 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/406 2023-11-25T05:43:52.785 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/406 2023-11-25T05:43:52.785 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:52.788 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:52.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:52.799 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-11-25T05:43:52.973 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:52.977 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:52.977 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:53.153 INFO:teuthology.orchestra.run.smithi002.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:43:53.157 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/407 2023-11-25T05:43:53.157 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/407 2023-11-25T05:43:53.157 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:53.159 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:53.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:53.168 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-11-25T05:43:53.618 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:53.624 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:53.624 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:53.784 INFO:teuthology.orchestra.run.smithi002.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-25T05:43:53.788 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/408 2023-11-25T05:43:53.788 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/408 2023-11-25T05:43:53.788 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:53.790 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:53.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:53.799 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-11-25T05:43:54.233 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:54.237 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:54.237 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:54.353 INFO:teuthology.orchestra.run.smithi002.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:54.356 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/409 2023-11-25T05:43:54.357 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/409 2023-11-25T05:43:54.357 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:54.358 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:54.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:54.368 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-11-25T05:43:54.541 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:54.545 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:54.546 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:54.665 INFO:teuthology.orchestra.run.smithi002.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:54.668 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/410 2023-11-25T05:43:54.669 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/410 2023-11-25T05:43:54.669 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:54.671 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:54.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:54.680 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-11-25T05:43:54.854 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:54.858 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:54.858 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:54.972 INFO:teuthology.orchestra.run.smithi002.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:54.976 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/411 2023-11-25T05:43:54.976 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/411 2023-11-25T05:43:54.976 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:54.978 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:54.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:55.000 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-11-25T05:43:55.176 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:55.180 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:55.180 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:55.292 INFO:teuthology.orchestra.run.smithi002.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:55.296 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/412 2023-11-25T05:43:55.296 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/412 2023-11-25T05:43:55.296 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:55.298 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:55.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:55.307 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-11-25T05:43:55.483 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:55.488 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:55.488 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/413 2023-11-25T05:43:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/413 2023-11-25T05:43:55.606 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:55.608 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:55.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:55.627 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-11-25T05:43:55.801 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:55.805 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:55.805 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:55.916 INFO:teuthology.orchestra.run.smithi002.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:55.920 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/414 2023-11-25T05:43:55.920 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/414 2023-11-25T05:43:55.920 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:55.922 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:55.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:55.931 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-11-25T05:43:56.104 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:56.108 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:56.108 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:56.218 INFO:teuthology.orchestra.run.smithi002.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/415 2023-11-25T05:43:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/415 2023-11-25T05:43:56.220 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:56.222 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:56.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:56.231 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-11-25T05:43:56.403 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:56.407 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:56.408 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:56.517 INFO:teuthology.orchestra.run.smithi002.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:56.521 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/416 2023-11-25T05:43:56.521 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/416 2023-11-25T05:43:56.521 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:56.523 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:56.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:56.532 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-11-25T05:43:56.706 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:56.710 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:56.710 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:56.819 INFO:teuthology.orchestra.run.smithi002.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:56.822 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/417 2023-11-25T05:43:56.822 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/417 2023-11-25T05:43:56.823 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:56.825 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:56.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:56.834 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-11-25T05:43:57.008 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:57.012 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:57.012 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:57.164 INFO:teuthology.orchestra.run.smithi002.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-11-25T05:43:57.167 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/418 2023-11-25T05:43:57.168 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/418 2023-11-25T05:43:57.168 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:57.170 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:57.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:57.179 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-11-25T05:43:57.353 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:57.357 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:57.357 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:57.493 INFO:teuthology.orchestra.run.smithi002.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:57.497 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/419 2023-11-25T05:43:57.497 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/419 2023-11-25T05:43:57.497 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:57.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:57.508 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-11-25T05:43:57.682 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:57.686 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:57.686 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:58.691 INFO:teuthology.orchestra.run.smithi002.stdout:generic/420 1s 2023-11-25T05:43:58.698 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/420 2023-11-25T05:43:58.699 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:58.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:58.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:58.710 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-11-25T05:43:59.160 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:59.164 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:59.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:59.476 INFO:teuthology.orchestra.run.smithi002.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:59.478 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/421 2023-11-25T05:43:59.479 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/421 2023-11-25T05:43:59.479 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:59.481 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:59.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:59.489 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-11-25T05:43:59.664 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:43:59.668 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:43:59.668 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:59.828 INFO:teuthology.orchestra.run.smithi002.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:43:59.832 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/422 2023-11-25T05:43:59.832 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/422 2023-11-25T05:43:59.832 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:43:59.834 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:43:59.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:43:59.843 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-11-25T05:44:00.015 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:00.019 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:00.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:00.530 INFO:teuthology.orchestra.run.smithi002.stdout:generic/423 0s 2023-11-25T05:44:00.536 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/423 2023-11-25T05:44:00.536 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:00.538 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:00.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:00.547 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-11-25T05:44:00.978 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:00.983 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:00.983 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:01.142 INFO:teuthology.orchestra.run.smithi002.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-11-25T05:44:01.145 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/424 2023-11-25T05:44:01.145 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/424 2023-11-25T05:44:01.145 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:01.147 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:01.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:01.169 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-11-25T05:44:01.349 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:01.354 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:01.355 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:01.472 INFO:teuthology.orchestra.run.smithi002.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:44:01.475 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/425 2023-11-25T05:44:01.475 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/425 2023-11-25T05:44:01.475 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:01.478 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:01.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:01.487 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-11-25T05:44:01.660 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:01.664 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:01.664 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:33.117 INFO:teuthology.orchestra.run.smithi002.stdout:generic/426 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/426.out.bad) 2023-11-25T05:44:33.140 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/426.out 2023-11-25 04:09:45.781124203 +0000 2023-11-25T05:44:33.140 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/426.out.bad 2023-11-25 05:44:33.089158247 +0000 2023-11-25T05:44:33.140 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1,5 +1,1001 @@ 2023-11-25T05:44:33.140 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 426 2023-11-25T05:44:33.141 INFO:teuthology.orchestra.run.smithi002.stdout: test_file_handles TEST_DIR/426-dir -d 2023-11-25T05:44:33.141 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000028) opened an unlinked file! 2023-11-25T05:44:33.141 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000029) opened an unlinked file! 2023-11-25T05:44:33.141 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000030) opened an unlinked file! 2023-11-25T05:44:33.141 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000031) opened an unlinked file! 2023-11-25T05:44:33.141 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000032) opened an unlinked file! 2023-11-25T05:44:33.141 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000033) opened an unlinked file! 2023-11-25T05:44:33.142 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000034) opened an unlinked file! 2023-11-25T05:44:33.142 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000035) opened an unlinked file! 2023-11-25T05:44:33.142 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000036) opened an unlinked file! 2023-11-25T05:44:33.142 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000037) opened an unlinked file! 2023-11-25T05:44:33.142 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000038) opened an unlinked file! 2023-11-25T05:44:33.142 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000039) opened an unlinked file! 2023-11-25T05:44:33.142 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000040) opened an unlinked file! 2023-11-25T05:44:33.143 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000041) opened an unlinked file! 2023-11-25T05:44:33.143 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000042) opened an unlinked file! 2023-11-25T05:44:33.143 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000043) opened an unlinked file! 2023-11-25T05:44:33.143 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000044) opened an unlinked file! 2023-11-25T05:44:33.143 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000045) opened an unlinked file! 2023-11-25T05:44:33.143 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000046) opened an unlinked file! 2023-11-25T05:44:33.143 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000047) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000048) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000049) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000050) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000051) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000052) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000053) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000054) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000055) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000056) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000057) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000058) opened an unlinked file! 2023-11-25T05:44:33.144 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000059) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000060) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000061) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000062) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000063) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000064) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000065) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000066) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000067) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000068) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000069) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000070) opened an unlinked file! 2023-11-25T05:44:33.145 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000071) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000072) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000073) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000074) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000075) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000076) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000077) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000078) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000079) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000080) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000081) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000082) opened an unlinked file! 2023-11-25T05:44:33.146 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000083) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000084) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000085) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000086) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000087) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000088) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000089) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000090) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000091) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000092) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000093) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000094) opened an unlinked file! 2023-11-25T05:44:33.147 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000095) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000096) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000097) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000098) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000099) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000100) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000101) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000102) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000103) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000104) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000105) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000106) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000107) opened an unlinked file! 2023-11-25T05:44:33.148 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000108) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000109) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000110) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000111) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000112) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000113) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000114) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000115) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000116) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000117) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000118) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000119) opened an unlinked file! 2023-11-25T05:44:33.149 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000120) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000121) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000122) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000123) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000124) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000125) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000126) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000127) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000128) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000129) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000130) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000131) opened an unlinked file! 2023-11-25T05:44:33.150 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000132) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000133) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000134) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000135) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000136) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000137) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000138) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000139) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000140) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000141) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000142) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000143) opened an unlinked file! 2023-11-25T05:44:33.151 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000144) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000145) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000146) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000147) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000148) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000149) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000150) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000151) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000152) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000153) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000154) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000155) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000156) opened an unlinked file! 2023-11-25T05:44:33.152 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000157) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000158) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000159) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000160) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000161) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000162) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000163) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000164) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000165) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000166) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000167) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000168) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000169) opened an unlinked file! 2023-11-25T05:44:33.153 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000170) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000171) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000172) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000173) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000174) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000175) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000176) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000177) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000178) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000179) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000180) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000181) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000182) opened an unlinked file! 2023-11-25T05:44:33.154 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000183) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000184) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000185) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000186) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000187) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000188) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000189) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000190) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000191) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000192) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000193) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000194) opened an unlinked file! 2023-11-25T05:44:33.155 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000195) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000196) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000197) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000198) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000199) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000200) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000201) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000202) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000203) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000204) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000205) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000206) opened an unlinked file! 2023-11-25T05:44:33.156 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000207) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000208) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000209) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000210) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000211) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000212) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000213) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000214) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000215) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000216) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000217) opened an unlinked file! 2023-11-25T05:44:33.157 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000218) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000219) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000220) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000221) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000222) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000223) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000224) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000225) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000226) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000227) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000228) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000229) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000230) opened an unlinked file! 2023-11-25T05:44:33.158 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000231) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000232) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000233) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000234) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000235) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000236) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000237) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000238) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000239) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000240) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000241) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000242) opened an unlinked file! 2023-11-25T05:44:33.159 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000243) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000244) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000245) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000246) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000247) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000248) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000249) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000250) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000251) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000252) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000253) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000254) opened an unlinked file! 2023-11-25T05:44:33.160 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000255) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000256) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000257) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000258) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000259) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000260) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000261) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000262) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000263) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000264) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000265) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000266) opened an unlinked file! 2023-11-25T05:44:33.161 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000267) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000268) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000269) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000270) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000271) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000272) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000273) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000274) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000275) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000276) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000277) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000278) opened an unlinked file! 2023-11-25T05:44:33.162 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000279) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000280) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000281) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000282) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000283) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000284) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000285) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000286) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000287) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000288) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000289) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000290) opened an unlinked file! 2023-11-25T05:44:33.163 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000291) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000292) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000293) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000294) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000295) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000296) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000297) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000298) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000299) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000300) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000301) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000302) opened an unlinked file! 2023-11-25T05:44:33.164 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000303) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000304) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000305) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000306) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000307) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000308) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000309) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000310) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000311) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000312) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000313) opened an unlinked file! 2023-11-25T05:44:33.165 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000314) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000315) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000316) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000317) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000318) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000319) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000320) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000321) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000322) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000323) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000324) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000325) opened an unlinked file! 2023-11-25T05:44:33.166 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000326) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000327) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000328) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000329) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000330) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000331) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000332) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000333) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000334) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000335) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000336) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000337) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000338) opened an unlinked file! 2023-11-25T05:44:33.167 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000339) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000340) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000341) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000342) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000343) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000344) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000345) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000346) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000347) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000348) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000349) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000350) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000351) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000352) opened an unlinked file! 2023-11-25T05:44:33.168 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000353) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000354) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000355) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000356) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000357) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000358) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000359) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000360) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000361) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000362) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000363) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000364) opened an unlinked file! 2023-11-25T05:44:33.169 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000365) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000366) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000367) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000368) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000369) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000370) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000371) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000372) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000373) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000374) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000375) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000376) opened an unlinked file! 2023-11-25T05:44:33.170 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000377) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000378) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000379) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000380) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000381) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000382) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000383) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000384) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000385) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000386) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000387) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000388) opened an unlinked file! 2023-11-25T05:44:33.171 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000389) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000390) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000391) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000392) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000393) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000394) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000395) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000396) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000397) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000398) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000399) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000400) opened an unlinked file! 2023-11-25T05:44:33.172 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000401) opened an unlinked file! 2023-11-25T05:44:33.173 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000402) opened an unlinked file! 2023-11-25T05:44:33.173 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000403) opened an unlinked file! 2023-11-25T05:44:33.173 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000404) opened an unlinked file! 2023-11-25T05:44:33.173 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000405) opened an unlinked file! 2023-11-25T05:44:33.173 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000406) opened an unlinked file! 2023-11-25T05:44:33.173 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000407) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000408) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000409) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000410) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000411) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000412) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000413) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000414) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000415) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000416) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000417) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000418) opened an unlinked file! 2023-11-25T05:44:33.174 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000419) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000420) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000421) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000422) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000423) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000424) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000425) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000426) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000427) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000428) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000429) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000430) opened an unlinked file! 2023-11-25T05:44:33.175 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000431) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000432) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000433) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000434) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000435) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000436) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000437) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000438) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000439) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000440) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000441) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000442) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000443) opened an unlinked file! 2023-11-25T05:44:33.176 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000444) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000445) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000446) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000447) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000448) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000449) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000450) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000451) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000452) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000453) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000454) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000455) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000456) opened an unlinked file! 2023-11-25T05:44:33.177 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000457) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000458) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000459) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000460) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000461) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000462) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000463) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000464) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000465) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000466) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000467) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000468) opened an unlinked file! 2023-11-25T05:44:33.178 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000469) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000470) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000471) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000472) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000473) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000474) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000475) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000476) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000477) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000478) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000479) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000480) opened an unlinked file! 2023-11-25T05:44:33.179 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000481) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000482) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000483) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000484) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000485) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000486) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000487) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000488) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000489) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000490) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000491) opened an unlinked file! 2023-11-25T05:44:33.180 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000492) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000493) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000494) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000495) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000496) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000497) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000498) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000499) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000500) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000501) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000502) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000503) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000504) opened an unlinked file! 2023-11-25T05:44:33.181 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000505) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000506) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000507) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000508) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000509) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000510) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000511) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000512) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000513) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000514) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000515) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000516) opened an unlinked file! 2023-11-25T05:44:33.182 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000517) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000518) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000519) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000520) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000521) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000522) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000523) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000524) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000525) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000526) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000527) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000528) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000529) opened an unlinked file! 2023-11-25T05:44:33.183 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000530) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000531) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000532) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000533) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000534) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000535) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000536) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000537) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000538) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000539) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000540) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000541) opened an unlinked file! 2023-11-25T05:44:33.184 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000542) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000543) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000544) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000545) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000546) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000547) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000548) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000549) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000550) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000551) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000552) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000553) opened an unlinked file! 2023-11-25T05:44:33.185 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000554) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000555) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000556) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000557) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000558) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000559) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000560) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000561) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000562) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000563) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000564) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000565) opened an unlinked file! 2023-11-25T05:44:33.186 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000566) opened an unlinked file! 2023-11-25T05:44:33.187 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000567) opened an unlinked file! 2023-11-25T05:44:33.187 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000568) opened an unlinked file! 2023-11-25T05:44:33.187 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000569) opened an unlinked file! 2023-11-25T05:44:33.187 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000570) opened an unlinked file! 2023-11-25T05:44:33.187 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000571) opened an unlinked file! 2023-11-25T05:44:33.187 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000572) opened an unlinked file! 2023-11-25T05:44:33.187 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000573) opened an unlinked file! 2023-11-25T05:44:33.188 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000574) opened an unlinked file! 2023-11-25T05:44:33.188 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000575) opened an unlinked file! 2023-11-25T05:44:33.188 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000576) opened an unlinked file! 2023-11-25T05:44:33.188 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000577) opened an unlinked file! 2023-11-25T05:44:33.188 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000578) opened an unlinked file! 2023-11-25T05:44:33.188 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000579) opened an unlinked file! 2023-11-25T05:44:33.188 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000580) opened an unlinked file! 2023-11-25T05:44:33.188 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000581) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000582) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000583) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000584) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000585) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000586) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000587) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000588) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000589) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000590) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000591) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000592) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000593) opened an unlinked file! 2023-11-25T05:44:33.189 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000594) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000595) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000596) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000597) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000598) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000599) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000600) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000601) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000602) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000603) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000604) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000605) opened an unlinked file! 2023-11-25T05:44:33.190 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000606) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000607) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000608) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000609) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000610) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000611) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000612) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000613) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000614) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000615) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000616) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000617) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000618) opened an unlinked file! 2023-11-25T05:44:33.191 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000619) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000620) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000621) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000622) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000623) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000624) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000625) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000626) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000627) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000628) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000629) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000630) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000631) opened an unlinked file! 2023-11-25T05:44:33.192 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000632) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000633) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000634) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000635) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000636) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000637) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000638) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000639) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000640) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000641) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000642) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000643) opened an unlinked file! 2023-11-25T05:44:33.193 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000644) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000645) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000646) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000647) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000648) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000649) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000650) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000651) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000652) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000653) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000654) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000655) opened an unlinked file! 2023-11-25T05:44:33.194 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000656) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000657) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000658) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000659) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000660) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000661) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000662) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000663) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000664) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000665) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000666) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000667) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000668) opened an unlinked file! 2023-11-25T05:44:33.195 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000669) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000670) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000671) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000672) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000673) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000674) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000675) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000676) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000677) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000678) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000679) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000680) opened an unlinked file! 2023-11-25T05:44:33.196 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000681) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000682) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000683) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000684) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000685) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000686) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000687) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000688) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000689) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000690) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000691) opened an unlinked file! 2023-11-25T05:44:33.197 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000692) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000693) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000694) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000695) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000696) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000697) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000698) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000699) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000700) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000701) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000702) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000703) opened an unlinked file! 2023-11-25T05:44:33.198 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000704) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000705) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000706) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000707) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000708) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000709) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000710) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000711) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000712) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000713) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000714) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000715) opened an unlinked file! 2023-11-25T05:44:33.199 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000716) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000717) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000718) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000719) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000720) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000721) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000722) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000723) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000724) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000725) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000726) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000727) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000728) opened an unlinked file! 2023-11-25T05:44:33.200 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000729) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000730) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000731) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000732) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000733) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000734) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000735) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000736) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000737) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000738) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000739) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000740) opened an unlinked file! 2023-11-25T05:44:33.201 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000741) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000742) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000743) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000744) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000745) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000746) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000747) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000748) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000749) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000750) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000751) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000752) opened an unlinked file! 2023-11-25T05:44:33.202 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000753) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000754) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000755) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000756) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000757) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000758) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000759) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000760) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000761) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000762) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000763) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000764) opened an unlinked file! 2023-11-25T05:44:33.203 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000765) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000766) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000767) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000768) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000769) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000770) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000771) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000772) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000773) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000774) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000775) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000776) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000777) opened an unlinked file! 2023-11-25T05:44:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000778) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000779) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000780) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000781) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000782) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000783) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000784) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000785) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000786) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000787) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000788) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000789) opened an unlinked file! 2023-11-25T05:44:33.205 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000790) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000791) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000792) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000793) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000794) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000795) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000796) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000797) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000798) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000799) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000800) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000801) opened an unlinked file! 2023-11-25T05:44:33.206 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000802) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000803) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000804) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000805) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000806) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000807) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000808) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000809) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000810) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000811) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000812) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000813) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000814) opened an unlinked file! 2023-11-25T05:44:33.207 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000815) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000816) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000817) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000818) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000819) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000820) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000821) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000822) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000823) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000824) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000825) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000826) opened an unlinked file! 2023-11-25T05:44:33.208 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000827) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000828) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000829) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000830) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000831) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000832) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000833) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000834) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000835) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000836) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000837) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000838) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000839) opened an unlinked file! 2023-11-25T05:44:33.209 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000840) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000841) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000842) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000843) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000844) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000845) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000846) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000847) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000848) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000849) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000850) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000851) opened an unlinked file! 2023-11-25T05:44:33.210 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000852) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000853) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000854) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000855) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000856) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000857) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000858) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000859) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000860) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000861) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000862) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000863) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000864) opened an unlinked file! 2023-11-25T05:44:33.211 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000865) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000866) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000867) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000868) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000869) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000870) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000871) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000872) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000873) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000874) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000875) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000876) opened an unlinked file! 2023-11-25T05:44:33.212 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000877) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000878) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000879) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000880) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000881) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000882) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000883) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000884) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000885) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000886) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000887) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000888) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000889) opened an unlinked file! 2023-11-25T05:44:33.213 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000890) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000891) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000892) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000893) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000894) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000895) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000896) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000897) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000898) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000899) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000900) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000901) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000902) opened an unlinked file! 2023-11-25T05:44:33.214 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000903) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000904) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000905) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000906) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000907) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000908) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000909) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000910) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000911) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000912) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000913) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000914) opened an unlinked file! 2023-11-25T05:44:33.215 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000915) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000916) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000917) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000918) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000919) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000920) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000921) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000922) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000923) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000924) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000925) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000926) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000927) opened an unlinked file! 2023-11-25T05:44:33.216 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000928) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000929) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000930) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000931) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000932) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000933) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000934) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000935) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000936) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000937) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000938) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000939) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000940) opened an unlinked file! 2023-11-25T05:44:33.217 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000941) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000942) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000943) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000944) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000945) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000946) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000947) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000948) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000949) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000950) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000951) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000952) opened an unlinked file! 2023-11-25T05:44:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000953) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000954) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000955) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000956) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000957) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000958) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000959) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000960) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000961) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000962) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000963) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000964) opened an unlinked file! 2023-11-25T05:44:33.219 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000965) opened an unlinked file! 2023-11-25T05:44:33.220 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000966) opened an unlinked file! 2023-11-25T05:44:33.220 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000967) opened an unlinked file! 2023-11-25T05:44:33.220 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000968) opened an unlinked file! 2023-11-25T05:44:33.220 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000969) opened an unlinked file! 2023-11-25T05:44:33.220 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000970) opened an unlinked file! 2023-11-25T05:44:33.220 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000971) opened an unlinked file! 2023-11-25T05:44:33.220 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000972) opened an unlinked file! 2023-11-25T05:44:33.220 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000973) opened an unlinked file! 2023-11-25T05:44:33.220 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000974) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000975) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000976) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000977) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000978) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000979) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000980) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000981) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000982) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000983) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000984) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000985) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000986) opened an unlinked file! 2023-11-25T05:44:33.221 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000987) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000988) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000989) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000990) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000991) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000992) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000993) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000994) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000995) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000996) opened an unlinked file! 2023-11-25T05:44:33.222 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000997) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000998) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file000999) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001000) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001001) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001002) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001003) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001004) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001005) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001006) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001007) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001008) opened an unlinked file! 2023-11-25T05:44:33.223 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001009) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001010) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001011) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001012) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001013) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001014) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001015) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001016) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001017) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001018) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001019) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001020) opened an unlinked file! 2023-11-25T05:44:33.224 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001021) opened an unlinked file! 2023-11-25T05:44:33.225 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001022) opened an unlinked file! 2023-11-25T05:44:33.225 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/426-dir/file001023) opened an unlinked file! 2023-11-25T05:44:33.225 INFO:teuthology.orchestra.run.smithi002.stdout: test_file_handles TEST_DIR/426-dir 2023-11-25T05:44:33.225 INFO:teuthology.orchestra.run.smithi002.stdout: test_file_handles TEST_DIR/426-dir -l 2023-11-25T05:44:33.225 INFO:teuthology.orchestra.run.smithi002.stdout: test_file_handles TEST_DIR/426-dir -u 2023-11-25T05:44:33.226 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/426 2023-11-25T05:44:33.226 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/426 2023-11-25T05:44:33.226 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:44:33.226 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:33.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:44:33.344 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:44:33.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:44:33.344 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-11-25T05:44:34.317 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:34.321 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:34.321 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:34.470 INFO:teuthology.orchestra.run.smithi002.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/427 2023-11-25T05:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/427 2023-11-25T05:44:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:34.476 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:34.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:34.484 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-11-25T05:44:34.677 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:34.682 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:34.682 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:34.875 INFO:teuthology.orchestra.run.smithi002.stdout:generic/428 0s 2023-11-25T05:44:34.880 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/428 2023-11-25T05:44:34.881 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:34.883 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:34.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:34.892 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-11-25T05:44:35.078 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:35.082 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:35.082 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:35.219 INFO:teuthology.orchestra.run.smithi002.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:44:35.223 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/429 2023-11-25T05:44:35.223 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/429 2023-11-25T05:44:35.223 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:35.225 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:35.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:35.234 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-11-25T05:44:35.423 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:35.427 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:35.427 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:35.690 INFO:teuthology.orchestra.run.smithi002.stdout:generic/430 0s 2023-11-25T05:44:35.697 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/430 2023-11-25T05:44:35.697 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:35.698 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:35.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:35.708 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-11-25T05:44:36.149 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:36.153 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:36.153 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:36.392 INFO:teuthology.orchestra.run.smithi002.stdout:generic/431 0s 2023-11-25T05:44:36.397 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/431 2023-11-25T05:44:36.397 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:36.400 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:36.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:36.408 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-11-25T05:44:36.874 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:36.878 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:36.878 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:37.122 INFO:teuthology.orchestra.run.smithi002.stdout:generic/432 1s 2023-11-25T05:44:37.127 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/432 2023-11-25T05:44:37.128 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:37.130 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:37.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:37.140 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-11-25T05:44:37.597 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:37.601 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:37.601 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:37.812 INFO:teuthology.orchestra.run.smithi002.stdout:generic/433 0s 2023-11-25T05:44:37.817 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/433 2023-11-25T05:44:37.817 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:37.821 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:37.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:37.829 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-11-25T05:44:38.254 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:38.259 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:38.259 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:38.477 INFO:teuthology.orchestra.run.smithi002.stdout:generic/434 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/434.out.bad) 2023-11-25T05:44:38.479 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/434.out 2023-11-25 04:09:45.781124203 +0000 2023-11-25T05:44:38.479 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/434.out.bad 2023-11-25 05:44:38.476034423 +0000 2023-11-25T05:44:38.479 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -9,6 +9,6 @@ 2023-11-25T05:44:38.479 INFO:teuthology.orchestra.run.smithi002.stdout: copy_range: Bad file descriptor 2023-11-25T05:44:38.479 INFO:teuthology.orchestra.run.smithi002.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-11-25T05:44:38.479 INFO:teuthology.orchestra.run.smithi002.stdout: Try to copy to a device 2023-11-25T05:44:38.480 INFO:teuthology.orchestra.run.smithi002.stdout: -copy_range: Invalid argument 2023-11-25T05:44:38.480 INFO:teuthology.orchestra.run.smithi002.stdout: +/tmp/tmp.VDcWebYyYttest/test-434/dev1: Permission denied 2023-11-25T05:44:38.480 INFO:teuthology.orchestra.run.smithi002.stdout: Try to copy to a fifo 2023-11-25T05:44:38.480 INFO:teuthology.orchestra.run.smithi002.stdout: copy_range: Invalid argument 2023-11-25T05:44:38.481 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/434 2023-11-25T05:44:38.482 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/434 2023-11-25T05:44:38.482 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:44:38.484 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:38.493 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:44:38.493 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:44:38.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:44:38.493 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-11-25T05:44:38.949 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:38.953 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:38.954 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:39.096 INFO:teuthology.orchestra.run.smithi002.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:44:39.099 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/435 2023-11-25T05:44:39.099 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/435 2023-11-25T05:44:39.099 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:39.102 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:39.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:39.111 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-11-25T05:44:39.284 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:39.288 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:39.288 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:40.192 INFO:teuthology.orchestra.run.smithi002.stdout:generic/436 1s 2023-11-25T05:44:40.197 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/436 2023-11-25T05:44:40.198 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:40.200 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:40.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:40.209 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-11-25T05:44:40.659 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:40.666 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:40.666 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:41.481 INFO:teuthology.orchestra.run.smithi002.stdout:generic/437 1s 2023-11-25T05:44:41.486 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/437 2023-11-25T05:44:41.487 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:44:41.489 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:41.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:44:41.498 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-11-25T05:44:41.670 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:44:41.674 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:44:41.674 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:44:52.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:44:52.120 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:45:22.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:45:22.238 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:45:44.607 INFO:teuthology.orchestra.run.smithi002.stdout:generic/438 63s 2023-11-25T05:45:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/438 2023-11-25T05:45:44.612 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:44.614 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:44.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:44.624 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-11-25T05:45:44.795 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:44.799 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:44.799 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/439 2023-11-25T05:45:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/439 2023-11-25T05:45:44.915 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:44.917 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:44.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:44.926 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-11-25T05:45:45.097 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:45.101 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:45.101 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:45.248 INFO:teuthology.orchestra.run.smithi002.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/440 2023-11-25T05:45:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/440 2023-11-25T05:45:45.251 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:45.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:45.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:45.263 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-11-25T05:45:45.434 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:45.438 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:45.438 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:45.635 INFO:teuthology.orchestra.run.smithi002.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:45.638 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/441 2023-11-25T05:45:45.639 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/441 2023-11-25T05:45:45.639 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:45.641 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:45.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:45.649 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-11-25T05:45:45.821 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:45.825 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:45.825 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:45.955 INFO:teuthology.orchestra.run.smithi002.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:45.959 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/442 2023-11-25T05:45:45.959 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/442 2023-11-25T05:45:45.959 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:45.961 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:45.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:45.970 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-11-25T05:45:46.141 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:46.145 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:46.145 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:46.296 INFO:teuthology.orchestra.run.smithi002.stdout:generic/443 0s 2023-11-25T05:45:46.301 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/443 2023-11-25T05:45:46.301 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:46.304 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:46.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:46.312 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-11-25T05:45:46.483 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:46.488 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:46.488 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:46.633 INFO:teuthology.orchestra.run.smithi002.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-25T05:45:46.637 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/444 2023-11-25T05:45:46.637 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/444 2023-11-25T05:45:46.637 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:46.639 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:46.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:46.648 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-11-25T05:45:46.821 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:46.825 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:46.825 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:47.658 INFO:teuthology.orchestra.run.smithi002.stdout:generic/445 1s 2023-11-25T05:45:47.663 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/445 2023-11-25T05:45:47.664 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:47.666 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:47.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:47.675 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-11-25T05:45:48.130 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:48.134 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:48.134 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:48.242 INFO:teuthology.orchestra.run.smithi002.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:48.246 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/446 2023-11-25T05:45:48.246 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/446 2023-11-25T05:45:48.246 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:48.248 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:48.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:48.257 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-11-25T05:45:48.429 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:48.434 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:48.434 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:48.549 INFO:teuthology.orchestra.run.smithi002.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:48.553 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/447 2023-11-25T05:45:48.553 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/447 2023-11-25T05:45:48.553 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:48.555 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:48.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:48.564 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-11-25T05:45:48.742 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:48.746 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:48.747 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:49.558 INFO:teuthology.orchestra.run.smithi002.stdout:generic/448 1s 2023-11-25T05:45:49.563 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/448 2023-11-25T05:45:49.564 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:49.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:49.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:49.579 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-11-25T05:45:50.005 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:50.010 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:50.010 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:50.136 INFO:teuthology.orchestra.run.smithi002.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:50.140 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/449 2023-11-25T05:45:50.140 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/449 2023-11-25T05:45:50.140 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:50.142 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:50.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:50.151 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-11-25T05:45:50.324 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:50.328 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:50.328 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:51.351 INFO:teuthology.orchestra.run.smithi002.stdout:generic/450 1s 2023-11-25T05:45:51.357 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/450 2023-11-25T05:45:51.357 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:51.359 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:51.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:51.369 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-11-25T05:45:51.829 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:51.834 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:51.834 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:52.119 INFO:teuthology.orchestra.run.smithi002.stdout:generic/451 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/451.out.bad) 2023-11-25T05:45:52.121 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/451.out 2023-11-25 04:09:45.782124179 +0000 2023-11-25T05:45:52.121 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/451.out.bad 2023-11-25 05:45:52.116340251 +0000 2023-11-25T05:45:52.121 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1,2 +1,5 @@ 2023-11-25T05:45:52.121 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 451 2023-11-25T05:45:52.121 INFO:teuthology.orchestra.run.smithi002.stdout: +get stale data from buffer read 2023-11-25T05:45:52.121 INFO:teuthology.orchestra.run.smithi002.stdout: +00000000 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 55 UUUUUUUUUUUUUUUU 2023-11-25T05:45:52.121 INFO:teuthology.orchestra.run.smithi002.stdout: +000a0000 2023-11-25T05:45:52.121 INFO:teuthology.orchestra.run.smithi002.stdout: Silence is golden 2023-11-25T05:45:52.123 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/451 2023-11-25T05:45:52.123 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/451 2023-11-25T05:45:52.123 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:45:52.125 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:52.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:45:52.134 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:45:52.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:45:52.134 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-11-25T05:45:52.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:45:52.304 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:45:52.449 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:52.457 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:52.457 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:52.671 INFO:teuthology.orchestra.run.smithi002.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:52.678 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/452 2023-11-25T05:45:52.678 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/452 2023-11-25T05:45:52.678 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:52.688 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:52.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:52.696 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-11-25T05:45:52.876 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:52.880 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:52.881 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:52.996 INFO:teuthology.orchestra.run.smithi002.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:52.999 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/453 2023-11-25T05:45:52.999 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/453 2023-11-25T05:45:52.999 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:53.002 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:53.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:53.011 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-11-25T05:45:53.183 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:53.187 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:53.187 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:53.297 INFO:teuthology.orchestra.run.smithi002.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:53.300 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/454 2023-11-25T05:45:53.300 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/454 2023-11-25T05:45:53.300 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:53.302 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:53.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:53.328 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-11-25T05:45:53.502 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:53.506 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:53.506 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:53.672 INFO:teuthology.orchestra.run.smithi002.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:53.675 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/455 2023-11-25T05:45:53.676 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/455 2023-11-25T05:45:53.676 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:53.678 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:53.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:53.687 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-11-25T05:45:53.860 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:53.864 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:53.864 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:54.004 INFO:teuthology.orchestra.run.smithi002.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:54.008 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/456 2023-11-25T05:45:54.008 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/456 2023-11-25T05:45:54.008 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:54.010 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:54.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:54.019 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-11-25T05:45:54.190 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:54.195 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:54.195 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:54.362 INFO:teuthology.orchestra.run.smithi002.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:54.366 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/457 2023-11-25T05:45:54.366 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/457 2023-11-25T05:45:54.366 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:54.368 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:54.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:54.377 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-11-25T05:45:54.550 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:54.554 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:54.554 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:54.665 INFO:teuthology.orchestra.run.smithi002.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:54.668 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/458 2023-11-25T05:45:54.668 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/458 2023-11-25T05:45:54.668 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:54.671 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:54.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:54.680 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-11-25T05:45:54.851 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:54.855 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:54.855 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:55.110 INFO:teuthology.orchestra.run.smithi002.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:55.114 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/459 2023-11-25T05:45:55.114 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/459 2023-11-25T05:45:55.114 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:55.116 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:55.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:55.125 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-11-25T05:45:55.297 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:55.301 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:55.301 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:55.411 INFO:teuthology.orchestra.run.smithi002.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:55.415 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/460 2023-11-25T05:45:55.415 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/460 2023-11-25T05:45:55.415 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:55.417 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:55.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:55.426 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-11-25T05:45:55.598 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:55.602 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:55.602 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:55.713 INFO:teuthology.orchestra.run.smithi002.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/461 2023-11-25T05:45:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/461 2023-11-25T05:45:55.716 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:55.719 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:55.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:55.730 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-11-25T05:45:55.902 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:55.906 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:55.906 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:56.018 INFO:teuthology.orchestra.run.smithi002.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:56.022 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/462 2023-11-25T05:45:56.022 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/462 2023-11-25T05:45:56.022 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:56.024 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:56.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:56.033 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-11-25T05:45:56.205 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:56.209 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:56.209 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:56.373 INFO:teuthology.orchestra.run.smithi002.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T05:45:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/463 2023-11-25T05:45:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/463 2023-11-25T05:45:56.376 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:56.379 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:56.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:56.388 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-11-25T05:45:56.833 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:56.838 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:56.838 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:56.948 INFO:teuthology.orchestra.run.smithi002.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:45:56.951 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/464 2023-11-25T05:45:56.952 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/464 2023-11-25T05:45:56.952 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:45:56.954 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:45:56.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:45:56.963 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-11-25T05:45:57.135 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:45:57.139 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:45:57.139 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:10.093 INFO:teuthology.orchestra.run.smithi002.stdout:generic/465 13s 2023-11-25T05:46:10.196 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/465 2023-11-25T05:46:10.196 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:46:10.196 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:10.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:46:10.196 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-11-25T05:46:10.532 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:46:10.536 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:46:10.536 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:10.696 INFO:teuthology.orchestra.run.smithi002.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:46:10.698 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/466 2023-11-25T05:46:10.698 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/466 2023-11-25T05:46:10.698 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:46:10.700 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:10.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:46:10.710 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-11-25T05:46:10.881 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:46:10.885 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:46:10.885 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:16.401 INFO:teuthology.orchestra.run.smithi002.stdout:generic/467 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/467.out.bad) 2023-11-25T05:46:16.413 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/467.out 2023-11-25 04:09:45.783124156 +0000 2023-11-25T05:46:16.413 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/467.out.bad 2023-11-25 05:46:16.383781565 +0000 2023-11-25T05:46:16.414 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1,5 +1,15 @@ 2023-11-25T05:46:16.414 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 467 2023-11-25T05:46:16.414 INFO:teuthology.orchestra.run.smithi002.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-11-25T05:46:16.414 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000000) opened an unlinked file! 2023-11-25T05:46:16.414 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000001) opened an unlinked file! 2023-11-25T05:46:16.414 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000002) opened an unlinked file! 2023-11-25T05:46:16.414 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000003) opened an unlinked file! 2023-11-25T05:46:16.414 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000004) opened an unlinked file! 2023-11-25T05:46:16.414 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000005) opened an unlinked file! 2023-11-25T05:46:16.415 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000006) opened an unlinked file! 2023-11-25T05:46:16.415 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000007) opened an unlinked file! 2023-11-25T05:46:16.415 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000008) opened an unlinked file! 2023-11-25T05:46:16.415 INFO:teuthology.orchestra.run.smithi002.stdout: +open_by_handle(/tmp/tmp.VDcWebYyYttest/467-dir/file000009) opened an unlinked file! 2023-11-25T05:46:16.415 INFO:teuthology.orchestra.run.smithi002.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-11-25T05:46:16.415 INFO:teuthology.orchestra.run.smithi002.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-11-25T05:46:16.415 INFO:teuthology.orchestra.run.smithi002.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-11-25T05:46:16.438 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/467 2023-11-25T05:46:16.438 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/467 2023-11-25T05:46:16.438 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:46:16.463 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:16.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:46:16.678 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:46:16.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:46:16.678 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-11-25T05:46:17.660 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:46:17.665 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:46:17.665 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:17.828 INFO:teuthology.orchestra.run.smithi002.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:46:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/468 2023-11-25T05:46:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/468 2023-11-25T05:46:17.832 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:46:17.835 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:17.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:46:17.844 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-11-25T05:46:18.105 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:46:18.107 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:46:18.107 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:19.727 INFO:teuthology.orchestra.run.smithi002.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-25T05:46:19.731 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/469 2023-11-25T05:46:19.731 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/469 2023-11-25T05:46:19.731 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:46:19.733 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:19.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:46:19.743 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-11-25T05:46:20.191 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:46:20.196 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:46:20.196 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:20.375 INFO:teuthology.orchestra.run.smithi002.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:46:20.379 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/470 2023-11-25T05:46:20.379 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/470 2023-11-25T05:46:20.379 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:46:20.381 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:20.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:46:20.390 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-11-25T05:46:20.572 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:46:20.576 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:46:20.576 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:46:22.399 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:46:22.402 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:46:52.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:46:52.519 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:47:17.128 INFO:teuthology.orchestra.run.smithi002.stdout:generic/471 57s 2023-11-25T05:47:17.134 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/471 2023-11-25T05:47:17.134 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:17.137 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:17.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:17.154 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-11-25T05:47:17.721 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:17.729 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:17.729 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:17.953 INFO:teuthology.orchestra.run.smithi002.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:17.959 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/472 2023-11-25T05:47:17.959 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/472 2023-11-25T05:47:17.959 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:17.964 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:17.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:17.989 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-11-25T05:47:18.340 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:18.345 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:18.346 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:18.868 INFO:teuthology.orchestra.run.smithi002.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T05:47:18.877 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/473 2023-11-25T05:47:18.877 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/473 2023-11-25T05:47:18.877 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:18.880 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:18.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:18.897 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-11-25T05:47:19.314 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:19.329 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:19.329 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:19.556 INFO:teuthology.orchestra.run.smithi002.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:19.560 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/474 2023-11-25T05:47:19.560 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/474 2023-11-25T05:47:19.560 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:19.562 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:19.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:19.582 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-11-25T05:47:19.897 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:19.901 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:19.901 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:20.466 INFO:teuthology.orchestra.run.smithi002.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:20.469 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/475 2023-11-25T05:47:20.469 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/475 2023-11-25T05:47:20.469 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:20.472 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:20.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:20.483 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-11-25T05:47:20.664 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:20.668 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:20.668 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:20.863 INFO:teuthology.orchestra.run.smithi002.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:20.866 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/476 2023-11-25T05:47:20.866 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/476 2023-11-25T05:47:20.866 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:20.869 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:20.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:20.877 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-11-25T05:47:21.050 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:21.054 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:21.054 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:23.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:47:23.059 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:47:23.476 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T05:47:23.474+0000 7fe9009f3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 472084) UID: 0 2023-11-25T05:47:23.477 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T05:47:23.474+0000 7f607a7b0640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 472084) UID: 0 2023-11-25T05:47:35.667 INFO:teuthology.orchestra.run.smithi002.stdout:generic/477 14s 2023-11-25T05:47:35.860 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/477 2023-11-25T05:47:35.860 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:35.902 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:36.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:36.066 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-11-25T05:47:38.370 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:38.374 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:38.374 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:48.395 INFO:teuthology.orchestra.run.smithi002.stdout:generic/478 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/478.out.bad) 2023-11-25T05:47:48.397 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/478.out 2023-11-25 04:09:45.784124132 +0000 2023-11-25T05:47:48.397 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/478.out.bad 2023-11-25 05:47:48.390663378 +0000 2023-11-25T05:47:48.397 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -10,7 +10,7 @@ 2023-11-25T05:47:48.397 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.397 INFO:teuthology.orchestra.run.smithi002.stdout: get wrlck 2023-11-25T05:47:48.397 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: -lock could be placed 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: +get wrlck 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -25,7 +25,7 @@ 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: get wrlck 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: -lock could be placed 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: +get wrlck 2023-11-25T05:47:48.398 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -37,7 +37,7 @@ 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: get rdlck 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: get rdlck 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: -lock could be placed 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: +get rdlck 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: get rdlck 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: get rdlck 2023-11-25T05:47:48.399 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -46,7 +46,7 @@ 2023-11-25T05:47:48.400 INFO:teuthology.orchestra.run.smithi002.stdout: get rdlck 2023-11-25T05:47:48.400 INFO:teuthology.orchestra.run.smithi002.stdout: get rdlck 2023-11-25T05:47:48.400 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.400 INFO:teuthology.orchestra.run.smithi002.stdout: -lock could be placed 2023-11-25T05:47:48.400 INFO:teuthology.orchestra.run.smithi002.stdout: +get rdlck 2023-11-25T05:47:48.400 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.400 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.400 INFO:teuthology.orchestra.run.smithi002.stdout: lock could be placed 2023-11-25T05:47:48.401 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/478 2023-11-25T05:47:48.401 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/478 2023-11-25T05:47:48.401 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:47:48.402 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:48.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:47:48.411 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:47:48.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:47:48.411 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-11-25T05:47:48.628 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:48.632 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:49.003 INFO:teuthology.orchestra.run.smithi002.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:49.007 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/479 2023-11-25T05:47:49.007 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/479 2023-11-25T05:47:49.007 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:49.009 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:49.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:49.029 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-11-25T05:47:49.228 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:49.232 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:49.232 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:49.353 INFO:teuthology.orchestra.run.smithi002.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:49.356 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/480 2023-11-25T05:47:49.357 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/480 2023-11-25T05:47:49.357 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:49.359 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:49.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:49.369 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-11-25T05:47:49.544 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:49.549 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:49.549 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:49.668 INFO:teuthology.orchestra.run.smithi002.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:49.674 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/481 2023-11-25T05:47:49.674 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/481 2023-11-25T05:47:49.674 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:49.674 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:49.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:49.683 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-11-25T05:47:49.869 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:49.873 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:49.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:50.073 INFO:teuthology.orchestra.run.smithi002.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:50.076 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/482 2023-11-25T05:47:50.076 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/482 2023-11-25T05:47:50.076 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:50.079 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:50.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:50.100 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-11-25T05:47:50.275 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:50.279 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:50.279 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:50.419 INFO:teuthology.orchestra.run.smithi002.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:50.423 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/483 2023-11-25T05:47:50.423 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/483 2023-11-25T05:47:50.423 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:50.425 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:50.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:50.434 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-11-25T05:47:50.606 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:50.610 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:50.610 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:50.742 INFO:teuthology.orchestra.run.smithi002.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:50.745 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/484 2023-11-25T05:47:50.745 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/484 2023-11-25T05:47:50.746 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:50.747 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:50.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:50.756 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-11-25T05:47:50.936 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:50.940 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:50.940 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:51.852 INFO:teuthology.orchestra.run.smithi002.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-25T05:47:51.859 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/485 2023-11-25T05:47:51.859 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/485 2023-11-25T05:47:51.859 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:51.859 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:51.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:51.868 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-11-25T05:47:52.358 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:52.363 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:52.363 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:52.559 INFO:teuthology.orchestra.run.smithi002.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:52.563 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/486 2023-11-25T05:47:52.563 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/486 2023-11-25T05:47:52.563 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:52.565 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:52.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:52.575 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-11-25T05:47:52.751 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:52.755 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:52.756 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:52.891 INFO:teuthology.orchestra.run.smithi002.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:52.895 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/487 2023-11-25T05:47:52.895 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/487 2023-11-25T05:47:52.895 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:52.897 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:52.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:52.906 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-11-25T05:47:53.082 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:53.086 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:53.086 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:53.198 INFO:teuthology.orchestra.run.smithi002.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:53.202 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/488 2023-11-25T05:47:53.202 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/488 2023-11-25T05:47:53.202 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:53.204 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:53.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:53.213 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-11-25T05:47:53.390 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:53.394 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:53.394 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:53.515 INFO:teuthology.orchestra.run.smithi002.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/489 2023-11-25T05:47:53.519 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/489 2023-11-25T05:47:53.519 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:53.521 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:53.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:53.530 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-11-25T05:47:53.706 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:53.710 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:53.710 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:54.617 INFO:teuthology.orchestra.run.smithi002.stdout:generic/490 1s 2023-11-25T05:47:54.623 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/490 2023-11-25T05:47:54.623 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:54.625 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:54.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:54.635 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-11-25T05:47:55.119 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:55.123 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:55.123 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:55.297 INFO:teuthology.orchestra.run.smithi002.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:55.300 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/491 2023-11-25T05:47:55.301 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/491 2023-11-25T05:47:55.301 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:55.303 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:55.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:55.326 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-11-25T05:47:55.518 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:55.522 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:55.522 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:55.638 INFO:teuthology.orchestra.run.smithi002.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/492 2023-11-25T05:47:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/492 2023-11-25T05:47:55.641 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:55.643 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:55.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:55.663 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-11-25T05:47:55.838 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:55.843 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:55.843 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:55.962 INFO:teuthology.orchestra.run.smithi002.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:55.965 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/493 2023-11-25T05:47:55.965 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/493 2023-11-25T05:47:55.965 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:55.968 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:55.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:55.977 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-11-25T05:47:56.152 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:56.156 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:56.156 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:56.286 INFO:teuthology.orchestra.run.smithi002.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:56.289 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/494 2023-11-25T05:47:56.289 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/494 2023-11-25T05:47:56.289 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:56.292 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:56.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:56.302 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-11-25T05:47:56.478 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:56.482 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:56.482 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:56.592 INFO:teuthology.orchestra.run.smithi002.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:56.596 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/495 2023-11-25T05:47:56.596 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/495 2023-11-25T05:47:56.596 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:56.598 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:56.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:56.607 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-11-25T05:47:56.781 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:56.786 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:56.786 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:56.920 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/496 2023-11-25T05:47:56.920 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/496 2023-11-25T05:47:56.920 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:56.921 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:56.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:56.930 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-11-25T05:47:57.104 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:57.108 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:57.109 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:57.219 INFO:teuthology.orchestra.run.smithi002.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:57.222 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/497 2023-11-25T05:47:57.222 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/497 2023-11-25T05:47:57.222 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:57.224 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:57.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:57.233 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-11-25T05:47:57.425 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:57.429 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:57.560 INFO:teuthology.orchestra.run.smithi002.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:57.564 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/498 2023-11-25T05:47:57.564 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/498 2023-11-25T05:47:57.564 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:57.566 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:57.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:57.575 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-11-25T05:47:57.751 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:57.754 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:57.755 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:57.864 INFO:teuthology.orchestra.run.smithi002.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:57.867 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/499 2023-11-25T05:47:57.868 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/499 2023-11-25T05:47:57.868 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:57.870 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:57.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:57.879 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-11-25T05:47:58.054 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:58.058 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:58.058 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:58.207 INFO:teuthology.orchestra.run.smithi002.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:58.211 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/500 2023-11-25T05:47:58.211 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/500 2023-11-25T05:47:58.211 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:58.213 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:58.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:58.232 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-11-25T05:47:58.406 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:58.410 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:58.410 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:58.534 INFO:teuthology.orchestra.run.smithi002.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:58.538 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/501 2023-11-25T05:47:58.538 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/501 2023-11-25T05:47:58.538 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:58.540 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:58.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:58.552 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-11-25T05:47:58.728 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:58.732 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:58.732 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:58.853 INFO:teuthology.orchestra.run.smithi002.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:58.856 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/502 2023-11-25T05:47:58.856 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/502 2023-11-25T05:47:58.856 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:58.859 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:58.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:58.868 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-11-25T05:47:59.043 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:59.046 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:59.046 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:59.163 INFO:teuthology.orchestra.run.smithi002.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:59.166 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/503 2023-11-25T05:47:59.166 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/503 2023-11-25T05:47:59.167 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:59.169 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:59.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:59.178 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-11-25T05:47:59.353 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:59.357 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:59.357 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:59.541 INFO:teuthology.orchestra.run.smithi002.stdout:generic/504 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/504.out.bad) 2023-11-25T05:47:59.542 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/504.out 2023-11-25 04:09:45.786124085 +0000 2023-11-25T05:47:59.542 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/504.out.bad 2023-11-25 05:47:59.535406803 +0000 2023-11-25T05:47:59.542 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1,2 +1,3 @@ 2023-11-25T05:47:59.542 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 504 2023-11-25T05:47:59.542 INFO:teuthology.orchestra.run.smithi002.stdout: +lock info not found 2023-11-25T05:47:59.542 INFO:teuthology.orchestra.run.smithi002.stdout: Silence is golden 2023-11-25T05:47:59.542 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/504 2023-11-25T05:47:59.543 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/504 2023-11-25T05:47:59.543 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T05:47:59.545 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:59.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T05:47:59.554 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T05:47:59.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T05:47:59.554 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-11-25T05:47:59.728 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:47:59.732 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:47:59.733 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:59.843 INFO:teuthology.orchestra.run.smithi002.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:47:59.848 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/505 2023-11-25T05:47:59.848 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/505 2023-11-25T05:47:59.848 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:47:59.850 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:47:59.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:47:59.859 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-11-25T05:48:00.034 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:00.038 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:00.038 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:00.151 INFO:teuthology.orchestra.run.smithi002.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:00.154 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/506 2023-11-25T05:48:00.154 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/506 2023-11-25T05:48:00.154 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:00.157 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:00.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:00.166 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-11-25T05:48:00.366 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:00.370 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:00.370 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:00.535 INFO:teuthology.orchestra.run.smithi002.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-11-25T05:48:00.539 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/507 2023-11-25T05:48:00.539 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/507 2023-11-25T05:48:00.539 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:00.541 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:00.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:00.550 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-11-25T05:48:00.726 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:00.730 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:00.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:00.859 INFO:teuthology.orchestra.run.smithi002.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-11-25T05:48:00.863 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/508 2023-11-25T05:48:00.863 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/508 2023-11-25T05:48:00.863 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:00.865 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:00.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:00.885 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-11-25T05:48:01.061 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:01.065 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:01.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:01.189 INFO:teuthology.orchestra.run.smithi002.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:01.193 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/509 2023-11-25T05:48:01.193 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/509 2023-11-25T05:48:01.193 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:01.195 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:01.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:01.204 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-11-25T05:48:01.378 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:01.382 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:01.382 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:01.511 INFO:teuthology.orchestra.run.smithi002.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:01.514 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/510 2023-11-25T05:48:01.515 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/510 2023-11-25T05:48:01.515 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:01.518 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:01.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:01.526 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-11-25T05:48:01.705 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:01.709 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:01.710 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:01.819 INFO:teuthology.orchestra.run.smithi002.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:01.822 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/511 2023-11-25T05:48:01.822 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/511 2023-11-25T05:48:01.822 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:01.825 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:01.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:01.843 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-11-25T05:48:02.020 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:02.024 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:02.025 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:02.151 INFO:teuthology.orchestra.run.smithi002.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:02.155 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/512 2023-11-25T05:48:02.155 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/512 2023-11-25T05:48:02.156 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:02.157 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:02.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:02.168 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-11-25T05:48:02.343 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:02.347 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:02.347 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:02.458 INFO:teuthology.orchestra.run.smithi002.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:02.462 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/513 2023-11-25T05:48:02.462 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/513 2023-11-25T05:48:02.462 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:02.464 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:02.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:02.473 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-11-25T05:48:02.649 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:02.654 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:02.654 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:02.767 INFO:teuthology.orchestra.run.smithi002.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:02.771 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/514 2023-11-25T05:48:02.771 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/514 2023-11-25T05:48:02.771 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:02.774 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:02.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:02.782 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-11-25T05:48:02.957 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:02.961 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:02.961 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:03.071 INFO:teuthology.orchestra.run.smithi002.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:03.075 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/515 2023-11-25T05:48:03.075 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/515 2023-11-25T05:48:03.075 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:03.077 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:03.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:03.086 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-11-25T05:48:03.261 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:03.265 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:03.265 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:03.424 INFO:teuthology.orchestra.run.smithi002.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-11-25T05:48:03.427 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/516 2023-11-25T05:48:03.428 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/516 2023-11-25T05:48:03.428 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:03.430 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:03.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:03.472 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-11-25T05:48:03.928 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:03.934 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:03.934 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:04.060 INFO:teuthology.orchestra.run.smithi002.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:04.064 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/517 2023-11-25T05:48:04.064 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/517 2023-11-25T05:48:04.065 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:04.066 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:04.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:04.075 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-11-25T05:48:04.249 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:04.253 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:04.253 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:04.364 INFO:teuthology.orchestra.run.smithi002.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:04.368 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/518 2023-11-25T05:48:04.368 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/518 2023-11-25T05:48:04.369 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:04.369 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:04.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:04.389 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-11-25T05:48:04.563 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:04.566 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:04.567 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:04.677 INFO:teuthology.orchestra.run.smithi002.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:04.681 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/519 2023-11-25T05:48:04.681 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/519 2023-11-25T05:48:04.681 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:04.684 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:04.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:04.693 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-11-25T05:48:04.865 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:04.869 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:04.869 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:04.990 INFO:teuthology.orchestra.run.smithi002.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T05:48:04.994 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/520 2023-11-25T05:48:04.994 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/520 2023-11-25T05:48:04.994 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T05:48:04.996 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:48:05.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T05:48:05.005 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-11-25T05:48:05.179 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T05:48:05.183 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T05:48:05.183 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T05:50:27.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:50:27.148 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:50:57.232 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:50:57.235 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:51:27.288 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:51:27.291 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:51:57.369 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:51:57.372 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:52:27.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:52:27.429 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:52:57.492 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:52:57.495 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:53:27.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:53:27.739 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:53:57.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:53:57.795 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:54:27.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:54:27.859 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:54:57.938 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:54:57.941 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:55:28.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:55:28.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:55:58.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:55:58.082 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:56:28.129 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:56:28.132 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:56:58.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:56:58.196 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:57:28.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:57:28.265 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:57:58.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:57:58.327 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:58:28.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:58:28.398 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:58:58.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:58:58.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:59:28.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T05:59:31.875 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:00:02.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:00:02.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:00:32.246 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:00:32.249 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:01:02.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:01:02.305 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:01:32.375 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:01:32.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:02:02.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:02:02.442 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:02:32.504 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:02:32.507 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:03:02.569 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:03:02.571 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:03:33.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:03:33.014 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:04:03.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:04:03.076 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:04:33.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:04:33.157 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:05:03.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:05:03.221 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:05:33.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:05:33.284 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:06:03.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:06:03.342 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:06:33.406 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:06:33.409 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:07:03.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:07:03.498 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:07:33.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:07:33.912 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:07:33.949 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T06:07:33.948+0000 7f24fefda640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99969) UID: 0 2023-11-25T06:07:33.949 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T06:07:33.948+0000 7f46899b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99969) UID: 0 2023-11-25T06:07:33.949 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T06:07:33.948+0000 7f36e3756640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99969) UID: 0 2023-11-25T06:07:33.949 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T06:07:33.948+0000 7f82c4e49640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99969) UID: 0 2023-11-25T06:10:09.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:10:09.920 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:10:40.161 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:10:40.164 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:11:10.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:11:10.229 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:11:40.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:11:40.286 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:12:10.347 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:12:10.350 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:12:40.420 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:12:40.423 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:13:10.852 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:13:10.854 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:13:40.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:13:40.919 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:14:10.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:14:10.985 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:14:41.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:14:41.050 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:15:11.135 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:15:11.138 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:15:41.213 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:15:41.215 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:16:11.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:16:11.277 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:16:41.333 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:16:41.337 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:17:11.397 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:17:11.400 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:17:41.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:17:41.472 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:18:11.533 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:18:11.540 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:18:41.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:18:41.600 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:19:11.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:19:11.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:19:41.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:19:41.781 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:20:11.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:20:11.852 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:20:41.914 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:20:41.917 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:21:11.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:21:11.982 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:21:42.045 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:21:43.075 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:21:43.110 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T06:21:43.110+0000 7f24fefda640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100413) UID: 0 2023-11-25T06:21:43.110 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T06:21:43.110+0000 7f46899b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100413) UID: 0 2023-11-25T06:21:43.111 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T06:21:43.110+0000 7f82c4e49640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100413) UID: 0 2023-11-25T06:21:43.111 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T06:21:43.110+0000 7f36e3756640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100413) UID: 0 2023-11-25T06:24:01.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:24:01.700 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:24:31.762 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:24:31.765 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:25:01.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:25:01.828 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:25:31.887 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:25:31.889 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:26:01.947 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:26:01.950 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:26:32.009 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:26:32.011 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:27:02.094 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:27:02.097 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:27:32.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:27:32.445 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:28:02.506 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:28:02.509 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:28:32.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:28:32.566 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:29:02.644 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:29:02.647 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:29:02.683 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T06:29:02.683+0000 7fa32f6d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493404) UID: 0 2023-11-25T06:29:02.684 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T06:29:02.683+0000 7f7298afa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493404) UID: 0 2023-11-25T06:29:02.684 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T06:29:02.683+0000 7feffe992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493404) UID: 0 2023-11-25T06:29:02.684 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T06:29:02.683+0000 7fc60d779640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 493404) UID: 0 2023-11-25T06:31:38.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:31:38.573 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:32:08.864 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:32:08.867 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:32:38.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:32:38.925 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:33:08.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:33:08.987 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:33:39.041 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:33:39.044 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:34:09.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:34:09.109 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:34:39.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:34:39.172 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:35:07.213 INFO:teuthology.orchestra.run.smithi002.stdout:generic/521 2822s 2023-11-25T06:35:07.252 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/521 2023-11-25T06:35:07.252 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T06:35:07.254 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T06:35:07.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T06:35:07.272 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-11-25T06:35:07.743 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T06:35:07.747 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T06:35:07.747 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T06:35:09.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:35:09.252 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:35:39.673 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:35:39.675 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:36:09.747 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:36:09.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:36:39.809 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:36:39.811 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:37:09.861 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:37:09.864 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:37:39.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:37:39.940 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:38:09.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:38:10.001 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:38:40.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:38:40.124 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:39:10.189 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:39:10.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:39:40.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:39:40.256 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:40:10.325 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:40:10.328 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:40:40.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:40:40.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:41:10.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:41:10.641 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:41:40.703 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:41:40.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:42:11.007 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:42:11.010 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:42:41.064 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:42:41.067 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:43:11.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:43:11.123 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:43:41.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:43:41.188 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:44:11.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:44:11.250 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:44:41.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:44:43.996 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:45:14.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:45:14.069 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:45:44.123 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:45:44.127 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:46:14.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:46:14.187 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:46:44.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:46:44.246 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:47:14.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:47:14.318 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:47:44.395 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:47:44.397 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:48:14.752 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:48:14.754 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:48:44.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:48:44.802 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:49:15.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:49:15.225 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:49:45.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:49:45.298 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:50:15.368 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:50:15.370 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:50:45.635 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:50:45.638 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:51:15.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:51:15.707 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:51:15.754 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T06:51:15.752+0000 7fe9009f3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 494599) UID: 0 2023-11-25T06:51:15.754 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T06:51:15.752+0000 7f607a7b0640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 494599) UID: 0 2023-11-25T06:53:48.603 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:53:48.606 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:54:18.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:54:18.679 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:54:48.738 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:54:48.741 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:55:18.831 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:55:18.833 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:55:48.908 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:55:48.912 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:56:18.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:56:18.972 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:56:49.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:56:49.031 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:57:19.092 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:57:19.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:57:49.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:57:49.176 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:58:19.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:58:19.242 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:58:49.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:58:49.615 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:59:19.674 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:59:19.677 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:59:49.740 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T06:59:49.743 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:00:19.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:00:19.806 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:00:49.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:00:49.871 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:00:49.906 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T07:00:49.905+0000 7f24fefda640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101629) UID: 0 2023-11-25T07:00:49.907 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T07:00:49.905+0000 7f46899b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101629) UID: 0 2023-11-25T07:00:49.907 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T07:00:49.905+0000 7f36e3756640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101629) UID: 0 2023-11-25T07:00:49.908 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T07:00:49.905+0000 7f82c4e49640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101629) UID: 0 2023-11-25T07:03:06.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:03:06.956 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:03:37.019 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:03:37.022 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:04:07.082 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:04:07.085 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:04:37.272 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:04:37.277 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:05:07.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:05:07.340 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:05:37.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:05:37.403 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:06:07.465 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:06:07.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:06:37.513 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:06:37.515 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:07:07.595 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:07:07.598 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:07:18.306 INFO:teuthology.orchestra.run.smithi002.stdout:generic/522 1931s 2023-11-25T07:07:18.312 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/522 2023-11-25T07:07:18.312 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:18.321 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:18.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:18.331 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-11-25T07:07:18.506 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:18.510 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:18.510 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:18.644 INFO:teuthology.orchestra.run.smithi002.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:18.647 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/523 2023-11-25T07:07:18.648 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/523 2023-11-25T07:07:18.648 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:18.650 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:18.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:18.661 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-11-25T07:07:18.834 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:18.838 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:18.839 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:18.946 INFO:teuthology.orchestra.run.smithi002.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:18.950 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/524 2023-11-25T07:07:18.950 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/524 2023-11-25T07:07:18.951 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:18.952 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:18.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:18.961 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-11-25T07:07:19.133 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:19.137 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:19.137 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:19.246 INFO:teuthology.orchestra.run.smithi002.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:19.250 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/525 2023-11-25T07:07:19.250 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/525 2023-11-25T07:07:19.250 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:19.252 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:19.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:19.261 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-11-25T07:07:19.434 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:19.438 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:19.438 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:19.586 INFO:teuthology.orchestra.run.smithi002.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:19.590 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/526 2023-11-25T07:07:19.590 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/526 2023-11-25T07:07:19.590 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:19.592 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:19.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:19.601 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-11-25T07:07:19.774 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:19.779 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:19.779 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:19.903 INFO:teuthology.orchestra.run.smithi002.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:19.906 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/527 2023-11-25T07:07:19.907 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/527 2023-11-25T07:07:19.907 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:19.909 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:19.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:19.918 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-11-25T07:07:20.093 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:20.097 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:20.097 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:20.236 INFO:teuthology.orchestra.run.smithi002.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-11-25T07:07:20.240 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/528 2023-11-25T07:07:20.240 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/528 2023-11-25T07:07:20.240 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:20.242 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:20.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:20.252 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-11-25T07:07:20.426 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:20.430 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:20.431 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:20.578 INFO:teuthology.orchestra.run.smithi002.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-11-25T07:07:20.582 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/529 2023-11-25T07:07:20.582 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/529 2023-11-25T07:07:20.582 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:20.584 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:20.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:20.593 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-11-25T07:07:20.769 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:20.773 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:20.774 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:20.882 INFO:teuthology.orchestra.run.smithi002.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:20.885 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/530 2023-11-25T07:07:20.886 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/530 2023-11-25T07:07:20.886 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:20.888 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:20.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:20.897 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-11-25T07:07:21.069 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:21.073 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:21.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:21.181 INFO:teuthology.orchestra.run.smithi002.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:21.185 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/531 2023-11-25T07:07:21.185 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/531 2023-11-25T07:07:21.185 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:21.187 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:21.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:21.196 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-11-25T07:07:21.372 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:21.376 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:21.376 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:21.537 INFO:teuthology.orchestra.run.smithi002.stdout:generic/532 0s 2023-11-25T07:07:21.543 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/532 2023-11-25T07:07:21.543 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:21.545 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:21.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:21.554 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-11-25T07:07:21.727 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:21.731 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:21.732 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:22.093 INFO:teuthology.orchestra.run.smithi002.stdout:generic/533 1s 2023-11-25T07:07:22.099 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/533 2023-11-25T07:07:22.099 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:22.101 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:22.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:22.110 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-11-25T07:07:22.282 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:22.286 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:22.286 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:22.405 INFO:teuthology.orchestra.run.smithi002.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:22.408 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/534 2023-11-25T07:07:22.408 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/534 2023-11-25T07:07:22.409 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:22.411 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:22.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:22.420 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-11-25T07:07:22.593 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:22.597 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:22.598 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:22.717 INFO:teuthology.orchestra.run.smithi002.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:22.721 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/535 2023-11-25T07:07:22.721 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/535 2023-11-25T07:07:22.721 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:22.723 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:22.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:22.732 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-11-25T07:07:22.905 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:22.910 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:22.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:23.017 INFO:teuthology.orchestra.run.smithi002.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:23.021 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/536 2023-11-25T07:07:23.021 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/536 2023-11-25T07:07:23.021 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:23.024 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:23.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:23.032 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-11-25T07:07:23.206 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:23.210 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:23.210 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:23.323 INFO:teuthology.orchestra.run.smithi002.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:07:23.326 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/537 2023-11-25T07:07:23.327 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/537 2023-11-25T07:07:23.327 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:07:23.329 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:23.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:07:23.338 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-11-25T07:07:23.511 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:07:23.516 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:07:23.516 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:07:37.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:07:37.662 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:08:07.734 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:08:07.738 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:08:37.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:08:37.810 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:09:07.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:09:07.874 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:09:37.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:09:37.963 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:10:08.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:10:08.053 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:10:38.122 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:10:38.126 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:10:38.164 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T07:10:38.162+0000 7fa32f6d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 502747) UID: 0 2023-11-25T07:10:38.165 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T07:10:38.162+0000 7f7298afa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 502747) UID: 0 2023-11-25T07:10:38.165 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T07:10:38.162+0000 7feffe992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 502747) UID: 0 2023-11-25T07:10:38.165 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T07:10:38.162+0000 7fc60d779640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 502747) UID: 0 2023-11-25T07:13:12.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:13:12.346 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:13:12.382 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T07:13:12.380+0000 7f24fefda640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101957) UID: 0 2023-11-25T07:13:12.382 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T07:13:12.380+0000 7f46899b2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101957) UID: 0 2023-11-25T07:13:12.382 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T07:13:12.380+0000 7f82c4e49640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101957) UID: 0 2023-11-25T07:13:12.383 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T07:13:12.380+0000 7f36e3756640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101957) UID: 0 2023-11-25T07:15:37.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:15:37.277 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:16:07.338 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:16:07.341 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:16:37.402 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:16:37.404 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:17:07.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:17:07.494 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:17:37.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:17:37.559 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:18:07.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:18:07.618 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:18:37.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:18:37.679 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:18:37.716 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T07:18:37.715+0000 7fa32f6d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504178) UID: 0 2023-11-25T07:18:37.716 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T07:18:37.715+0000 7f7298afa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504178) UID: 0 2023-11-25T07:18:37.717 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T07:18:37.715+0000 7fc60d779640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504178) UID: 0 2023-11-25T07:18:37.717 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T07:18:37.715+0000 7feffe992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 504178) UID: 0 2023-11-25T07:21:04.916 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:21:04.919 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:21:34.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:21:34.982 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:22:05.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:22:05.071 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:22:35.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:22:35.154 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:23:05.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:23:05.210 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:23:35.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:23:35.281 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:24:05.336 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:24:05.338 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:24:35.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:24:35.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:25:05.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:25:05.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:25:35.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:25:35.530 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:26:05.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:26:05.594 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:26:35.647 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:26:35.650 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:27:05.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:27:05.727 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:27:36.073 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:27:36.075 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:28:06.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:28:06.141 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:28:36.311 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:28:36.314 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:29:06.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:29:06.469 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:29:36.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:29:36.542 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:30:06.606 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:30:06.609 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:30:36.677 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:30:36.680 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:31:06.740 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:31:06.744 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:31:06.778 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T07:31:06.776+0000 7fa32f6d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506573) UID: 0 2023-11-25T07:31:06.779 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T07:31:06.776+0000 7f7298afa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506573) UID: 0 2023-11-25T07:31:06.779 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T07:31:06.776+0000 7feffe992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506573) UID: 0 2023-11-25T07:31:06.779 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T07:31:06.776+0000 7fc60d779640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 506573) UID: 0 2023-11-25T07:33:30.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:33:30.904 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:34:00.970 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:34:00.973 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:34:31.037 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:34:31.040 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:35:01.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:35:01.103 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:35:31.172 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:35:31.175 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:36:01.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:36:01.239 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:36:31.317 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:36:31.320 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:37:01.398 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:37:01.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:37:31.457 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:37:31.460 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:38:01.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:38:01.558 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:38:31.618 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:38:31.620 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:39:01.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:39:01.686 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:39:31.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:39:31.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:40:01.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:40:01.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:40:31.904 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:40:31.906 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:41:01.960 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:41:01.962 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:41:32.033 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:41:32.036 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:42:02.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:42:02.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:42:32.171 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:42:32.174 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:43:02.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:43:02.564 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:43:32.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:43:32.637 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:44:02.698 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:44:02.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:44:32.771 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:44:32.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:45:02.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:45:02.831 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:45:32.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:45:32.901 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:45:48.922 INFO:teuthology.orchestra.run.smithi002.stdout:generic/538 2305s 2023-11-25T07:45:48.952 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/538 2023-11-25T07:45:48.953 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:48.955 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:48.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:48.985 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-11-25T07:45:49.474 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:49.478 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:49.478 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:51.159 INFO:teuthology.orchestra.run.smithi002.stdout:generic/539 2s 2023-11-25T07:45:51.165 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/539 2023-11-25T07:45:51.165 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:51.167 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:51.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:51.176 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-11-25T07:45:51.658 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:51.662 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:51.662 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:51.774 INFO:teuthology.orchestra.run.smithi002.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:51.777 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/540 2023-11-25T07:45:51.777 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/540 2023-11-25T07:45:51.777 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:51.779 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:51.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:51.788 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-11-25T07:45:51.962 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:51.966 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:51.966 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:52.076 INFO:teuthology.orchestra.run.smithi002.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:52.080 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/541 2023-11-25T07:45:52.080 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/541 2023-11-25T07:45:52.080 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:52.082 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:52.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:52.091 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-11-25T07:45:52.269 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:52.273 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:52.274 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:52.384 INFO:teuthology.orchestra.run.smithi002.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:52.388 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/542 2023-11-25T07:45:52.388 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/542 2023-11-25T07:45:52.388 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:52.390 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:52.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:52.399 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-11-25T07:45:52.572 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:52.576 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:52.576 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:52.686 INFO:teuthology.orchestra.run.smithi002.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:52.690 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/543 2023-11-25T07:45:52.690 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/543 2023-11-25T07:45:52.690 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:52.692 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:52.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:52.701 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-11-25T07:45:52.872 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:52.876 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:52.876 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:52.990 INFO:teuthology.orchestra.run.smithi002.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:52.993 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/544 2023-11-25T07:45:52.993 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/544 2023-11-25T07:45:52.993 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:52.995 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:53.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:53.004 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-11-25T07:45:53.177 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:53.181 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:53.182 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:53.362 INFO:teuthology.orchestra.run.smithi002.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-11-25T07:45:53.366 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/545 2023-11-25T07:45:53.366 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/545 2023-11-25T07:45:53.366 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:53.368 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:53.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:53.377 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-11-25T07:45:53.560 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:53.564 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:53.564 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:53.741 INFO:teuthology.orchestra.run.smithi002.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:53.744 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/546 2023-11-25T07:45:53.744 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/546 2023-11-25T07:45:53.745 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:53.747 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:53.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:53.756 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-11-25T07:45:53.929 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:53.933 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:53.933 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:54.059 INFO:teuthology.orchestra.run.smithi002.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/547 2023-11-25T07:45:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/547 2023-11-25T07:45:54.062 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:54.065 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:54.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:54.073 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-11-25T07:45:54.250 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:54.254 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:54.255 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:54.391 INFO:teuthology.orchestra.run.smithi002.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:54.396 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/548 2023-11-25T07:45:54.396 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/548 2023-11-25T07:45:54.396 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:54.397 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:54.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:54.406 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-11-25T07:45:54.580 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:54.584 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:54.584 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:54.720 INFO:teuthology.orchestra.run.smithi002.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/549 2023-11-25T07:45:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/549 2023-11-25T07:45:54.724 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:54.727 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:54.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:54.735 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-11-25T07:45:54.908 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:54.912 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:54.912 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:55.059 INFO:teuthology.orchestra.run.smithi002.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:55.063 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/550 2023-11-25T07:45:55.063 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/550 2023-11-25T07:45:55.063 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:55.065 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:55.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:55.074 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-11-25T07:45:55.247 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:55.251 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:55.251 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:55.361 INFO:teuthology.orchestra.run.smithi002.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:55.364 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/551 2023-11-25T07:45:55.364 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/551 2023-11-25T07:45:55.364 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:55.367 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:55.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:55.376 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-11-25T07:45:55.549 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:55.552 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:55.553 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:55.674 INFO:teuthology.orchestra.run.smithi002.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/552 2023-11-25T07:45:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/552 2023-11-25T07:45:55.678 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:55.680 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:55.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:55.688 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-11-25T07:45:55.862 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:55.867 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:55.867 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:56.047 INFO:teuthology.orchestra.run.smithi002.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-11-25T07:45:56.050 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/553 2023-11-25T07:45:56.050 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/553 2023-11-25T07:45:56.050 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:56.053 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:56.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:56.061 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-11-25T07:45:56.527 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:56.531 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:56.532 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:56.644 INFO:teuthology.orchestra.run.smithi002.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:56.647 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/554 2023-11-25T07:45:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/554 2023-11-25T07:45:56.648 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:56.650 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:56.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:56.659 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-11-25T07:45:56.833 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:56.837 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:56.837 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:56.984 INFO:teuthology.orchestra.run.smithi002.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-11-25T07:45:56.988 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/555 2023-11-25T07:45:56.988 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/555 2023-11-25T07:45:56.988 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:56.990 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:56.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:56.999 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-11-25T07:45:57.476 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:57.480 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:57.480 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:57.591 INFO:teuthology.orchestra.run.smithi002.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:57.594 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/556 2023-11-25T07:45:57.594 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/556 2023-11-25T07:45:57.594 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:57.596 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:57.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:57.605 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-11-25T07:45:57.778 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:57.782 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:57.783 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:57.902 INFO:teuthology.orchestra.run.smithi002.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:57.905 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/557 2023-11-25T07:45:57.905 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/557 2023-11-25T07:45:57.905 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:57.908 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:57.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:57.917 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-11-25T07:45:58.090 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:58.094 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:58.094 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:58.357 INFO:teuthology.orchestra.run.smithi002.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:58.361 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/558 2023-11-25T07:45:58.362 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/558 2023-11-25T07:45:58.362 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:58.364 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:58.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:58.386 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-11-25T07:45:58.563 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:58.567 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:58.567 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:58.677 INFO:teuthology.orchestra.run.smithi002.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:58.681 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/559 2023-11-25T07:45:58.681 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/559 2023-11-25T07:45:58.682 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:58.683 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:58.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:58.702 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-11-25T07:45:58.873 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:58.878 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:58.878 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:58.988 INFO:teuthology.orchestra.run.smithi002.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:58.992 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/560 2023-11-25T07:45:58.992 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/560 2023-11-25T07:45:58.992 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:58.994 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:59.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:59.002 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-11-25T07:45:59.177 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:59.181 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:59.181 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:59.293 INFO:teuthology.orchestra.run.smithi002.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:59.294 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/561 2023-11-25T07:45:59.294 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/561 2023-11-25T07:45:59.294 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:59.297 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:59.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:59.306 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-11-25T07:45:59.479 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:59.483 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:59.483 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:59.609 INFO:teuthology.orchestra.run.smithi002.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:59.612 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/562 2023-11-25T07:45:59.612 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/562 2023-11-25T07:45:59.612 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:59.615 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:59.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:59.624 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-11-25T07:45:59.796 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:45:59.800 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:45:59.800 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:59.975 INFO:teuthology.orchestra.run.smithi002.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:45:59.978 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/563 2023-11-25T07:45:59.979 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/563 2023-11-25T07:45:59.979 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:45:59.981 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:45:59.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:45:59.990 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-11-25T07:46:00.163 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:00.167 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:00.168 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:00.580 INFO:teuthology.orchestra.run.smithi002.stdout:generic/564 0s 2023-11-25T07:46:00.585 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/564 2023-11-25T07:46:00.585 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:00.587 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:00.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:00.597 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-11-25T07:46:01.098 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:01.102 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:01.102 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:01.226 INFO:teuthology.orchestra.run.smithi002.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:01.230 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/565 2023-11-25T07:46:01.230 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/565 2023-11-25T07:46:01.230 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:01.232 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:01.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:01.255 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-11-25T07:46:01.428 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:01.432 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:01.432 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:01.553 INFO:teuthology.orchestra.run.smithi002.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:01.556 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/566 2023-11-25T07:46:01.557 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/566 2023-11-25T07:46:01.557 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:01.559 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:01.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:01.568 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-11-25T07:46:01.742 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:01.746 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:01.746 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:01.860 INFO:teuthology.orchestra.run.smithi002.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:01.864 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/567 2023-11-25T07:46:01.864 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/567 2023-11-25T07:46:01.864 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:01.867 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:01.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:01.876 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-11-25T07:46:02.050 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:02.054 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:02.054 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:02.230 INFO:teuthology.orchestra.run.smithi002.stdout:generic/568 0s 2023-11-25T07:46:02.258 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/568 2023-11-25T07:46:02.258 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:02.268 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:02.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:02.284 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-11-25T07:46:02.760 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:02.764 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:02.764 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:02.925 INFO:teuthology.orchestra.run.smithi002.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:02.929 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/569 2023-11-25T07:46:02.929 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/569 2023-11-25T07:46:02.929 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:02.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:02.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:02.940 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-11-25T07:46:02.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:46:02.985 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:46:03.118 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:03.122 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:03.122 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:03.234 INFO:teuthology.orchestra.run.smithi002.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:03.238 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/570 2023-11-25T07:46:03.238 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/570 2023-11-25T07:46:03.238 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:03.241 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:03.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:03.260 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-11-25T07:46:03.435 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:03.439 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:03.439 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:09.703 INFO:teuthology.orchestra.run.smithi002.stdout:generic/571 6s 2023-11-25T07:46:09.709 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/571 2023-11-25T07:46:09.709 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:09.712 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:09.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:09.722 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-11-25T07:46:10.213 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:10.217 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:10.217 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:10.328 INFO:teuthology.orchestra.run.smithi002.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:10.332 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/572 2023-11-25T07:46:10.332 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/572 2023-11-25T07:46:10.332 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:10.334 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:10.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:10.343 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-11-25T07:46:10.515 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:10.519 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:10.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:10.628 INFO:teuthology.orchestra.run.smithi002.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:10.631 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/573 2023-11-25T07:46:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/573 2023-11-25T07:46:10.632 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:10.634 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:10.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:10.643 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-11-25T07:46:10.816 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:10.820 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:10.820 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:10.930 INFO:teuthology.orchestra.run.smithi002.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/574 2023-11-25T07:46:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/574 2023-11-25T07:46:10.934 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:10.937 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:10.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:10.945 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-11-25T07:46:11.119 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:11.123 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:11.123 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:11.238 INFO:teuthology.orchestra.run.smithi002.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:11.242 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/575 2023-11-25T07:46:11.242 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/575 2023-11-25T07:46:11.242 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:11.244 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:11.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:11.252 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-11-25T07:46:11.425 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:11.430 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:11.430 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:11.566 INFO:teuthology.orchestra.run.smithi002.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:11.570 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/576 2023-11-25T07:46:11.570 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/576 2023-11-25T07:46:11.570 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:11.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:11.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:11.581 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-11-25T07:46:11.756 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:11.760 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:11.760 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:11.890 INFO:teuthology.orchestra.run.smithi002.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:11.893 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/577 2023-11-25T07:46:11.894 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/577 2023-11-25T07:46:11.894 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:11.896 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:11.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:11.904 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-11-25T07:46:12.078 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:12.082 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:12.082 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:12.225 INFO:teuthology.orchestra.run.smithi002.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-25T07:46:12.228 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/578 2023-11-25T07:46:12.228 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/578 2023-11-25T07:46:12.228 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:12.231 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:12.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:12.239 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-11-25T07:46:12.414 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:12.418 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:12.418 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:12.546 INFO:teuthology.orchestra.run.smithi002.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:12.550 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/579 2023-11-25T07:46:12.550 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/579 2023-11-25T07:46:12.550 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:12.552 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:12.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:12.562 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-11-25T07:46:12.738 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:12.742 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:12.742 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:12.882 INFO:teuthology.orchestra.run.smithi002.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:12.886 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/580 2023-11-25T07:46:12.886 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/580 2023-11-25T07:46:12.886 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:12.888 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:12.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:12.897 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-11-25T07:46:13.072 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:13.076 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:13.076 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:13.739 INFO:teuthology.orchestra.run.smithi002.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:13.743 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/581 2023-11-25T07:46:13.743 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/581 2023-11-25T07:46:13.743 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:13.746 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:13.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:13.756 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-11-25T07:46:13.934 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:13.938 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:13.938 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:14.076 INFO:teuthology.orchestra.run.smithi002.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:14.079 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/582 2023-11-25T07:46:14.079 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/582 2023-11-25T07:46:14.080 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:14.082 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:14.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:14.091 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-11-25T07:46:14.269 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:14.273 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:14.409 INFO:teuthology.orchestra.run.smithi002.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:14.412 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/583 2023-11-25T07:46:14.412 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/583 2023-11-25T07:46:14.413 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:14.415 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:14.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:14.424 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-11-25T07:46:14.598 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:14.602 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:14.603 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:14.739 INFO:teuthology.orchestra.run.smithi002.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:14.742 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/584 2023-11-25T07:46:14.743 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/584 2023-11-25T07:46:14.743 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:14.744 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:14.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:14.754 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-11-25T07:46:14.930 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:14.934 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:14.934 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:15.044 INFO:teuthology.orchestra.run.smithi002.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:15.048 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/585 2023-11-25T07:46:15.048 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/585 2023-11-25T07:46:15.048 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:15.050 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:15.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:15.062 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-11-25T07:46:15.235 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:15.239 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:15.239 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:33.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:46:33.059 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:46:33.464 INFO:teuthology.orchestra.run.smithi002.stdout:generic/586 18s 2023-11-25T07:46:33.470 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/586 2023-11-25T07:46:33.470 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:33.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:33.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:33.484 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-11-25T07:46:34.018 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:34.023 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:34.023 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:34.279 INFO:teuthology.orchestra.run.smithi002.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-11-25T07:46:34.283 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/587 2023-11-25T07:46:34.283 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/587 2023-11-25T07:46:34.283 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:34.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:34.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:34.296 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-11-25T07:46:34.478 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:34.482 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:34.482 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:34.613 INFO:teuthology.orchestra.run.smithi002.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:34.617 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/588 2023-11-25T07:46:34.617 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/588 2023-11-25T07:46:34.617 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:34.620 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:34.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:34.629 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-11-25T07:46:34.803 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:34.807 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:34.807 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:34.923 INFO:teuthology.orchestra.run.smithi002.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:34.929 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/589 2023-11-25T07:46:34.929 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/589 2023-11-25T07:46:34.930 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:34.930 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:34.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:34.938 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-11-25T07:46:35.113 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:35.118 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:35.118 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:35.229 INFO:teuthology.orchestra.run.smithi002.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:35.232 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/590 2023-11-25T07:46:35.232 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/590 2023-11-25T07:46:35.232 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:35.234 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:35.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:35.244 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-11-25T07:46:35.417 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:35.421 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:35.421 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:35.693 INFO:teuthology.orchestra.run.smithi002.stdout:generic/591 0s 2023-11-25T07:46:35.699 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/591 2023-11-25T07:46:35.699 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:35.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:35.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:35.711 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-11-25T07:46:36.198 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:36.202 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:36.202 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:36.338 INFO:teuthology.orchestra.run.smithi002.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:36.342 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/592 2023-11-25T07:46:36.342 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/592 2023-11-25T07:46:36.342 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:36.344 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:36.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:36.353 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-11-25T07:46:36.528 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:36.533 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:36.533 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:36.670 INFO:teuthology.orchestra.run.smithi002.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:36.673 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/593 2023-11-25T07:46:36.673 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/593 2023-11-25T07:46:36.673 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:36.675 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:36.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:36.685 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-11-25T07:46:36.858 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:36.863 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:36.863 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:36.973 INFO:teuthology.orchestra.run.smithi002.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:36.978 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/594 2023-11-25T07:46:36.978 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/594 2023-11-25T07:46:36.978 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:36.979 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:36.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:36.989 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-11-25T07:46:37.161 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:37.165 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:37.166 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:37.303 INFO:teuthology.orchestra.run.smithi002.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:37.306 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/595 2023-11-25T07:46:37.306 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/595 2023-11-25T07:46:37.306 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:37.309 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:37.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:37.317 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-11-25T07:46:37.489 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:37.493 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:37.493 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:37.682 INFO:teuthology.orchestra.run.smithi002.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-11-25T07:46:37.685 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/596 2023-11-25T07:46:37.685 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/596 2023-11-25T07:46:37.685 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:37.688 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:37.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:37.697 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-11-25T07:46:37.873 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:37.877 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:37.877 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:38.427 INFO:teuthology.orchestra.run.smithi002.stdout:generic/597 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/597.out.bad) 2023-11-25T07:46:38.428 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/597.out 2023-11-25 04:09:45.793123921 +0000 2023-11-25T07:46:38.429 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/597.out.bad 2023-11-25 07:46:38.422826444 +0000 2023-11-25T07:46:38.429 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -4,11 +4,11 @@ 2023-11-25T07:46:38.429 INFO:teuthology.orchestra.run.smithi002.stdout: fs.protected_symlinks = 0 2023-11-25T07:46:38.429 INFO:teuthology.orchestra.run.smithi002.stdout: successfully followed symlink 2023-11-25T07:46:38.429 INFO:teuthology.orchestra.run.smithi002.stdout: fs.protected_symlinks = 1 2023-11-25T07:46:38.429 INFO:teuthology.orchestra.run.smithi002.stdout: -Permission denied 2023-11-25T07:46:38.429 INFO:teuthology.orchestra.run.smithi002.stdout: +successfully followed symlink 2023-11-25T07:46:38.429 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:38.429 INFO:teuthology.orchestra.run.smithi002.stdout: == Test hardlink create protection when 2023-11-25T07:46:38.430 INFO:teuthology.orchestra.run.smithi002.stdout: == process != target owner and process cannot read target 2023-11-25T07:46:38.430 INFO:teuthology.orchestra.run.smithi002.stdout: fs.protected_hardlinks = 0 2023-11-25T07:46:38.430 INFO:teuthology.orchestra.run.smithi002.stdout: -successfully created hardlink 2023-11-25T07:46:38.430 INFO:teuthology.orchestra.run.smithi002.stdout: +Permission denied 2023-11-25T07:46:38.430 INFO:teuthology.orchestra.run.smithi002.stdout: fs.protected_hardlinks = 1 2023-11-25T07:46:38.430 INFO:teuthology.orchestra.run.smithi002.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-11-25T07:46:38.430 INFO:teuthology.orchestra.run.smithi002.stdout: +Permission denied 2023-11-25T07:46:38.431 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/597 2023-11-25T07:46:38.431 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/597 2023-11-25T07:46:38.431 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T07:46:38.433 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:38.442 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T07:46:38.443 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T07:46:38.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T07:46:38.443 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-11-25T07:46:38.927 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:38.931 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:38.931 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:39.403 INFO:teuthology.orchestra.run.smithi002.stdout:generic/598 - output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/598.out.bad) 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/598.out 2023-11-25 04:09:45.793123921 +0000 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/598.out.bad 2023-11-25 07:46:39.399803194 +0000 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -5,13 +5,10 @@ 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: = only group writable dir 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: fs.protected_regular = 1 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: = group & world writable dir 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: -Permission denied 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: = only group writable dir 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: fs.protected_regular = 2 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: = group & world writable dir 2023-11-25T07:46:39.405 INFO:teuthology.orchestra.run.smithi002.stdout: -Permission denied 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: = only group writable dir 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: -Permission denied 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: fs.protected_fifos = 0 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -19,10 +16,7 @@ 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: = only group writable dir 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: fs.protected_fifos = 1 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: = group & world writable dir 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: -Permission denied 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: = only group writable dir 2023-11-25T07:46:39.406 INFO:teuthology.orchestra.run.smithi002.stdout: fs.protected_fifos = 2 2023-11-25T07:46:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: = group & world writable dir 2023-11-25T07:46:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: -Permission denied 2023-11-25T07:46:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: = only group writable dir 2023-11-25T07:46:39.407 INFO:teuthology.orchestra.run.smithi002.stdout: -Permission denied 2023-11-25T07:46:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/598 2023-11-25T07:46:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/598 2023-11-25T07:46:39.407 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T07:46:39.410 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:39.418 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T07:46:39.419 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T07:46:39.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T07:46:39.419 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-11-25T07:46:39.908 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:39.912 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:40.023 INFO:teuthology.orchestra.run.smithi002.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/599 2023-11-25T07:46:40.026 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/599 2023-11-25T07:46:40.027 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:40.029 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:40.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:40.038 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-11-25T07:46:40.216 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:40.220 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:40.220 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:40.331 INFO:teuthology.orchestra.run.smithi002.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:40.334 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/600 2023-11-25T07:46:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/600 2023-11-25T07:46:40.335 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:40.337 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:40.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:40.346 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-11-25T07:46:40.518 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:40.522 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:40.523 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:40.647 INFO:teuthology.orchestra.run.smithi002.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:40.650 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/601 2023-11-25T07:46:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/601 2023-11-25T07:46:40.651 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:40.653 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:40.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:40.662 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-11-25T07:46:40.835 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:40.840 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:40.840 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:40.978 INFO:teuthology.orchestra.run.smithi002.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:40.981 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/602 2023-11-25T07:46:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/602 2023-11-25T07:46:40.982 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:40.984 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:40.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:40.993 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-11-25T07:46:41.168 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:41.172 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:41.172 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:41.284 INFO:teuthology.orchestra.run.smithi002.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/603 2023-11-25T07:46:41.287 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/603 2023-11-25T07:46:41.288 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:41.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:41.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:41.298 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-11-25T07:46:41.473 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:41.478 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:41.478 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:41.588 INFO:teuthology.orchestra.run.smithi002.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/604 2023-11-25T07:46:41.591 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/604 2023-11-25T07:46:41.592 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:41.594 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:41.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:41.603 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-11-25T07:46:41.776 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:41.780 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:41.781 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:41.891 INFO:teuthology.orchestra.run.smithi002.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/605 2023-11-25T07:46:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/605 2023-11-25T07:46:41.895 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:41.897 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:41.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:41.906 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-11-25T07:46:42.079 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:42.083 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:42.083 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:42.192 INFO:teuthology.orchestra.run.smithi002.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/606 2023-11-25T07:46:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/606 2023-11-25T07:46:42.196 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:42.198 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:42.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:42.207 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-11-25T07:46:42.381 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:42.385 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:42.385 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:42.500 INFO:teuthology.orchestra.run.smithi002.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/607 2023-11-25T07:46:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/607 2023-11-25T07:46:42.505 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:42.506 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:42.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:42.515 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-11-25T07:46:42.690 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:42.694 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:42.695 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:42.803 INFO:teuthology.orchestra.run.smithi002.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/608 2023-11-25T07:46:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/608 2023-11-25T07:46:42.807 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:42.810 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:42.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:42.818 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-11-25T07:46:42.993 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:42.997 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:42.997 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:43.370 INFO:teuthology.orchestra.run.smithi002.stdout:generic/609 0s 2023-11-25T07:46:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/609 2023-11-25T07:46:43.376 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:43.378 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:43.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:43.387 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-11-25T07:46:43.872 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:43.876 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:43.876 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:43.985 INFO:teuthology.orchestra.run.smithi002.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/610 2023-11-25T07:46:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/610 2023-11-25T07:46:43.988 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:43.991 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:44.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:44.000 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-11-25T07:46:44.175 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:44.179 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:44.180 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:44.289 INFO:teuthology.orchestra.run.smithi002.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/611 2023-11-25T07:46:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/611 2023-11-25T07:46:44.293 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:44.296 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:44.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:44.305 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-11-25T07:46:44.479 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:44.483 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:44.483 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:44.663 INFO:teuthology.orchestra.run.smithi002.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T07:46:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/612 2023-11-25T07:46:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/612 2023-11-25T07:46:44.666 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:44.669 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:44.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:44.677 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-11-25T07:46:45.164 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:45.168 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:45.168 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:45.305 INFO:teuthology.orchestra.run.smithi002.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:45.309 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/613 2023-11-25T07:46:45.309 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/613 2023-11-25T07:46:45.309 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:45.311 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:45.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:45.329 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-11-25T07:46:45.502 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:45.507 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:45.507 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:45.616 INFO:teuthology.orchestra.run.smithi002.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:45.619 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/614 2023-11-25T07:46:45.620 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/614 2023-11-25T07:46:45.620 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:45.622 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:45.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:45.631 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-11-25T07:46:45.885 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:45.889 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:45.890 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:46.000 INFO:teuthology.orchestra.run.smithi002.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:46.003 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/615 2023-11-25T07:46:46.004 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/615 2023-11-25T07:46:46.004 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:46.006 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:46.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:46.015 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-11-25T07:46:46.188 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:46.192 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:46.193 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:46.305 INFO:teuthology.orchestra.run.smithi002.stdout:generic/616 [not run] kernel does not support IO_URING 2023-11-25T07:46:46.309 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/616 2023-11-25T07:46:46.309 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/616 2023-11-25T07:46:46.309 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:46.311 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:46.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:46.321 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-11-25T07:46:46.494 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:46.497 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:46.498 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:46.653 INFO:teuthology.orchestra.run.smithi002.stdout:generic/617 [not run] kernel does not support IO_URING 2023-11-25T07:46:46.657 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/617 2023-11-25T07:46:46.657 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/617 2023-11-25T07:46:46.657 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:46.659 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:46.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:46.668 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-11-25T07:46:46.842 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:46.846 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:46.846 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:46.956 INFO:teuthology.orchestra.run.smithi002.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:46.960 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/618 2023-11-25T07:46:46.960 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/618 2023-11-25T07:46:46.960 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:46.962 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:46.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:46.971 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-11-25T07:46:47.147 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:47.151 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:47.151 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:47.262 INFO:teuthology.orchestra.run.smithi002.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:47.266 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/619 2023-11-25T07:46:47.266 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/619 2023-11-25T07:46:47.266 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:47.268 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:47.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:47.288 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-11-25T07:46:47.461 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:47.465 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:47.465 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:47.603 INFO:teuthology.orchestra.run.smithi002.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:47.607 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/620 2023-11-25T07:46:47.607 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/620 2023-11-25T07:46:47.607 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:47.609 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:47.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:47.618 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-11-25T07:46:47.805 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:47.809 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:47.809 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:47.964 INFO:teuthology.orchestra.run.smithi002.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:47.967 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/621 2023-11-25T07:46:47.968 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/621 2023-11-25T07:46:47.968 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:47.970 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:47.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:47.980 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-11-25T07:46:48.153 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:48.157 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:48.157 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:48.269 INFO:teuthology.orchestra.run.smithi002.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:48.273 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/622 2023-11-25T07:46:48.273 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/622 2023-11-25T07:46:48.273 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:48.275 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:48.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:48.285 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-11-25T07:46:48.459 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:48.463 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:48.463 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:48.577 INFO:teuthology.orchestra.run.smithi002.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:48.581 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/623 2023-11-25T07:46:48.581 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/623 2023-11-25T07:46:48.581 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:48.583 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:48.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:48.592 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-11-25T07:46:48.765 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:48.769 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:48.770 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:48.881 INFO:teuthology.orchestra.run.smithi002.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:48.884 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/624 2023-11-25T07:46:48.885 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/624 2023-11-25T07:46:48.885 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:48.887 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:48.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:48.896 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-11-25T07:46:49.072 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:49.077 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:49.077 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:49.188 INFO:teuthology.orchestra.run.smithi002.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:49.192 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/625 2023-11-25T07:46:49.192 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/625 2023-11-25T07:46:49.192 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:49.194 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:49.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:49.204 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-11-25T07:46:49.380 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:49.385 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:49.385 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:49.503 INFO:teuthology.orchestra.run.smithi002.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:49.507 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/626 2023-11-25T07:46:49.507 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/626 2023-11-25T07:46:49.507 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:49.509 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:49.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:49.518 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-11-25T07:46:49.692 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:49.696 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:49.696 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:49.814 INFO:teuthology.orchestra.run.smithi002.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:49.817 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/627 2023-11-25T07:46:49.817 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/627 2023-11-25T07:46:49.818 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:49.820 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:49.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:49.829 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-11-25T07:46:50.004 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:50.008 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:50.008 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:50.144 INFO:teuthology.orchestra.run.smithi002.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:50.148 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/628 2023-11-25T07:46:50.148 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/628 2023-11-25T07:46:50.148 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:50.150 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:50.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:50.160 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-11-25T07:46:50.332 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:50.336 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:50.337 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:50.457 INFO:teuthology.orchestra.run.smithi002.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:50.460 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/629 2023-11-25T07:46:50.461 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/629 2023-11-25T07:46:50.461 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:50.463 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:50.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:50.485 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-11-25T07:46:50.658 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:50.662 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:50.662 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:50.771 INFO:teuthology.orchestra.run.smithi002.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:50.775 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/630 2023-11-25T07:46:50.776 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/630 2023-11-25T07:46:50.776 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:50.777 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:50.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:50.786 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-11-25T07:46:50.960 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:50.964 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:50.965 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:51.074 INFO:teuthology.orchestra.run.smithi002.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:51.077 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/631 2023-11-25T07:46:51.078 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/631 2023-11-25T07:46:51.078 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:51.080 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:51.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:51.089 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-11-25T07:46:51.262 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:51.266 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:51.266 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:53.976 INFO:teuthology.orchestra.run.smithi002.stdout:generic/632 2s 2023-11-25T07:46:54.006 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/632 2023-11-25T07:46:54.006 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:54.009 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:54.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:54.018 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-11-25T07:46:54.192 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:54.196 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:54.196 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:54.474 INFO:teuthology.orchestra.run.smithi002.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/633.out.bad) 2023-11-25T07:46:54.505 INFO:teuthology.orchestra.run.smithi002.stdout: --- tests/generic/633.out 2023-11-25 04:09:45.796123851 +0000 2023-11-25T07:46:54.505 INFO:teuthology.orchestra.run.smithi002.stdout: +++ /tmp/tmp.qL1lhbO0Esxfstests-dev/results//generic/633.out.bad 2023-11-25 07:46:54.471444519 +0000 2023-11-25T07:46:54.505 INFO:teuthology.orchestra.run.smithi002.stdout: @@ -1,2 +1,5 @@ 2023-11-25T07:46:54.505 INFO:teuthology.orchestra.run.smithi002.stdout: QA output created by 633 2023-11-25T07:46:54.506 INFO:teuthology.orchestra.run.smithi002.stdout: Silence is golden 2023-11-25T07:46:54.506 INFO:teuthology.orchestra.run.smithi002.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2023-11-25T07:46:54.506 INFO:teuthology.orchestra.run.smithi002.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2023-11-25T07:46:54.506 INFO:teuthology.orchestra.run.smithi002.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2023-11-25T07:46:54.513 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/633 2023-11-25T07:46:54.513 INFO:teuthology.orchestra.run.smithi002.stdout:Failures: generic/633 2023-11-25T07:46:54.513 INFO:teuthology.orchestra.run.smithi002.stdout:Failed 1 of 1 tests 2023-11-25T07:46:54.517 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:54.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T07:46:54.534 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-25T07:46:54.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-25T07:46:54.534 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-11-25T07:46:54.956 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:54.960 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:54.960 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:55.069 INFO:teuthology.orchestra.run.smithi002.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/634 2023-11-25T07:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/634 2023-11-25T07:46:55.073 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:55.075 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:55.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:55.084 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-11-25T07:46:55.265 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:55.269 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:55.269 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:55.378 INFO:teuthology.orchestra.run.smithi002.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:55.381 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/635 2023-11-25T07:46:55.381 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/635 2023-11-25T07:46:55.381 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:55.383 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:55.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:55.392 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-11-25T07:46:55.564 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:55.569 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:55.569 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:55.679 INFO:teuthology.orchestra.run.smithi002.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:55.682 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/636 2023-11-25T07:46:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/636 2023-11-25T07:46:55.683 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:55.685 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:55.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:55.693 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-11-25T07:46:55.867 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:55.871 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:55.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:56.877 INFO:teuthology.orchestra.run.smithi002.stdout:generic/637 1s 2023-11-25T07:46:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/637 2023-11-25T07:46:56.882 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:56.884 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:56.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:56.894 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-11-25T07:46:57.423 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:57.427 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:57.427 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:57.595 INFO:teuthology.orchestra.run.smithi002.stdout:generic/638 0s 2023-11-25T07:46:57.600 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/638 2023-11-25T07:46:57.600 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:57.603 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:57.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:57.613 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-11-25T07:46:57.787 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:57.792 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:57.792 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:58.722 INFO:teuthology.orchestra.run.smithi002.stdout:generic/639 1s 2023-11-25T07:46:58.728 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/639 2023-11-25T07:46:58.728 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:58.731 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:58.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:58.742 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-11-25T07:46:58.921 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:58.925 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:58.925 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:59.045 INFO:teuthology.orchestra.run.smithi002.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:59.049 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/640 2023-11-25T07:46:59.049 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/640 2023-11-25T07:46:59.049 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:59.051 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:59.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:59.060 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-11-25T07:46:59.234 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:59.239 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:59.240 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:59.348 INFO:teuthology.orchestra.run.smithi002.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:59.351 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/641 2023-11-25T07:46:59.352 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/641 2023-11-25T07:46:59.352 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:59.354 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:59.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:59.363 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-11-25T07:46:59.535 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:59.539 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:59.539 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:59.652 INFO:teuthology.orchestra.run.smithi002.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:59.656 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/642 2023-11-25T07:46:59.656 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/642 2023-11-25T07:46:59.656 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:59.658 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:59.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:59.668 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-11-25T07:46:59.843 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:46:59.847 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:46:59.847 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:59.956 INFO:teuthology.orchestra.run.smithi002.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:46:59.960 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/643 2023-11-25T07:46:59.960 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/643 2023-11-25T07:46:59.960 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:46:59.962 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:46:59.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:46:59.972 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-11-25T07:47:00.147 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:47:00.151 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:47:00.151 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:00.262 INFO:teuthology.orchestra.run.smithi002.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-11-25T07:47:00.266 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/644 2023-11-25T07:47:00.266 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/644 2023-11-25T07:47:00.266 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:47:00.268 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:00.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:47:00.277 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-11-25T07:47:00.449 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:47:00.453 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:47:00.454 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:00.564 INFO:teuthology.orchestra.run.smithi002.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-11-25T07:47:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/645 2023-11-25T07:47:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/645 2023-11-25T07:47:00.568 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:47:00.570 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:00.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:47:00.581 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-11-25T07:47:00.753 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:47:00.757 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:47:00.757 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:00.865 INFO:teuthology.orchestra.run.smithi002.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:47:00.869 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/646 2023-11-25T07:47:00.869 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/646 2023-11-25T07:47:00.869 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:47:00.871 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:00.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:47:00.881 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-11-25T07:47:01.055 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:47:01.059 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:47:01.059 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:01.336 INFO:teuthology.orchestra.run.smithi002.stdout:generic/647 0s 2023-11-25T07:47:01.341 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/647 2023-11-25T07:47:01.341 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:47:01.343 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:01.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:47:01.352 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-11-25T07:47:01.812 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:47:01.816 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:47:01.816 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:01.939 INFO:teuthology.orchestra.run.smithi002.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-11-25T07:47:01.943 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/648 2023-11-25T07:47:01.943 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/648 2023-11-25T07:47:01.943 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:47:01.945 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:01.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:47:01.955 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-11-25T07:47:02.127 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:47:02.131 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:47:02.131 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:02.294 INFO:teuthology.orchestra.run.smithi002.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-11-25T07:47:02.297 INFO:teuthology.orchestra.run.smithi002.stdout:Ran: generic/649 2023-11-25T07:47:02.297 INFO:teuthology.orchestra.run.smithi002.stdout:Not run: generic/649 2023-11-25T07:47:02.297 INFO:teuthology.orchestra.run.smithi002.stdout:Passed all 1 tests 2023-11-25T07:47:02.300 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:02.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-25T07:47:02.309 DEBUG:teuthology.orchestra.run.smithi002:> (cd /tmp/tmp.qL1lhbO0Esxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-11-25T07:47:02.753 INFO:teuthology.orchestra.run.smithi002.stdout:FSTYP -- ceph-fuse 2023-11-25T07:47:02.758 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM -- Linux/x86_64 smithi002 5.14.0-386.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Nov 15 10:38:22 UTC 2023 2023-11-25T07:47:02.758 INFO:teuthology.orchestra.run.smithi002.stdout: 2023-11-25T07:47:03.133 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:47:03.135 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:47:33.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:47:33.756 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:48:03.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:48:03.905 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:48:34.275 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:48:34.285 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:49:04.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:49:04.488 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:49:34.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:49:34.663 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:50:04.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:50:04.863 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:50:35.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:50:35.135 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:51:05.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:51:05.360 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:51:35.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:51:35.542 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:52:05.711 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:52:05.721 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:52:36.000 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:52:36.007 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:53:06.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:53:06.323 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:53:36.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:53:36.500 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:54:06.748 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:54:06.756 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:54:36.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:54:36.955 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:55:07.414 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:55:07.421 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:55:37.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:55:37.598 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:56:07.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:56:07.767 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:56:37.972 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:56:37.986 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:57:08.135 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:57:08.139 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:57:38.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:57:38.306 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:58:08.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:58:08.477 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:58:38.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:58:38.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:59:08.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:59:08.883 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:59:39.050 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T07:59:39.058 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:00:09.273 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:00:09.278 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:00:39.449 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:00:39.455 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:01:09.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:01:09.663 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:01:39.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:01:39.863 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:02:10.042 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:02:10.050 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:02:40.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:02:40.271 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:03:10.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:03:10.435 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:03:40.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:03:40.682 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:04:10.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:04:10.983 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:04:41.157 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:04:41.162 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:05:06.111 INFO:tasks.ceph.osd.3.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7506-gec928368/rpm/el9/BUILD/ceph-18.0.0-7506-gec928368/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc603d79640 time 2023-11-25T08:05:06.106662+0000 2023-11-25T08:05:06.111 INFO:tasks.ceph.osd.3.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7506-gec928368/rpm/el9/BUILD/ceph-18.0.0-7506-gec928368/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-11-25T08:05:06.111 INFO:tasks.ceph.osd.3.smithi002.stderr: ceph version 18.0.0-7506-gec928368 (ec928368edcc5fc71884a56fd9fd821b148f4e30) reef (dev) 2023-11-25T08:05:06.111 INFO:tasks.ceph.osd.3.smithi002.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x560d499b0e3b] 2023-11-25T08:05:06.111 INFO:tasks.ceph.osd.3.smithi002.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x560d4a2ffda6] 2023-11-25T08:05:06.111 INFO:tasks.ceph.osd.3.smithi002.stderr: 3: ceph-osd(+0xd9ff91) [0x560d4a2e0f91] 2023-11-25T08:05:06.111 INFO:tasks.ceph.osd.3.smithi002.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fc61149f802] 2023-11-25T08:05:06.112 INFO:tasks.ceph.osd.3.smithi002.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fc61143f450] 2023-11-25T08:05:06.112 INFO:tasks.ceph.osd.3.smithi002.stderr:*** Caught signal (Aborted) ** 2023-11-25T08:05:06.112 INFO:tasks.ceph.osd.3.smithi002.stderr: in thread 7fc603d79640 thread_name:bstore_aio 2023-11-25T08:05:06.134 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T08:05:06.089+0000 7fc603d79640 -1 bdev(0x560d4b9e8e00 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-5 ((5) Input/output error) 2023-11-25T08:05:06.134 INFO:tasks.ceph.osd.3.smithi002.stderr:2023-11-25T08:05:06.108+0000 7fc603d79640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7506-gec928368/rpm/el9/BUILD/ceph-18.0.0-7506-gec928368/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc603d79640 time 2023-11-25T08:05:06.106662+0000 2023-11-25T08:05:06.134 INFO:tasks.ceph.osd.3.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7506-gec928368/rpm/el9/BUILD/ceph-18.0.0-7506-gec928368/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-11-25T08:05:06.135 INFO:tasks.ceph.osd.3.smithi002.stderr: 2023-11-25T08:05:06.135 INFO:tasks.ceph.osd.3.smithi002.stderr: ceph version 18.0.0-7506-gec928368 (ec928368edcc5fc71884a56fd9fd821b148f4e30) reef (dev) 2023-11-25T08:05:06.135 INFO:tasks.ceph.osd.3.smithi002.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x560d499b0e3b] 2023-11-25T08:05:06.135 INFO:tasks.ceph.osd.3.smithi002.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x560d4a2ffda6] 2023-11-25T08:05:06.135 INFO:tasks.ceph.osd.3.smithi002.stderr: 3: ceph-osd(+0xd9ff91) [0x560d4a2e0f91] 2023-11-25T08:05:06.135 INFO:tasks.ceph.osd.3.smithi002.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fc61149f802] 2023-11-25T08:05:06.135 INFO:tasks.ceph.osd.3.smithi002.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fc61143f450] 2023-11-25T08:05:06.135 INFO:tasks.ceph.osd.3.smithi002.stderr: 2023-11-25T08:05:06.207 INFO:tasks.ceph.osd.3.smithi002.stderr: ceph version 18.0.0-7506-gec928368 (ec928368edcc5fc71884a56fd9fd821b148f4e30) reef (dev) 2023-11-25T08:05:06.207 INFO:tasks.ceph.osd.3.smithi002.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fc611454db0] 2023-11-25T08:05:06.208 INFO:tasks.ceph.osd.3.smithi002.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fc6114a154c] 2023-11-25T08:05:06.208 INFO:tasks.ceph.osd.3.smithi002.stderr: 3: raise() 2023-11-25T08:05:06.208 INFO:tasks.ceph.osd.3.smithi002.stderr: 4: abort() 2023-11-25T08:05:06.208 INFO:tasks.ceph.osd.3.smithi002.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x560d499b0efc] 2023-11-25T08:05:06.208 INFO:tasks.ceph.osd.3.smithi002.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x560d4a2ffda6] 2023-11-25T08:05:06.208 INFO:tasks.ceph.osd.3.smithi002.stderr: 7: ceph-osd(+0xd9ff91) [0x560d4a2e0f91] 2023-11-25T08:05:06.208 INFO:tasks.ceph.osd.3.smithi002.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fc61149f802] 2023-11-25T08:05:06.208 INFO:tasks.ceph.osd.3.smithi002.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fc61143f450] 2023-11-25T08:05:06.217 INFO:tasks.ceph.osd.3.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7506-gec928368/rpm/el9/BUILD/ceph-18.0.0-7506-gec928368/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc602d77640 time 2023-11-25T08:05:06.214047+0000 2023-11-25T08:05:06.217 INFO:tasks.ceph.osd.3.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7506-gec928368/rpm/el9/BUILD/ceph-18.0.0-7506-gec928368/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-11-25T08:05:06.224 INFO:tasks.ceph.osd.3.smithi002.stderr: ceph version 18.0.0-7506-gec928368 (ec928368edcc5fc71884a56fd9fd821b148f4e30) reef (dev) 2023-11-25T08:05:06.224 INFO:tasks.ceph.osd.3.smithi002.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x560d499b0e3b] 2023-11-25T08:05:06.224 INFO:tasks.ceph.osd.3.smithi002.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x560d4a2ffda6] 2023-11-25T08:05:06.224 INFO:tasks.ceph.osd.3.smithi002.stderr: 3: ceph-osd(+0xd9ff91) [0x560d4a2e0f91] 2023-11-25T08:05:06.224 INFO:tasks.ceph.osd.3.smithi002.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fc61149f802] 2023-11-25T08:05:06.224 INFO:tasks.ceph.osd.3.smithi002.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fc61143f450] 2023-11-25T08:05:11.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:05:11.305 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:05:16.685 INFO:tasks.ceph.osd.3.smithi002.stderr:daemon-helper: command crashed with signal 6 2023-11-25T08:05:20.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-25T08:05:26.645 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~7s 2023-11-25T08:05:33.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~13s 2023-11-25T08:05:39.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-11-25T08:05:45.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:05:45.658 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:05:46.483 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~26s 2023-11-25T08:05:53.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~33s 2023-11-25T08:05:59.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2023-11-25T08:06:06.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~46s 2023-11-25T08:06:12.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~53s 2023-11-25T08:06:15.801 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:06:15.808 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:06:22.217 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~62s 2023-11-25T08:06:28.829 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~69s 2023-11-25T08:06:35.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~75s 2023-11-25T08:06:42.055 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~82s 2023-11-25T08:06:46.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:06:46.049 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:06:48.668 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~89s 2023-11-25T08:06:55.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~95s 2023-11-25T08:07:01.892 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~102s 2023-11-25T08:07:08.505 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~108s 2023-11-25T08:07:15.117 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~115s 2023-11-25T08:07:16.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:07:16.304 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:07:21.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~122s 2023-11-25T08:07:28.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~128s 2023-11-25T08:07:34.955 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~135s 2023-11-25T08:07:41.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~142s 2023-11-25T08:07:46.508 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:07:46.518 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:07:48.179 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~148s 2023-11-25T08:07:54.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~155s 2023-11-25T08:08:01.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~161s 2023-11-25T08:08:08.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~168s 2023-11-25T08:08:14.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~175s 2023-11-25T08:08:16.696 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:08:16.703 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:08:21.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~181s 2023-11-25T08:08:27.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~188s 2023-11-25T08:08:34.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~194s 2023-11-25T08:08:41.077 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~201s 2023-11-25T08:08:46.835 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:08:46.842 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:08:47.281 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T08:08:47.279+0000 7fe9009f3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 562878) UID: 0 2023-11-25T08:08:47.290 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T08:08:47.285+0000 7f607a7b0640 -1 Fail to open '/proc/562878/cmdline' error = (2) No such file or directory 2023-11-25T08:08:47.290 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T08:08:47.285+0000 7f607a7b0640 -1 received signal: Hangup from (PID: 562878) UID: 0 2023-11-25T08:08:47.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~208s 2023-11-25T08:08:54.298 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~214s 2023-11-25T08:09:00.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~221s 2023-11-25T08:09:07.522 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~227s 2023-11-25T08:09:14.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~234s 2023-11-25T08:09:20.745 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~241s 2023-11-25T08:09:27.356 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~247s 2023-11-25T08:09:33.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~254s 2023-11-25T08:09:40.580 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~261s 2023-11-25T08:09:47.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~267s 2023-11-25T08:09:53.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~274s 2023-11-25T08:10:00.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~280s 2023-11-25T08:10:07.027 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~287s 2023-11-25T08:10:13.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~294s 2023-11-25T08:10:20.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~300s 2023-11-25T08:10:20.252 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-11-25T08:10:20.253 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T08:10:20.253 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T08:10:20.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057150,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1302 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 ceph-fuse /tmp/tmp.VDcWebYyYttest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-11-25T08:10:20.350 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi002.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2023-11-25T08:10:20.350 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T08:10:20.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T08:10:20.351 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-25T08:10:20.411 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2023-11-25T08:10:20.411 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T08:10:20.454 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057150,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1302 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249488k,nr_inodes=812372,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498980k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 ceph-fuse /tmp/tmp.VDcWebYyYttest fuse.ceph-fuse rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other 0 0 2023-11-25T08:10:20.455 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.2 is not mounted at ubuntu@smithi002.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.2 2023-11-25T08:10:20.455 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi002.front.sepia.ceph.com 2023-11-25T08:10:20.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T08:10:20.455 DEBUG:teuthology.orchestra.run.smithi002:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-25T08:10:20.552 INFO:teuthology.orchestra.run.smithi002.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-11-25T08:10:20.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T08:10:20.553 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T08:10:20.553 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T08:10:20.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056359,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1258 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-25T08:10:20.586 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.1 is not mounted at ubuntu@smithi066.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1 2023-11-25T08:10:20.587 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T08:10:20.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T08:10:20.587 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-25T08:10:20.649 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T08:10:20.754 INFO:teuthology.orchestra.run.smithi066.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-11-25T08:10:20.754 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-11-25T08:10:20.754 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-25T08:10:20.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056359,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1258 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248856k,nr_inodes=812214,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497712k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-25T08:10:20.810 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.3 is not mounted at ubuntu@smithi066.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.3 2023-11-25T08:10:20.810 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2023-11-25T08:10:20.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-25T08:10:20.811 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-25T08:10:20.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-25T08:10:20.869 INFO:teuthology.orchestra.run.smithi066.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-11-25T08:10:22.480 INFO:tasks.ceph.osd.0:Sent signal 15 2023-11-25T08:10:22.481 INFO:tasks.ceph.osd.1:Sent signal 15 2023-11-25T08:10:22.481 INFO:tasks.ceph.osd.2:Sent signal 15 2023-11-25T08:10:22.481 INFO:tasks.ceph.osd.4:Sent signal 15 2023-11-25T08:10:22.482 INFO:tasks.ceph.osd.5:Sent signal 15 2023-11-25T08:10:22.482 INFO:tasks.ceph.osd.6:Sent signal 15 2023-11-25T08:10:22.482 INFO:tasks.ceph.osd.7:Sent signal 15 2023-11-25T08:10:22.483 INFO:tasks.ceph.mds.a:Sent signal 15 2023-11-25T08:10:22.483 INFO:tasks.ceph.mds.c:Sent signal 15 2023-11-25T08:10:22.483 INFO:tasks.ceph.mds.b:Sent signal 15 2023-11-25T08:10:22.484 INFO:tasks.ceph.mds.d:Sent signal 15 2023-11-25T08:10:22.484 INFO:tasks.ceph.mon.a:Sent signal 15 2023-11-25T08:10:22.484 INFO:tasks.ceph.mon.b:Sent signal 15 2023-11-25T08:10:22.485 INFO:tasks.ceph.mon.c:Sent signal 15 2023-11-25T08:10:22.485 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-11-25T08:10:22.485 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-11-25T08:10:22.486 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f82c4e49640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 89431) UID: 0 2023-11-25T08:10:22.490 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f82c4e49640 -1 osd.4 35 *** Got signal Terminated *** 2023-11-25T08:10:22.490 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f82c4e49640 -1 osd.4 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-25T08:10:22.491 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f24fefda640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 89433) UID: 0 2023-11-25T08:10:22.491 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f24fefda640 -1 osd.5 35 *** Got signal Terminated *** 2023-11-25T08:10:22.491 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f24fefda640 -1 osd.5 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-25T08:10:22.492 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f46899b2640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 89434) UID: 0 2023-11-25T08:10:22.492 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f46899b2640 -1 osd.6 35 *** Got signal Terminated *** 2023-11-25T08:10:22.492 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f46899b2640 -1 osd.6 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-25T08:10:22.492 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f36e3756640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 89437) UID: 0 2023-11-25T08:10:22.493 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f36e3756640 -1 osd.7 35 *** Got signal Terminated *** 2023-11-25T08:10:22.493 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-11-25T08:10:22.481+0000 7f36e3756640 -1 osd.7 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-25T08:10:22.493 INFO:tasks.ceph.mds.b.smithi066.stderr:2023-11-25T08:10:22.482+0000 7f9243ce4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 96491) UID: 0 2023-11-25T08:10:22.494 INFO:tasks.ceph.mds.b.smithi066.stderr:2023-11-25T08:10:22.482+0000 7f9243ce4640 -1 mds.b *** got signal Terminated *** 2023-11-25T08:10:22.494 INFO:tasks.ceph.mds.d.smithi066.stderr:2023-11-25T08:10:22.483+0000 7f97fbaab640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 96492) UID: 0 2023-11-25T08:10:22.494 INFO:tasks.ceph.mds.d.smithi066.stderr:2023-11-25T08:10:22.483+0000 7f97fbaab640 -1 mds.d *** got signal Terminated *** 2023-11-25T08:10:22.495 INFO:tasks.ceph.mon.b.smithi066.stderr:2023-11-25T08:10:22.483+0000 7f72f65aa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 88862) UID: 0 2023-11-25T08:10:22.495 INFO:tasks.ceph.mon.b.smithi066.stderr:2023-11-25T08:10:22.483+0000 7f72f65aa640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-11-25T08:10:22.496 INFO:tasks.ceph.mon.c.smithi066.stderr:2023-11-25T08:10:22.484+0000 7f4b7f13e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 88864) UID: 0 2023-11-25T08:10:22.496 INFO:tasks.ceph.mon.c.smithi066.stderr:2023-11-25T08:10:22.484+0000 7f4b7f13e640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-11-25T08:10:22.497 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T08:10:22.482+0000 7fe9009f3640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 101515) UID: 0 2023-11-25T08:10:22.497 INFO:tasks.ceph.mds.a.smithi002.stderr:2023-11-25T08:10:22.482+0000 7fe9009f3640 -1 mds.a *** got signal Terminated *** 2023-11-25T08:10:22.497 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T08:10:22.487+0000 7f607a7b0640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 101516) UID: 0 2023-11-25T08:10:22.497 INFO:tasks.ceph.mds.c.smithi002.stderr:2023-11-25T08:10:22.487+0000 7f607a7b0640 -1 mds.c *** got signal Terminated *** 2023-11-25T08:10:22.498 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-25T08:10:22.487+0000 7f16808ce640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 89030) UID: 0 2023-11-25T08:10:22.498 INFO:tasks.ceph.mon.a.smithi002.stderr:2023-11-25T08:10:22.487+0000 7f16808ce640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-11-25T08:10:22.498 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T08:10:22.491+0000 7feffe992640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 89315) UID: 0 2023-11-25T08:10:22.498 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T08:10:22.491+0000 7feffe992640 -1 osd.2 35 *** Got signal Terminated *** 2023-11-25T08:10:22.499 INFO:tasks.ceph.osd.2.smithi002.stderr:2023-11-25T08:10:22.491+0000 7feffe992640 -1 osd.2 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-25T08:10:22.499 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T08:10:22.495+0000 7fa32f6d4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 89301) UID: 0 2023-11-25T08:10:22.499 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T08:10:22.495+0000 7f7298afa640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 89314) UID: 0 2023-11-25T08:10:22.500 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T08:10:22.495+0000 7f7298afa640 -1 osd.1 35 *** Got signal Terminated *** 2023-11-25T08:10:22.500 INFO:tasks.ceph.osd.1.smithi002.stderr:2023-11-25T08:10:22.495+0000 7f7298afa640 -1 osd.1 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-25T08:10:22.500 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T08:10:22.495+0000 7fa32f6d4640 -1 osd.0 35 *** Got signal Terminated *** 2023-11-25T08:10:22.500 INFO:tasks.ceph.osd.0.smithi002.stderr:2023-11-25T08:10:22.495+0000 7fa32f6d4640 -1 osd.0 35 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-11-25T08:10:22.686 INFO:tasks.ceph.mgr.x.smithi066.stderr:daemon-helper: command crashed with signal 15 2023-11-25T08:16:07.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:16:07.546 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:16:37.669 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:16:37.673 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:17:07.792 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:17:07.796 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:17:37.915 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:17:37.922 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:18:08.046 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:18:08.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:18:38.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:18:38.174 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:19:08.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:19:08.293 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:19:38.412 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:19:38.416 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:20:08.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:20:08.539 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:20:38.655 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:20:38.660 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:21:08.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:21:08.783 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:21:38.901 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:21:38.905 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:22:09.014 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:22:09.019 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:22:39.136 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:22:39.140 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:23:09.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:23:09.290 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:23:39.422 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:23:39.426 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:24:09.545 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:24:09.549 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:24:39.700 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:24:39.704 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:25:09.823 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:25:09.827 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:25:39.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:25:39.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:26:10.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:26:10.063 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:26:40.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:26:40.210 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:27:10.328 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:27:10.332 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:27:40.441 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:27:40.446 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:28:10.570 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:28:10.574 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:28:40.685 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:28:40.690 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:29:10.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:29:10.804 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:29:40.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:29:40.935 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:30:11.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:30:11.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:30:41.175 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:30:41.179 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:31:11.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:31:11.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:31:41.427 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:31:41.431 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:32:11.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:32:11.554 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:32:41.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:32:41.694 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:33:11.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:33:11.808 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:33:41.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:33:41.938 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:34:12.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:34:12.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:34:42.186 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:34:42.190 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:35:12.300 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:35:12.305 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:35:42.430 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:35:42.434 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:36:12.552 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:36:12.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:36:42.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:36:42.690 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:37:12.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:37:12.818 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:37:42.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:37:42.940 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:38:13.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:38:13.054 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:38:43.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:38:43.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:39:13.318 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:39:13.337 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:39:43.465 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:39:43.470 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:40:13.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:40:13.594 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:40:43.710 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:40:43.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:41:13.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:41:13.853 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:41:43.980 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:41:43.984 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:42:14.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:42:14.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:42:44.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:42:44.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:43:14.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:43:14.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:43:44.501 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:43:44.756 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:44:14.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:44:14.878 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:44:45.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:44:45.009 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:45:15.135 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:45:15.139 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:45:45.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:45:45.281 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:46:15.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:46:15.400 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:46:45.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:46:45.530 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:47:15.657 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:47:15.662 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:47:45.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:47:45.792 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:48:15.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:48:15.915 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:48:46.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:48:46.053 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:49:16.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:49:16.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:49:46.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:49:46.314 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:50:16.439 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:50:16.444 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:50:46.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:50:46.568 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:51:16.694 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:51:16.699 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:51:46.818 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:51:46.822 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:52:16.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:52:16.943 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:52:47.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:52:47.073 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:53:17.200 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:53:17.204 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:53:47.330 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:53:47.335 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:54:17.451 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:54:17.457 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:54:47.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:54:47.588 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:55:17.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:55:17.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:55:47.827 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:55:47.831 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:56:17.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:56:17.952 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:56:48.079 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:56:48.083 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:57:18.218 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:57:18.222 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:57:48.368 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:57:48.372 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:58:18.488 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:58:18.492 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:58:48.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:58:48.627 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:59:18.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:59:18.754 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:59:48.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T08:59:48.892 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:00:19.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:00:19.005 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:00:49.149 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:00:49.153 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:01:19.271 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:01:19.277 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:01:49.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:01:49.423 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:02:19.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:02:19.598 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:02:49.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:02:49.718 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:03:19.835 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:03:19.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:03:49.974 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:03:49.978 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:04:20.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:04:20.103 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:04:50.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:04:50.223 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:05:20.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:05:20.345 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:05:50.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:05:50.541 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:06:20.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:06:20.729 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:06:50.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:06:50.969 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:07:21.095 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:07:21.100 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:07:51.226 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:07:51.231 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:08:21.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:08:21.353 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:08:51.479 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:08:51.484 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:09:21.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:09:21.623 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:09:51.741 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:09:51.745 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:10:21.871 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:10:21.876 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:10:51.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:10:51.997 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:11:22.116 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:11:22.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:11:52.239 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:11:52.247 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:12:22.368 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:12:22.372 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:12:52.500 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:12:52.504 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:13:22.623 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:13:22.627 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:13:52.744 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:13:52.748 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:14:22.943 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:14:22.948 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:14:53.080 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:14:53.085 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:15:23.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:15:23.207 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:15:53.333 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:15:53.337 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:16:23.471 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:16:23.475 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:16:53.602 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:16:53.607 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:17:23.724 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:17:23.728 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:17:53.838 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:17:53.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:18:23.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:18:23.991 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:18:54.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:18:54.128 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:19:24.263 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:19:24.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:19:54.484 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:19:54.488 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:20:24.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:20:24.620 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:20:54.746 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:20:54.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:21:24.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:21:24.874 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:21:54.990 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:21:54.995 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:22:25.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:22:25.142 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:22:55.268 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:22:55.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:23:25.424 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:23:25.428 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:23:55.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:23:55.559 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:24:25.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:24:25.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:24:55.824 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:24:55.828 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:25:25.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:25:25.942 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:25:56.069 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:25:56.075 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:26:26.199 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:26:26.204 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:26:56.329 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:26:56.333 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:27:26.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:27:26.456 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:27:56.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:27:56.587 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:28:26.697 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:28:26.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:28:56.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:28:56.840 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:29:26.965 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:29:26.970 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:29:57.097 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:29:57.101 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:30:27.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:30:27.223 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:30:57.350 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:30:57.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:31:27.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:31:27.485 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:31:57.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:31:57.616 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:32:27.732 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:32:27.737 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:32:57.865 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:32:57.869 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:33:28.002 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:33:28.007 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:33:58.133 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:33:58.138 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:34:28.256 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:34:28.260 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:34:58.397 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:34:58.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:35:28.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:35:28.529 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:35:58.648 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:35:58.652 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:36:28.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:36:28.844 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:36:58.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:36:58.971 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:37:29.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:37:29.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:37:59.237 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:37:59.241 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:38:29.351 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:38:29.357 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:38:59.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:38:59.494 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:39:29.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:39:29.617 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:39:59.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:39:59.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:40:29.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:40:29.877 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:41:00.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:41:00.017 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:41:30.137 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:41:30.142 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:42:00.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:42:00.278 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:42:30.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:42:30.400 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:43:00.534 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:43:00.568 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:43:30.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:43:30.703 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:44:00.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:44:00.832 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:44:30.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:44:30.963 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:45:01.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:45:01.093 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:45:31.211 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:45:31.216 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:46:01.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:46:01.347 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:46:31.472 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:46:31.476 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:47:01.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:47:01.608 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:47:31.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:47:31.730 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:48:01.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:48:01.861 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:48:31.970 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:48:31.974 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:49:02.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:49:02.104 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:49:32.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:49:32.244 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:50:02.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:50:02.374 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:50:32.518 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:50:32.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:51:02.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:51:02.661 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:51:32.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:51:32.792 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:52:02.910 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:52:02.914 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:52:33.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:52:33.045 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:53:03.162 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:53:03.167 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:53:33.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:53:33.315 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:54:03.448 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:54:03.452 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:54:33.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:54:33.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:55:03.717 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:55:03.722 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:55:33.831 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:55:33.835 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:56:03.962 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:56:03.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:56:34.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:56:34.105 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:57:04.240 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:57:04.245 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:57:34.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:57:34.367 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:58:04.485 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:58:04.489 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:58:34.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:58:34.621 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:59:04.746 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:59:04.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:59:34.876 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T09:59:34.881 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:00:05.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:00:05.012 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:00:35.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:00:35.135 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:01:05.261 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:01:05.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:01:35.383 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:01:35.388 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:02:05.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:02:05.519 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:02:35.653 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:02:35.657 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:03:05.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:03:05.788 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:03:35.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:03:35.910 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:04:06.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:04:06.040 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:04:36.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:04:36.163 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:05:06.289 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:05:06.293 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:05:36.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:05:36.415 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:06:06.542 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:06:06.546 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:06:36.663 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:06:36.668 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:07:06.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:07:06.799 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:07:36.925 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:07:36.929 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:08:07.055 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:08:07.059 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:08:37.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:08:37.182 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:09:07.300 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:09:07.305 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:09:37.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:09:37.435 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:10:07.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:10:07.565 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:10:37.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:10:37.695 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:11:07.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:11:07.826 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:11:37.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:11:37.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:12:08.075 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:12:08.079 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:12:38.205 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:12:38.209 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:13:08.336 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:13:08.340 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:13:38.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:13:38.473 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:14:08.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:14:08.600 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:14:38.727 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:14:38.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:15:08.875 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:15:08.879 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:15:39.006 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:15:39.010 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:16:09.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:16:09.124 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:16:39.241 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:16:39.246 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:17:09.363 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:17:09.368 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:17:39.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:17:39.494 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:18:09.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:18:09.631 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:18:39.754 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:18:39.759 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:19:09.884 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:19:09.888 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:19:39.998 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:19:40.002 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:20:10.146 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:20:10.150 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:20:40.269 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:20:40.273 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:21:10.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:21:10.419 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:21:40.537 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:21:40.541 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:22:10.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:22:10.682 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:22:40.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:22:40.812 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:23:10.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:23:10.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:23:41.076 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:23:41.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:24:11.207 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:24:11.211 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:24:41.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:24:41.341 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:25:11.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:25:11.473 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:25:41.591 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:25:41.595 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:26:11.712 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:26:11.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:26:41.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:26:41.830 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:27:11.940 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:27:11.945 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:27:42.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:27:42.058 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:28:12.185 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:28:12.190 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:28:42.315 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:28:42.319 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:29:12.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:29:12.450 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:29:42.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:29:42.580 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:30:12.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:30:12.711 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:30:42.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:30:42.833 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:31:12.959 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:31:12.964 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:31:43.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:31:43.088 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:32:13.223 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:32:13.228 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:32:43.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:32:43.347 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:33:13.473 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:33:13.478 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:33:43.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:33:43.608 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:34:13.734 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:34:13.739 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:34:43.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:34:43.861 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:35:13.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:35:13.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:35:44.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:35:44.106 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:36:14.223 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:36:14.227 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:36:44.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:36:44.358 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:37:14.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:37:14.481 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:37:44.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:37:44.603 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:38:14.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:38:14.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:38:44.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:38:44.863 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:39:14.990 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:39:14.995 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:39:45.104 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:39:45.109 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:40:15.243 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:40:15.247 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:40:45.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:40:45.378 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:41:15.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:41:15.518 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:41:45.642 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:41:45.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:42:15.787 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:42:15.791 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:42:45.917 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:42:45.921 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:43:16.048 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:43:16.054 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:43:46.178 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:43:46.196 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:44:16.343 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:44:16.347 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:44:46.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:44:46.478 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:45:16.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:45:16.609 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:45:46.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:45:46.731 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:46:16.858 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:46:16.862 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:46:46.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:46:46.992 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:47:17.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:47:17.123 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:47:47.249 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:47:47.254 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:48:17.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:48:17.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:48:47.511 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:48:47.515 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:49:17.658 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:49:17.663 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:49:47.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:49:47.792 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:50:17.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:50:17.925 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:50:48.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:50:48.044 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:51:18.171 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:51:18.179 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:51:48.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:51:48.315 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:52:18.457 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:52:18.477 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:52:48.588 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:52:48.592 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:53:18.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:53:18.723 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:53:48.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:53:48.853 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:54:18.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:54:18.984 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:54:49.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:54:49.114 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:55:19.248 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:55:19.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:55:49.371 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:55:49.375 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:56:19.503 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:56:23.031 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:56:53.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:56:53.161 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:57:23.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:57:23.283 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:57:53.409 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:57:53.413 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:58:23.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:58:23.537 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:58:53.662 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:58:53.666 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:59:23.785 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:59:23.790 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:59:53.915 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T10:59:53.919 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:00:24.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:00:24.033 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:00:54.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:00:54.164 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:01:24.298 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:01:24.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:01:54.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:01:54.426 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:02:24.543 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:02:24.547 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:02:54.665 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:02:54.669 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:03:24.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:03:24.801 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:03:54.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:03:54.932 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:04:25.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:04:25.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:04:55.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:04:55.309 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:05:25.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:05:25.448 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:05:55.565 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:05:55.569 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:06:25.695 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:06:25.699 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:06:55.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:06:55.830 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:07:25.956 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:07:25.961 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:07:56.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:07:56.093 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:08:26.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:08:26.214 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:08:56.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:08:56.328 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:09:26.454 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:09:26.459 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:09:56.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:09:56.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:10:26.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:10:29.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:10:59.396 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:10:59.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:11:29.517 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:11:29.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:11:59.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:11:59.655 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:12:29.774 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:12:29.779 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:12:59.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:12:59.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:13:30.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:13:30.028 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:14:00.163 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:14:00.167 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:14:30.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:14:30.288 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:15:00.415 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:15:00.422 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:15:30.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:15:30.550 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:16:00.668 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:16:00.675 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:16:30.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:16:30.811 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:17:00.937 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:17:00.941 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:17:31.059 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:17:31.064 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:18:01.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:18:01.186 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:18:31.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:18:31.317 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:19:01.443 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:19:01.447 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:19:31.573 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:19:31.576 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:20:01.686 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:20:01.690 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:20:31.825 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:20:31.830 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:21:01.948 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:21:01.952 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:21:32.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:21:32.093 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:22:02.209 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:22:02.213 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:22:32.339 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:22:32.343 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:23:02.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:23:02.535 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:23:32.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:23:32.664 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:24:02.789 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:24:02.794 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:24:32.920 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:24:32.924 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:25:03.043 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:25:03.047 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:25:33.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:25:33.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:26:03.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:26:03.317 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:26:33.470 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:26:33.480 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:27:03.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:27:03.594 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:27:33.713 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:27:33.717 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:28:03.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:28:03.848 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:28:33.974 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:28:33.978 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:29:04.087 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:29:04.092 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:29:34.236 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:29:34.240 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:30:04.365 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:30:04.369 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:30:34.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:30:34.500 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:31:04.618 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:31:04.623 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:31:34.757 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:31:34.762 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:32:04.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:32:04.892 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:32:35.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:32:35.049 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:33:05.166 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:33:05.170 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:33:35.296 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:33:35.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:34:05.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:34:05.422 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:34:35.549 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:34:35.555 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:35:05.687 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:35:05.693 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:35:35.827 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:35:35.831 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:36:05.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:36:05.970 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:36:36.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:36:36.100 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:37:06.210 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:37:06.214 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:37:36.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:37:36.353 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:38:06.480 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:38:06.484 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:38:36.611 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:38:36.616 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:39:06.750 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:39:06.754 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:39:36.888 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:39:36.892 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:40:07.010 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:40:07.015 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:40:37.141 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:40:37.152 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:41:07.297 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:41:07.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:41:37.419 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:41:37.426 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:42:07.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:42:07.563 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:42:37.697 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:42:37.702 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:43:07.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:43:07.834 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:43:37.969 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:43:37.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:44:08.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:44:08.118 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:44:38.245 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:44:38.251 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:45:08.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:45:08.388 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:45:38.514 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:45:38.518 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:46:08.652 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:46:08.656 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:46:38.808 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:46:38.812 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:47:08.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:47:08.926 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:47:39.053 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:47:39.057 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:48:09.201 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:48:09.205 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:48:39.339 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:48:39.343 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:49:09.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:49:09.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:49:39.592 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:49:39.597 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:50:09.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:50:09.718 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:50:39.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:50:39.840 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:51:09.975 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:51:09.980 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:51:40.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:51:40.093 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:52:10.202 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:52:10.207 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:52:40.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:52:40.320 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:53:10.438 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:53:10.442 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:53:40.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:53:40.572 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:54:10.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:54:10.688 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:54:40.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:54:40.809 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:55:10.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:55:10.923 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:55:41.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:55:41.111 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:56:11.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:56:11.226 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:56:41.354 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:56:41.359 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:57:11.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:57:11.480 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:57:41.615 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:57:41.619 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:58:11.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:58:11.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:58:41.927 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:58:41.932 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:59:12.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:59:12.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:59:42.187 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T11:59:42.191 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:00:12.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:00:12.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:00:42.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:00:42.437 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:01:12.554 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:01:12.561 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:01:42.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:01:42.698 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:02:12.807 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:02:12.813 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:02:42.939 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:02:42.945 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:03:13.068 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:03:13.072 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:03:43.215 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:03:43.219 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:04:13.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:04:13.350 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:04:43.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:04:43.481 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:05:13.598 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:05:13.602 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:05:43.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:05:43.735 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:06:13.851 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:06:13.856 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:06:44.008 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:06:44.015 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:07:14.129 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:07:14.134 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:07:44.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:07:44.271 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:08:14.384 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:08:14.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:08:44.520 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:08:44.525 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:09:14.649 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:09:14.653 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:09:44.780 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:09:44.784 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:10:14.893 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:10:14.898 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:10:45.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:10:45.030 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:11:15.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:11:15.151 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:11:45.277 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:11:45.282 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:12:15.401 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:12:15.412 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:12:45.572 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:12:45.577 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:13:15.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:13:15.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:13:45.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:13:45.836 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:14:15.954 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:14:15.959 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:14:46.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:14:46.098 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:15:16.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:15:16.222 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:15:46.355 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:15:46.360 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:16:16.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:16:16.473 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:16:46.608 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:16:46.613 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:17:16.729 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:17:16.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:17:46.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:17:46.865 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:18:16.982 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:18:16.987 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:18:47.120 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:18:47.125 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:19:17.308 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:19:17.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:19:47.433 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:19:47.438 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:20:17.562 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:20:17.566 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:20:47.693 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:20:47.700 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:21:17.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:21:17.819 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:21:47.945 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:21:47.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:22:18.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:22:18.097 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:22:48.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:22:48.235 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:23:18.353 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:23:18.357 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:23:48.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:23:48.495 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:24:18.605 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:24:18.610 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:24:48.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:24:48.740 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:25:18.874 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:25:18.879 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:25:49.013 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:25:49.018 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:26:19.127 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:26:19.131 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:26:49.258 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:26:49.262 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:27:19.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:27:19.385 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:27:49.519 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:27:49.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:28:19.634 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:28:19.641 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:28:49.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:28:49.777 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:29:19.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:29:19.898 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:29:50.033 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:29:50.037 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:30:20.155 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:30:20.163 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:30:50.294 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:30:50.299 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:31:20.417 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:31:20.422 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:31:50.556 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:31:50.561 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:32:20.670 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:32:20.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:32:50.799 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:32:50.804 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:33:20.922 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:33:20.927 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:33:51.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:33:51.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:34:21.183 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:34:21.187 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:34:51.313 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:34:51.319 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:35:21.436 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:35:21.440 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:35:51.576 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:35:51.581 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:36:21.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:36:21.709 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:36:51.826 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:36:51.842 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:37:21.957 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:37:21.961 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:37:52.105 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:37:52.109 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:38:22.227 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:38:22.231 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:38:52.366 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:38:52.370 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:39:22.487 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:39:22.491 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:39:52.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:39:52.613 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:40:22.731 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:40:22.735 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:40:52.879 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:40:52.884 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:41:22.993 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:41:22.997 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:41:53.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:41:53.129 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:42:23.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:42:23.259 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:42:53.397 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:42:53.405 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:43:23.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:43:23.532 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:43:53.680 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:43:53.687 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:44:23.803 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:44:23.811 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:44:53.932 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:44:53.940 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:45:24.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:45:24.059 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:45:54.191 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:45:54.196 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:46:24.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:46:24.326 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:46:54.452 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:46:54.457 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:47:24.575 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:47:24.579 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:47:54.706 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:47:54.710 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:48:24.827 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:48:24.831 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:48:54.967 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:48:54.971 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:49:25.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:49:25.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:49:55.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:49:55.224 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:50:25.342 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:50:25.347 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:50:55.488 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:50:55.493 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:51:25.610 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:51:25.614 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:51:55.748 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:51:55.753 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:52:25.871 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:52:25.876 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:52:56.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:52:56.009 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:53:26.132 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:53:26.137 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:53:56.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:53:56.268 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:54:26.392 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:54:26.397 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:54:56.523 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:54:56.528 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:55:26.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:55:26.661 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:55:56.793 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:55:56.798 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:56:26.931 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:56:26.935 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:56:57.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:56:57.059 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:57:27.177 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:57:27.183 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:57:57.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:57:57.321 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:58:27.430 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:58:27.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:58:57.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:58:57.573 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:59:27.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:59:27.711 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:59:57.846 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T12:59:57.851 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:00:27.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:00:27.973 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:00:58.115 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:00:58.119 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:01:28.237 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:01:28.242 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:01:58.361 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:01:58.365 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:02:28.491 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:02:28.496 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:02:58.621 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:02:58.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:03:28.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:03:28.747 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:03:58.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:03:58.877 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:04:28.987 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:04:28.992 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:04:59.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:04:59.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:05:29.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:05:29.236 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:05:59.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:05:59.369 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:06:29.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:06:29.499 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:06:59.626 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:06:59.631 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:07:29.738 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:07:29.743 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:07:59.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:07:59.874 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:08:29.999 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:08:30.003 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:09:00.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:09:00.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:09:30.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:09:30.314 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:10:00.499 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:10:00.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:10:30.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:10:30.636 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:11:00.770 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:11:00.775 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:11:30.891 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:11:30.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:12:01.022 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:12:01.027 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:12:31.144 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:12:31.149 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:13:01.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:13:01.279 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:13:31.397 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:13:31.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:14:01.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:14:01.532 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:14:31.649 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:14:31.654 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:15:01.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:15:01.809 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:15:31.926 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:15:31.931 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:16:02.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:16:02.062 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:16:32.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:16:32.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:17:02.310 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:17:02.314 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:17:32.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:17:32.431 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:18:02.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:18:02.584 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:18:32.702 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:18:32.707 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:19:02.857 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:19:02.861 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:19:32.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:19:32.983 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:20:03.110 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:20:03.114 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:20:33.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:20:33.235 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:21:03.370 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:21:03.374 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:21:33.493 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:21:33.497 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:22:03.673 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:22:03.680 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:22:33.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:22:33.809 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:23:03.926 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:23:03.930 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:23:34.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:23:34.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:24:04.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:24:04.174 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:24:34.300 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:24:34.304 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:25:04.430 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:25:04.437 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:25:34.562 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:25:34.568 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:26:04.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:26:04.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:26:34.814 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:26:34.819 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:27:04.944 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:27:04.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:27:35.067 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:27:35.072 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:28:05.198 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:28:05.204 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:28:35.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:28:35.324 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:29:05.449 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:29:05.453 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:29:35.571 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:29:35.576 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:30:05.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:30:05.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:30:35.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:30:35.837 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:31:05.964 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:31:05.969 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:31:36.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:31:36.091 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:32:06.224 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:32:06.229 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:32:36.337 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:32:36.342 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:33:06.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:33:06.481 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:33:36.625 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:33:36.635 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:34:06.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:34:06.768 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:34:36.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:34:36.889 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:35:07.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:35:07.025 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:35:37.145 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:35:37.150 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:36:07.284 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:36:07.289 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:36:37.432 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:36:37.437 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:37:07.562 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:37:07.567 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:37:37.692 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:37:37.697 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:38:07.831 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:38:07.836 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:38:37.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:38:37.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:39:08.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:39:08.105 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:39:38.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:39:38.227 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:40:08.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:40:08.357 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:40:38.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:40:38.481 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:41:08.614 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:41:08.619 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:41:38.736 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:41:38.744 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:42:08.936 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:42:08.942 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:42:39.066 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:42:39.071 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:43:09.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:43:09.198 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:43:39.316 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:43:39.321 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:44:09.462 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:44:09.466 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:44:39.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:44:39.581 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:45:09.715 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:45:09.719 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:45:39.837 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:45:39.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:46:09.976 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:46:09.981 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:46:40.098 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:46:40.106 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:47:10.231 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:47:10.235 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:47:40.360 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:47:40.365 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:48:10.490 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:48:10.495 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:48:40.612 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:48:40.617 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:49:10.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:49:10.764 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:49:40.881 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:49:40.886 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:50:11.012 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:50:11.016 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:50:41.142 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:50:41.147 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:51:11.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:51:11.340 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:51:41.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:51:41.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:52:11.607 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:52:11.616 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:52:41.726 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:52:41.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:53:11.866 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:53:11.872 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:53:41.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:53:42.006 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:54:12.140 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:54:12.145 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:54:42.262 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:54:42.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:55:12.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:55:12.420 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:55:42.557 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:55:42.563 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:56:12.700 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:56:12.712 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:56:42.833 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:56:42.838 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:57:12.963 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:57:12.968 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:57:43.085 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:57:43.090 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:58:13.217 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:58:13.224 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:58:43.340 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:58:43.345 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:59:13.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:59:13.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:59:43.583 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T13:59:43.586 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:00:13.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:00:13.718 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:00:43.836 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:00:43.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:01:13.984 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:01:13.989 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:01:44.106 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:01:44.110 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:02:14.244 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:02:14.248 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:02:44.366 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:02:44.371 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:03:14.496 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:03:14.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:03:44.619 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:03:44.624 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:04:14.758 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:04:14.762 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:04:44.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:04:44.877 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:05:15.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:05:15.006 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:05:45.125 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:05:45.129 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:06:15.264 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:06:15.269 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:06:45.386 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:06:45.390 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:07:15.525 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:07:15.530 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:07:45.656 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:07:45.660 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:08:15.786 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:08:15.791 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:08:45.916 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:08:45.920 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:09:16.054 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:09:16.058 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:09:46.168 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:09:46.172 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:10:16.299 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:10:16.305 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:10:46.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:10:46.451 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:11:16.569 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:11:16.574 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:11:46.698 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:11:46.703 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:12:16.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:12:16.834 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:12:46.951 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:12:46.956 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:13:17.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:13:17.100 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:13:47.245 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:13:47.251 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:14:17.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:14:17.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:14:47.498 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:14:47.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:15:17.645 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:15:17.650 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:15:47.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:15:47.772 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:16:17.897 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:16:17.902 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:16:48.027 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:16:48.032 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:17:18.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:17:18.163 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:17:48.274 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:17:48.279 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:18:18.397 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:18:18.402 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:18:48.527 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:18:48.532 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:19:18.657 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:19:18.661 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:19:48.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:19:48.783 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:20:18.919 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:20:18.923 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:20:49.040 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:20:49.045 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:21:19.170 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:21:19.175 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:21:49.302 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:21:49.314 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:22:19.448 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:22:19.453 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:22:49.579 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:22:49.583 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:23:19.709 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:23:19.715 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:23:49.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:23:49.855 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:24:19.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:24:19.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:24:50.084 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:24:50.088 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:25:20.214 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:25:20.218 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:25:50.336 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:25:50.341 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:26:20.469 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:26:20.474 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:26:50.590 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:26:50.594 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:27:20.728 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:27:20.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:27:50.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:27:50.865 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:28:20.989 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:28:20.994 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:28:51.111 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:28:51.115 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:29:21.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:29:21.272 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:29:51.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:29:51.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:30:21.511 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:30:21.515 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:30:51.633 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:30:51.637 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:31:21.764 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:31:21.768 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:31:51.878 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:31:51.882 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:32:22.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:32:22.021 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:32:52.220 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:32:52.224 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:33:22.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:33:22.357 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:33:52.476 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:33:52.480 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:34:22.676 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:34:22.681 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:34:52.794 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:34:52.798 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:35:22.926 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:35:22.931 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:35:53.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:35:53.061 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:36:23.195 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:36:23.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:36:53.320 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:36:53.324 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:37:23.454 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:37:23.460 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:37:53.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:37:53.581 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:38:23.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:38:23.714 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:38:53.829 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:38:53.838 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:39:23.968 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:39:23.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:39:54.099 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:39:54.103 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:40:24.230 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:40:24.238 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:40:54.352 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:40:54.356 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:41:24.492 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:41:24.499 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:41:54.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:41:54.644 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:42:24.767 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:42:24.773 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:42:54.890 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:42:54.896 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:43:25.029 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:43:25.035 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:43:55.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:43:55.164 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:44:25.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:44:25.296 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:44:55.431 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:44:55.437 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:45:25.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:45:25.571 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:45:55.701 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:45:55.705 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:46:25.828 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:46:25.834 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:46:56.017 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:46:56.022 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:47:26.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:47:26.156 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:47:56.278 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:47:56.286 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:48:26.411 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:48:26.416 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:48:56.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:48:56.536 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:49:26.663 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:49:26.667 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:49:56.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:49:56.790 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:50:26.915 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:50:26.919 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:50:57.047 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:50:57.056 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:51:27.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:51:27.185 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:51:57.307 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:51:57.312 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:52:27.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:52:27.449 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:52:57.567 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:52:57.571 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:53:27.697 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:53:27.705 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:53:57.820 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:53:57.824 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:54:27.958 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:54:27.963 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:54:58.089 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:54:58.093 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:55:28.219 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:55:28.223 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:55:58.333 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:55:58.337 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:56:28.455 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:56:28.459 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:56:58.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:56:58.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:57:28.692 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:57:28.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:57:58.869 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:57:58.873 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:58:29.003 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:58:29.007 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:58:59.124 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:58:59.128 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:59:29.255 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:59:29.260 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:59:59.378 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T14:59:59.382 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:00:29.516 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:00:29.520 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:00:59.630 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:00:59.634 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:01:29.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:01:29.765 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:01:59.875 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:01:59.880 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:02:30.005 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:02:30.010 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:03:00.128 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:03:00.132 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:03:30.267 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:03:30.272 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:04:00.389 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:04:00.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:04:30.519 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:04:30.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:05:00.650 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:05:00.654 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:05:30.788 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:05:30.792 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:06:00.911 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:06:00.915 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:06:31.061 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:06:31.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:07:01.184 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:07:01.189 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:07:31.322 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:07:31.326 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:08:01.444 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:08:01.448 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:08:31.578 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:08:31.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:09:01.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:09:01.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:09:31.822 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:09:31.826 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:10:01.943 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:10:01.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:10:32.075 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:10:32.079 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:11:02.188 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:11:02.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:11:32.327 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:11:32.331 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:12:02.450 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:12:02.454 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:12:32.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:12:32.591 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:13:02.711 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:13:02.715 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:13:32.840 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:13:32.844 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:14:02.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:14:02.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:14:33.169 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:14:33.173 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:15:03.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:15:03.295 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:15:33.429 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:15:33.433 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:16:03.551 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:16:03.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:16:33.682 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:16:33.686 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:17:03.812 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:17:03.816 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:17:33.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:17:33.941 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:18:04.145 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:18:04.149 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:18:34.279 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:18:34.284 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:19:04.418 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:19:04.422 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:19:34.548 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:19:34.553 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:20:04.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:20:04.675 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:20:34.810 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:20:34.814 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:21:04.932 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:21:04.936 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:21:35.062 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:21:35.067 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:22:05.193 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:22:05.197 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:22:35.324 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:22:35.328 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:23:05.445 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:23:05.450 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:23:35.585 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:23:35.589 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:24:05.707 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:24:05.711 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:24:35.837 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:24:35.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:25:05.977 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:25:05.981 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:25:36.107 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:25:36.111 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:26:06.221 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:26:06.225 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:26:36.351 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:26:36.355 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:27:06.465 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:27:06.469 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:27:36.604 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:27:36.608 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:28:06.725 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:28:06.729 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:28:36.856 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:28:36.860 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:29:06.971 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:29:06.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:29:37.100 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:29:37.104 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:30:07.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:30:07.227 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:30:37.361 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:30:37.365 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:31:07.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:31:07.566 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:31:37.689 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:31:37.693 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:32:07.802 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:32:07.806 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:32:37.934 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:32:37.942 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:33:08.064 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:33:08.068 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:33:38.194 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:33:38.200 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:34:08.325 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:34:08.329 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:34:38.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:34:38.450 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:35:08.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:35:08.565 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:35:38.691 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:35:38.695 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:36:08.805 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:36:08.809 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:36:38.953 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:36:38.957 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:37:09.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:37:09.078 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:37:39.222 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:37:39.228 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:38:09.344 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:38:09.348 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:38:39.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:38:39.479 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:39:09.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:39:09.600 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:39:39.719 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:39:39.723 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:40:09.841 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:40:09.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:40:39.997 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:40:40.003 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:41:10.118 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:41:10.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:41:40.241 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:41:40.245 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:42:10.362 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:42:10.366 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:42:40.502 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:42:40.506 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:43:10.624 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:43:10.628 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:43:40.763 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:43:40.768 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:44:10.885 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:44:10.889 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:44:41.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:44:41.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:45:11.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:45:11.143 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:45:41.268 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:45:41.272 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:46:11.390 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:46:11.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:46:41.529 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:46:41.533 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:47:11.650 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:47:11.654 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:47:41.781 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:47:41.785 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:48:11.905 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:48:11.909 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:48:42.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:48:42.038 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:49:12.156 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:49:12.160 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:49:42.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:49:42.291 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:50:12.400 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:50:12.405 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:50:42.531 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:50:42.536 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:51:12.654 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:51:12.658 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:51:42.784 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:51:42.788 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:52:12.906 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:52:12.910 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:52:43.036 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:52:43.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:53:13.162 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:53:13.167 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:53:43.293 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:53:43.298 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:54:13.416 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:54:13.420 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:54:43.546 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:54:43.550 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:55:13.660 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:55:13.664 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:55:43.790 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:55:43.794 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:56:13.930 DEBUG:teuthology.orchestra.run.smithi002:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:56:13.934 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-25T15:56:41.713 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-11-25T15:56:44.169 DEBUG:teuthology.task.console_log:Killing console logger for smithi002 2023-11-25T15:56:44.170 DEBUG:teuthology.task.console_log:Killing console logger for smithi066 2023-11-25T15:56:44.170 DEBUG:teuthology.exit:Finished running handlers